Discover and read the best of Twitter Threads about #replication

Most recents (12)

1/50 #Science is an ongoing process that serves to investigate phenomena, gain new insights or "correct prior knowledge" and this only works in #discourse. This includes diversity of #Opinion, #tolerance and a broad debate space. This is a large thread.
2/50 "#trust the science" is in my view the most #antiscience statement ever. #Questioning science is how you do #Science. This thread gives some examples and further questions.
scientificamerican.com/article/why-do…
3/50 What about good ##scientific #Practice? I found a glaring example here (of all things, in what I consider to be a rush to #vaccine #approval). #blotgate
trialsitenews.com/a/startling-ev…
Read 28 tweets
1/6 I think that a #DeSci economy that covers all aspects of #academia in one ecosystem (#publications, #peerreview, and #funding) is more valuable and more likely to succeed in the long run than a project that covers only one or two of these aspects. Why? ...
2/6 Because of #networkeffects. All three parts of academia co-depend and influence each other. There are positive network externalities to solving problems in publishing, peer review, and funding to other parts of #academia. ...
3/6 And if such an integrated #DeSci solution helps to reward #scientists more fairly, solve their #funding problems, and raise the standards of #peerreview and #publications, every #scientist would want to be a part of it. ...
Read 6 tweets
Our paper is live! Can fMRI measure well-being? Can the "positive-negative axis" from @fmrib_steve et al. be seen in a larger, independent dataset w/younger subs collected across sites and scanners? Want it as a preregistered replication? Read on! doi.org/10.1098/rsos.2… 1/14 Smith et al 2015 results fi...
Using code made publicly available by @fmrib_steve, we first did an exact computational replications of their 2015 Nature Neuroscience paper. It worked! You can read about that at BioRxiv: doi.org/10.1101/2020.0… 2/14
Next, we wondered if this same relationship would show up in a totally independent, younger, cross-scanner dataset like the ABCD study funded by @NIAAAnews @NIDAnews @NIMHgov @NICHD_NIH @NINDSfunding @NIHOBSSR @NIMHD @NIH 3/14 Image
Read 14 tweets
How the #DigitalDevelopment community thinks about sharing #information, #resources, and #data and partners to advance #DigitalTransformation will be key to creating #impact from our efforts and ensuring country #governments can replicate them to better serve their #citizens.
DIAL thinks about #partnerships in everything it does—in fact, were founded in 2015 by a partnership of #global #donors seeking to connect incredibly promising #DigitalDevelopment efforts that had failed to achieve #scale.
Read 20 tweets
#JSM2021 an exceptionally rare case of ACTUAL out of sample prediction in #MachineLearning #ML #AI: two rounds of the same health data collection by @CDCgov
@CDCgov Yulei He @cdcgov #JSM2021 RANDS 1 (fall 2015) + 2 (spring 2016): Build models on RANDS1 and compare predictions for RANDS2

ridge, lasso, elastic net, PLS, KNN, bagging, RF, GBM, XGBoost, SVM, deep learning
#JSM2021 Yulei He R-square about 30%; random forests and grad boosting reduce the prediction error by about 4%, shrinking towards the mean; standard errors are way to small (-50% than should be)
Read 4 tweets
Folks have been curious about what I found replicating papers

While I believe in showing grace, respect, and due scientific process before naming names, here is a (slightly snarky) thread on 10 things I’ve learned through #replication

Remember we are all prone to error (1/12)
1.Coding errors do affect published results.

Those that lower p-values seem to be harder for authors to debug. (2/12)
2. Extra significance stars sometimes show up on key estimates.

Maybe that’s where falling stars go. 💫‍ (3/12)
Read 13 tweets
Survived another ASHG plenary talk :)

In case you missed it, I presented results on behalf of @Regeneron from a trans-ancestry #COVID19 meta-analysis of common and rare variants + gene burden tests in >883k imputed samples and >592k exomes.
#ASHG20
Using REGENIE developed by @joellembatchou and @marchini (SAIGE gave us some bizarre results with rare variants) to run our common and rare variant GWASes, we found 2 loci associated with susceptibility and 3 loci with hospitalization. #ASHG20
Curiously, despite losing ~75% of the cases, we found more loci with hospitalization than using all COVID19 positive individuals - @covid19_hgi sees the same pattern.

One might suspect a severe COVID19 GWAS would be even more powerful at the same sample size
#ASHG20
Read 10 tweets
Some personal good news in hard times: Joined with wonderful coauthors @Chris_ptz @pvillenueve we just published our paper „The macroeconomic effects of social security contributions and benefits” in the Journal of Monetary Economics doi.org/10.1016/j.jmon… #econtwitter Thread: Image
The gist of the paper is to estimate #macroeconomic #multiplier effects of spending on #socialsecurity vs. cutting contributions. The literature shows it is hard to estimate such effects, because spending and revenues are highly endogenous to the business cycle./2
We did a lot of nitpicking work conducting a time series of timing+size+circumstances of major legislations of social security in GER 1970q1-2018q4 (inspired by seminal work of Cristina+David Romer 2010 AER). This shall identify exogenous changes for causal analysis./3
Read 21 tweets
First completed systematic review on antimalarials (#hydrochloroquine #chloroquine) for #Covid_19
It is a rigorous SR conducted rapidly, NOT a rapid review (less rigour)
Submitted today to journal but preliminary report here to avoid delay in decision-making (1/4🧵)
For others to replicate, we share search strategy and downloadable files
Published and ongoing studies continuously updated here:
app.iloveevidence.com/loves/5e6fdb96…
Let's advocate for #replication not #duplication (waste) in evidence synthesis.
Also, collaboration more than welcome (2/4🧵)
It includes first RCT with reported data.
It has negative findings. Portrays different picture than questionable study hitting the news days ago (Gautret et al)
Thanks to @ConfucioUST for translation (Chinese to English). We are exploring copyright issues before sharing
(3/4🧵)
Read 4 tweets
1/ My research article out today in @ScienceAdvances shows U.S. agriculture has become considerably more sensitive to climatic shocks since the 1980s in key core regions like the Midwest.
- Cornell Chronicle: bit.ly/2PyLwF2 (w/ video)
- Paper: bit.ly/2UGLpuP
2/ This is joint work with @Barefoot_Econ and Bob Chambers (Maryland) and was funded by @NSF and @USDA_NIFA. I also thank @AtkinsonCenter for their support.
3/ Most of the growth in agricultural production in the US has been driven by gains in productivity over the past 50 years. We wanted to know whether these profound transformations altered the sector's ability to cope with extreme climatic events.
Read 17 tweets
Five hours in @Reagan_Airport and still here; twice rebooked due to thunderstorms—hope I make it to Boston tonight for tomorrow's IEEE #reproducibility workshop.
As the @IEEEorg steps into the #reproducibility discussion, I'm really hoping they'll pay attention to terminology—"Terminologies for Reproducible Research" arxiv.org/abs/1802.03311
My assessment after reviewing literature from more than a dozen fields is that the predominant usage for #reproducibility is “same data+same methods=same results.”
Read 10 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!