Discover and read the best of Twitter Threads about #replicability
Most recents (5)
Join us at #SIPS2022 tomorrow to help make rock solid tools for transparent neuroscience!
We believe the right kind of tools can make methods reporting smoother and less error-prone.
We’ll introduce the ARTEM-IS Web-App (beta) for you to try, and we can work on improving it! 🧵
We believe the right kind of tools can make methods reporting smoother and less error-prone.
We’ll introduce the ARTEM-IS Web-App (beta) for you to try, and we can work on improving it! 🧵
Accurate methods reporting is super important because different processing pathways can lead to different results, as we’ve shown in one multiverse analysis of N400s 🤔
(see how the Related version Reversed comparison has different outcomes in different pathways)
(see how the Related version Reversed comparison has different outcomes in different pathways)
If we want to improve #reproducibility and #replicability in our field, we need to make sure we can accurately report what has been done - which path was taken through the Garden of Forking Paths?
Lots of reporting guidelines currently exist but…
Lots of reporting guidelines currently exist but…
Daily Bookmarks to GAVNet 10/10/2021 greeneracresvaluenetwork.wordpress.com/2021/10/10/dai…
Dynamic Time Warping explained using Python and HAR dataset
analyticsvidhya.com/blog/2021/10/d…
#dynamic #TimeWarping #algorithms #TimeSeriesClassification #MachineLearning #PredictionAccuracy
analyticsvidhya.com/blog/2021/10/d…
#dynamic #TimeWarping #algorithms #TimeSeriesClassification #MachineLearning #PredictionAccuracy
The Problem With Science is Scientists
stemplet74.substack.com/p/the-problem-…
#RationalThinking #intuition #instinct #HumanBehavior #ResearchData #reporting #replicability
stemplet74.substack.com/p/the-problem-…
#RationalThinking #intuition #instinct #HumanBehavior #ResearchData #reporting #replicability
Daily Bookmarks to GAVNet 09/16/2021 greeneracresvaluenetwork.wordpress.com/2021/09/16/dai…
Reproducibility: expect less of the scientific paper
nature.com/articles/d4158…
#reproducibility #replicability #responsibility #ResearchData #ResearchManagement
nature.com/articles/d4158…
#reproducibility #replicability #responsibility #ResearchData #ResearchManagement
The Big Blurry Picture
appliedcomplexity.substack.com/p/the-big-blur…
#AppliedComplexity #unlearning #CoarseGrainedProcesses #control
appliedcomplexity.substack.com/p/the-big-blur…
#AppliedComplexity #unlearning #CoarseGrainedProcesses #control
Now out! New report examines Reproducibility and Replicability in Science, with recommendations for researchers, agencies, policy makers, journals, etc.
@theNASEM ow.ly/BK5350u0Iz2
#ReproducibilityInScience
@theNASEM ow.ly/BK5350u0Iz2
#ReproducibilityInScience
@theNASEM Terms like “reproducibility” and “replicability” are sometimes used as an umbrella word to encompass all related concerns. But often, researchers use each term to refer to a distinct concept. #ReproducibilityInScience
@theNASEM The committee defined #reproducibility as obtaining consistent computational results using the same input data, computational steps, methods, code, and conditions of analysis as an original study.
Commentary by Dijksterhuis, author of original study on behaviour priming that failed to replicate in most recent @RegReports, falls into usual post hoc explanations and lack of falsifiability. 1/n psychologicalscience.org/redesign/wp-co… #replicability #opensciecne
All degrees of freedom that are required to make the effect significant post hoc were foreseeable a priori. Eg exclude those who reporting being suspicious of the study's intent. If this data was collected + the original theory state it's an unconscious effect, 2/n
then why wasn't this employed as an exclusion criterion? Author reports not expecting such a high rate of suspicion, but it if was a priori relevant the rate wouldn't matter or could have had a design contingency. 3/n
