Tune in to Science Friday at 2 PM ET today to hear COS Senior Director of Research Tim Errington discuss findings from the SCORE project—a large-scale research initiative designed to improve the assessment of scientific credibility in the social and behavioral sciences.
🎙️
Posts by Center for Open Science
Virtual Event April 16 // 1 pm ET NEW EVIDENCE ON REPRODUCIBILITY ACROSS SOCIAL AND BEHAVIORAL RESEARCH Moderator: Tim Errington Speakers: Katrin Auspurg, Abel Brodeur, and Andrew Tyner
What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility
cos-io.zoom.us/webin...
🗞️ @chronicle.com covered findings from the large-scale SCORE effort, which evaluated reproducibility, replicability, and robustness across the social and behavioral sciences. The piece also features researchers weighing in on what the results may mean for the field:
www.chronicle.com/article/lots...
Interested in the latest evidence on reproducibility across social and behavioral research? 📑
Don’t miss this opportunity to learn from these researchers and large-scale initiatives shaping the future of open science.
New on the Generalist Repository Ecosystem Initiative (GREI) blog: highlights from the Streamlining Data Sharing webinar series, featuring practical guidance and tools, real-world user stories, solutions to common data sharing challenges, and more!
📖 medium.com/@blog-gre...
The Road to Open Science Requires Making #Data Count Better (via @makedatacount.bsky.social) makedatacount.org/read-our-blo... #openscience
COS will be participating in the World Conference on Research Integrity #WCRI2026 in Vancouver! The Network for Education & Research Quality (NERQ) is hosting two opportunities to connect:
🔹 Online Pre-Meeting (April 27): uni-kiel.zoom-x.de/m...
🔹 NERQ Reception (May 4): docs.google.com/form...
Last year at the C4R25 Conference 💥
Join us for C4R26 in Philadelphia, September 28–30, 2026!
#SavetheDate
#C4R26
From our friends at @cos.io
Thanks for sharing!
COS will be participating in the World Conference on Research Integrity #WCRI2026 in Vancouver! The Network for Education & Research Quality (NERQ) is hosting two opportunities to connect:
🔹 Online Pre-Meeting (April 27): uni-kiel.zoom-x.de/m...
🔹 NERQ Reception (May 4): docs.google.com/form...
Three recent papers examined reproducibility of a large sample of findings. Join this webinar to discuss them and explore where the findings converge and differ.
1. SCORE: www.nature.com/articles/s41...
2. I4R: www.nature.com/articles/s41...
3. Meta-Rep: royalsocietypublishing.org/rsos/article...
Virtual Event April 16 // 1 pm ET NEW EVIDENCE ON REPRODUCIBILITY ACROSS SOCIAL AND BEHAVIORAL RESEARCH Moderator: Tim Errington Speakers: Katrin Auspurg, Abel Brodeur, and Andrew Tyner
What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility
cos-io.zoom.us/webin...
Cover of this week’s Nature featuring papers on reproducibility issues in social and behavioural sciences
More self-reflection in research can lead to better science - as shown by a package of social & behavioural sciences papers that shows how collaborating can further the cause of reproducible, replicable & robust findings
@nature.com 🧪 #SCORE
@briannosek.bsky.social
www.nature.com/articles/d41...
Can published findings be reproduced from the same data + same analysis? As part of SCORE, Miske and 127 co-authors tested this across social and behavioral science papers from 2009–2018.
www.nature.com/articles/s41...
OA: osf.io/preprints/me...
1/
Issue 39 of #rdmweekly is out! 📬
It includes:
➡️ Working Smarter with {dplyr} 1.2.0 @ivelasq3.bsky.social
➡️ Computational Reproducibility: A Primer from @ukrepro.bsky.social
➡️ SCORE: Systematizing Confidence in Open Research and Evidence @cos.io
and more!
rdmweekly.substack.com/p/rdm-weekly...
Nature research paper: Investigating the reproducibility of the social and behavioural sciences
go.nature.com/3OhvkfP
Forbes covered the recently published SCORE findings on research repeatability and credibility—a large-scale effort spanning 3,900 claims across the social and behavioral sciences, and 865 collaborators: www.forbes.com/sites...
🔎 Explore the SCORE findings and materials: cos.io/score
Our large-scale multi-analyst project is now out in Nature (@nature.com)! 🚨
Same data, different analysts → different results.
Analytical choices matter more than we assume, with implications for robustness in social & behavioral science.
www.nature.com/articles/s41...
In this commentary, some of the SCORE organizers discuss the implications of the SCORE findings and the opportunity to develop scalable indicators of research trustworthiness, on many dimensions.
Preprint on MetaArXiv: osf.io/preprints/me...
I'll join the chorus of people who are not even quite sure what to say about this absolute behemoth of a project, except for YAY! I worked full time on SCORE from 2019-2021 with the COS team, designing and implementing the system for identifying claims in the literature, developing protocols to...
I had the chance to write a short commentary on one of the papers, focusing on the broader lesson I took away from the SCORE project: this kind of evidence should push us toward rigor, self-improvement, and institutional reforms, not away from trust in social science
www.nature.com/articles/d41...
@nature.com has published three groundbreaking papers on reproducibility, analytical robustness, and replicability across the social sciences. Sincere thanks are due to the many folks who contributed to these projects. It’s painstaking work, and a great service to social science.
So very excited to see the SCORE papers finally put in @nature.com with @cos.io led by @briannosek.bsky.social and colleagues. Working on SCORE was gruelling but has been tremendously rewarding. Special props to team leaders that we worked with, like Andrew Tyner!
www.science.org/content/arti...
“Did you know?” announcement for bioRxiv and medRxiv. The text says “All bioRxiv & medRxiv preprints get a QR code” and “Great for posters and slideshows!”. Screenshots of the top right link section on a bioRxiv preprint with a box around the link for “Get QR code” (4th link on the second column). Also two QR codes with bioRxiv or medRxiv logo. The footer says: “bioRxiv and medRxiv are preprint servers of openRxiv.”
Easily share a bioRxiv or medRxiv preprint with a QR code! Find the "Get QR code" link on the preprint's page. These codes allow scientists to quickly access a preprint on their phones from a poster or slide.
#OpenScience #Preprints #bioRxiv #medRxiv #openrxiv
Nice first person perspective on the experience of participating in part of the SCORE program from Vsevolod.
Very grateful to have been a tiny cog in an undertaking so enormous - it was fun to have a peek behind the curtain, and seeing the outputs collated (all the original/reproduced data, analysis code, methods, and human & machine-produced robustness & reliability metrics) is extremely impressive!
New article in Nature!
Happy to have contributed (as one of the many co-authors)
Researchers could replicate the results of about half of the studies in various social science disciplines
This holds for various fields: pol sci, econ, sociology, & psychology
#science 🧪 @briannosek.bsky.social
Finally, here is a press release that is our briefest summary of the program and findings. Go here if you want to spend <5 minutes on SCORE: www.cos.io/about/news/l...
3: If you are interested in the SCORE methodology, then the place to start is this "Process" page on the SCORE website: www.cos.io/score-process.
It provides a brief guide to exploring the extensive supplementary material spread across papers that will help you make sense of the program in whole.