📄Published Today in Nature:

500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social).

Article: www.nature.com/articles/s41...

Preprint: osf.io/preprints/me...

TLDR: 1/11

Investigating the reproducibility of the social and behavioural sciences - Nature A study of reproducibility in a stratified random sample of 600 papers published from 2009 to 2018 in 62 journals spanning the social and behavioural sciences finds higher reproducibility among more&n...

Can published findings be reproduced from the same data + same analysis? As part of SCORE, Miske and 127 co-authors tested this across social and behavioral science papers from 2009–2018.

www.nature.com/articles/s41...

OA: osf.io/preprints/me...

1/

Huge meta-research project puts claims in social-science papers to the test Three experts discuss lessons learnt from a large-scale dissection of the reproducibility, analytical robustness and replicability of published results.

Commentaries on SCORE papers from @asanchez-tojar.bsky.social, Jelte Wicherts, and @robbwiller.bsky.social

www.nature.com/articles/d41...

My new piece "Reproducibility: how to strengthen a weak foundation" is out today @nature.com! 🎉 How reproducible is research in the social & behavioural sciences? A new study by Miske et al. assessed 600 papers across 62 journals: the results are sobering.

📄 doi.org/10.1038/d415...
📄 rdcu.be/fbcq5

Do researchers share their code upon request? Does running their orginal code on the original data produce the original results? We provide evidence in a new Royal Society Open Science publication. Studying more than 1,000 articles which use data from the European Social Survey, we find that... 🧵

A Cross-Sectional Study of the Completeness of Preregistrations by Psychological Authors From German-Speaking Institutions - Lena Hahn, Andreas Glöckner, Mario Gollwitzer, Jens Hellmann, Jens Lange, S... Preregistering confirmatory research aims at reducing researchers’ degrees of freedom and increasing transparency to ultimately increase replicability. Yet the ...

How complete are preregistrations?

Short answer: 53% include all 6 procedural specifications

Medium answer: 🧵

Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social

doi.org/10.1177/2515...

What it takes to tutor—A preregistered direct replication of the scaffolding experimental study by D. Wood et al. (1978).

psycnet.apa.org/fulltext/202...

Good, bad, different or something else? A scoping review of the convictions, conventions and developments around quality in qualitative research | Royal Society Open Science We present a scoping review of methodological papers in the social science literature covered in Scopus from 2017 to 2022. In this review, we document the shared norms, ideals and practices regarding ...

The quality of qualitative research

royalsocietypublishing.org/doi/10.1098/...

📣New Preprint Alert!

Esther Maassen meticulously simulated the effect of p-hacking and publication bias on effect size & heterogeneity estimates.

💡bad: selective outcome reporting & optional dropping
💡bad: publication bias
💡not so bad: optional stopping/outlier removal

osf.io/preprints/ps...

Vacancy: We are looking for two fully paid PhD students in methodology and statistics as part of my NWO-funded VICI project Examining Variation in Causal Effects in Psychology!

www.academictransfer.com/nl/338321/ph...