1/
"Silicon samples" are becoming more and more common in research and polling.

One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.

The updated version of this preprint is now online!

THREAD🧵

arxiv.org/abs/2509.13397

PhD Student in Meta-Science and Clinical Psychology - Universität Bern Universität Bern is looking for PhD Student in Meta-Science and Clinical Psychology

I’m hiring a PhD student!

The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc.

jobs.unibe.ch/job-vacancie...

Postdoc In Meta-science Personal type: Scientific staff

We are inviting applications for a two-year postdoctoral position in a collaborative meta-science project on the effectiveness of data and code sharing policies in research-performing organizations. www.tue.nl/en/working-a...

Science needs downvotes A bug bounty module in grants would give criticism a leg up The Soviet Union was good at producing shoes. Factories made 800 million pairs a year, twice as many as Italy, three times as many as the...

New post on The 100% CI: Science needs downvotes.
www.the100.ci/2026/04/13/s...
In which I make the case that grant funders should add funding lines that include a module for bug bounties.

🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science.

Here’s what we found 👇

SCORE | Center for Open Science SCORE shows that there is no shortcut to producing credible research findings, and there is no single indicator of trustworthiness. Research progress depends on transparency, rigor, and establishing r...

SCORE, a collaboration of 865 researchers, is now released as three papers in Nature, six preprints, and a lot of data (cos.io/score/). SCORE examined repeatability of findings from the social-behavioral sciences and tested whether human and automated methods could predict replicability.

Call for Entries: 2026 Einstein Foundation Award for Promoting Quality in Research - The Official PLOS Blog The annual Einstein Foundation Award for Promoting Quality in Research is inviting applications and nominations for 2026. Learn more.

Be sure to submit nominations for the 2026 #EinsteinFoundationAward by April 30. The award program honors researchers, institutions, and #EarlyCareerResearchers from around the globe working to promote quality in #research and #openscience. Learn more at plos.io/4ro3GLD.
@einsteinberlin.bsky.social

What an issue! RegCheck is among some excellent company here 👏 www.sci-integrity.com/reach-januar...

🏆 @simine.com, psychologist at @psychunimelb.bsky.social / @unimelb.bsky.social and Editor-in-Chief of Psychological Science (@psychscience.bsky.social) is a leading voice in the reform movement in psychology - and is now being honored with the €150K Individual Award.
Huge congratulations! 🎉

I build a feed for european grant funding that's updated daily and (IMO) far more transparent then the official EU fundign website: michelnivard.github.io/eu-grants-fe... (inspired by the NIH equivalent @sashagusevposts.bsky.social build yesterday)

Graph showing the proportion of clinical psychology studies that adopted four transparent research practices (preregistration and sharing of measurement instruments, data, and analysis scripts) at three time points (2012, 2018, 2024). The graph suggests adoption of these practices has increased but remains uncommon.

Graph showing the proportion of clinical psychology studies that adopted three transparent research practices (reporting guidelines and disclosure of conflicts of interest and funding) at three time points (2012, 2018, 2024). The graph suggests use of reporting guidelines has increased but remains uncommon. Conflict of interest disclosure statements have increased and are now quite common. Funding disclosure statements were relatively common across the three time points.

Has transparency improved in clinical psychology? New cross sectional study from us (Bianca Kotoulas, Justine Blackwell & me). Adoption of transparent research practices has increased between 2012, 2018, & 2024, but aside from coi and funding disclosures, they remain uncommon osf.io/preprints/ps...

Excited and nervous for this event tomorrow. Come in person in Berlin, or join online!

www.einsteinfoundation.de/en/insights/...

We are pleased to announce that the Paul Meehl Graduate School is launching the PMGS Dissertation Award, recognizing outstanding PhD dissertations that advance meta-research.

See the eligibility criteria and apply before June 1st, 2026 at:
paulmeehlschool.github.io/award/

#SPSP2026 join us at 12:30 to answer all your questions about registered reports!

Causal inference for psychologists who think that causal inference is not for them Correlation does not imply causation and psychologists' causal inference training often focuses on the conclusion that therefore experiments are needed—without much consideration for the causal infer...

You need to bring in the same toolkit as in studies that try to establish causality without randomization.

I know it sounds unfair, but I don’t make the rules. These situations are instances of post-treatment bias, if you want to read up on it as a psychologist:

Assistant Professor Tenure Track for Social Psychology with a Focus on Environmental Psychology - Universität Bern Universität Bern is looking for Assistant Professor Tenure Track for Social Psychology with a Focus on Environmental Psychology

Our institute is hiring
1. an assistant professor (with TT) for Social Psychology (focus: environmental psychology)
ohws.prospective.ch/public/v1/jo...

2. an assistant lecturer (with TT) for Experimental Personality Psychology
ohws.prospective.ch/public/v1/jo...

Oversight of Research Outputs by Public Organisations as a Threat to Research Integrity: A Personal Account from Australia - Journal of Academic Ethics Research governance processes in Australian public organisations raise significant concerns for research integrity, particularly regarding the pre-dissemination review and editing of research outputs....

Join ReproducibiliTea Melbourne journal club this Thursday 4pm AEDT, to discuss "Oversight of Research Outputs by Public Organisations as a Threat to Research Integrity” by C. Brandenburg & @aidybarnett.bsky.social

Zoom: uni-sydney.zoom.us/j/83909186903
#ResearchIntegrity @reproducibilitea.org

Just an aside: 41 of the 100 meta analyses published in Psych Bull between 2023 and 2025 do not include *any* quality screening of identified studies. To the degree that those literatures include bad studies, they are being laundered together with the good ones.

New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.

Making Europe a scientific superpower · Luma The European Union spends more on science funding each year than America’s National Science Foundation. But scientific output in Europe still trails the US…

We at Works in Progress are hosting a series of lightning talks on the future of science R&D in Europe!

Come along for the ideas, conversations and meet us!

2nd March, Brussels. Register here: luma.com/08rnunqw

📅 Mark your calendars for #SIPS2027!
The 2027 SIPS conference, organized in collaboration with the Association for Interdisciplinary Meta-Research and Open Science @aimosinc.bsky.social, will be held in November at the University of Melbourne, Australia.

We are looking forward to seeing you there!

Screenshot of a preprint titled “Digital Behaviourism: A functional approach to behaviour in digital environments”

Our preprint has evolved!

v2 of “Digital Behaviourism” is out now with a new title, new co-authors, and a deeper dive into the behavioural concepts that shape our online lives.

It’s time to move beyond “screen time” and focus on function of online behaviours.

osf.io/preprints/ps...

Rethinking psychological measurement: Validity potential versus realised validity We propose a concept of validity with a novel feature that we argue can facilitate improved measurement validation practices in the psychological scie…

Thrilled to share our new paper introducing “validity potential” versus “realised validity” as a key distinction for psychological measurement, with @davidmkaplanx.bsky.social, Alexander Gillett, @suttonprofessor.bsky.social, and @robert-m-ross.bsky.social www.sciencedirect.com/science/arti...

How many versions of the Iowa Gambling Task (IGT) exist? And how much does this affect research using the IGT? More than you might think. 🧵

Some people bring up (1) the cost of criticism and (2) that a lot of criticism has already been voiced but ignored. Both points are valid, so here are some suggestion for (1) reducing backlash and (2) increasing impact (from this talk of mine: juliarohrer.com/wp-content/u...

RegCheck V2 is out!
Try it out yourself: regcheck.app
Read more about it: arxiv.org/abs/2601.13330
Check out the codebase: github.com/JamieCummins...

Fig. 3. Scatter plots of the synthetic and empirical estimates, validation study (Stage 2). Showing N = 30,135 item-pair correlations, N = 257 scale reliabilities, and N = 1,568 scale-pair correlations for (top) the pretrained SBERT model and (bottom) the fine-tuned SurveyBot3000 model. SBERT = all-mpnet-base-v2 model.

Fig. 4. Prediction error of the synthetic estimates, validation study (Stage 2). Our prediction model allowed the error term to vary freely according to the predictor, the synthetic estimate. The thin-plate splines show that some synthetic estimates were predictably more accurate.

Fig. 5. Accuracy by domain. Accuracy differed across domains. SurveyBot3000 accuracy (colored) was always higher than SBERT accuracy (gray). Results were largely consistent whether accuracy of items was tested (left, circle) within domains or (right, cross) across domains.

Fig. 1. Multistep training procedure for the SurveyBot3000, which produces synthetic estimates of interitem correlations. (a) Pretraining base model (SBERT). (b) Fine-tuning SurveyBot3000. (c) Validation. SBERT = all-mpnet-base-v2 model.

Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example.
journals.sagepub.com/doi/10.1177/...

Thank you!!

Thank you!! :)

Thanks Simine! I’m by far the luckiest PhD student ever because you’re the best! ✨ 🤸