Likelihood Ratio Test for Publication Bias Likelihood Ratio Test for Publication Bias — a statistical method to detect and quantify publication bias in heterogeneous datasets.

#statstab #504 Likelihood Ratio Test for Publication Bias

Thoughts: Interesting idea for a problem many of us think is present, but is hard to measure.

#likelihood #publicationbias #QRPs #metascience #metapsychology #metaresearch

freestylerscientist.pl/projects/lik...

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

#statstab #497 On the Statistical Analysis of Experiments
With Manipulation Checks

Thoughts: All psychologists reading this title will panic. Yes, you can't just delete data and assume all is well.

#assumptions #QRPs #estimand #causalinference #ITT #ATE #bias

journals.sagepub.com/doi/pdf/10.1...

Low power bias

#statstab #470 Low power bias {shiny} app

Thoughts: easily show what conducting an underpowered study would do to your effect size (type M error).

#teaching #bias #power #typeM #typeS #QRPs #underpowered #samplesize

c-jaksic.shinyapps.io/small_power_...

Redirecting

#statstab #469 We should focus on the biases that matter

Thoughts: I recommend this entire issue with the discussions and reply. They are a great insight into how science develops.

#metascience #bias #publicationbias #QRPs #TES

dx.doi.org/10.1016/j.jm...

Redirecting

#statstab #467 Replication, statistical consistency, and publication bias

Thoughts: Is the replication of a a finding the "gold standard" for scientific discovery? Maybe not.

#replication #metascience #metapsychology #statistics #bias #QRPs #nhst

doi.org/10.1016/j.jm...

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

#statstab #456 Bestiary of Questionable Research Practices in Psychology

Happy new year! ✨

Thoughts: Starting the year with a resource to make you more cynical in 2026.

#QRPs #phacking #metascience #research #ethics

journals.sagepub.com/doi/10.1177/...

#statstab #442 Understanding uncertainty in school league tables

Thoughts: Rankings are virtually meaningless, especially neighbour values.

#ranking #comparison #uncertainty #QRPs #education #academia

research-information.bris.ac.uk/ws/portalfil...

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

An interesting - likely highly citable - list of 40 #QRPs (questionable #research practices). I think practically every article I've ever read is now 'questionable' under this taxonomy. I think each one of these needs 'with the intent to deceive' or similar as a qualifier 🤔

doi.org/10.1177/2515...

Fighting coordinated publication fraud is like ‘emptying an overflowing bathtub with a spoon,’ study coauthor says The observed and forecasted growth rate of paper mill papers outpaces corrective measures, a new study finds. R. Richardson et al./PNAS 2025 Systematic research fraud has outpaced corrective measur…

retractionwatch.com/2025/08/04/f... #openscience #replication #perverseincentives #QRPs

#statstab #396 If researchers find Cohen’s d = 8, no they didn’t

Thoughts: Sometimes an effect is so impressive that its unbelievable.

#effectsize #cohend #QRPs #sesoi

mmmdata.io/posts/2025/0...

Questionable research practices from the practitioners’ perspectives Discussions and narratives from four behavioral and social scientists about their experiences learning, observing, and doing things in the course of research, and communicating that research, that con...

crowdid.hypotheses.org/1666 #QRPs #questionableresearchpractices #p-hacking #HARKing #publish-or-perish #science #metascience 🧪

🚨 New study alert! We're excited to share our "Bestiary of Questionable Research Practices in Psychology" in #AMPPS. We tackle the credibility crisis in research by defining, collecting, and categorizing QRPs using a community consensus method. 🧵#OpenScience #QRPs @psychscience.bsky.social

In psychology everything mediates everything In the past couple of years I have reviewed half a dozen manuscripts with abstracts that go something like this: <Construct X> is know...

#statstab #381 In psychology everything mediates everything

Thoughts: Another great explanation of the pitfalls of mediation analysis. Mediation is not a simple procedure and require strong theory.

#mediation #QRPs #correlation #regression #PROCESS

steamtraen.blogspot.com/2020/04/in-p...

Poster01: Poster session This page displays all the content accepted for the poster boards throughout the conference and the session on the Tuesday evening.

#metascience2025 #openscience #metascience
Come check out our poster where we share ethnographers of #QRPs (questionable research practices) nomadit.co.uk/conference/m...

[73] Don't Trust Internal Meta-Analysis - Data Colada Researchers have increasingly been using internal meta-analysis to summarize the evidence from multiple studies within the same paper. Much of the time, this involves computing the average effect size...

#statstab #369 Don't Trust Internal Meta-Analysis

Thoughts: I don't agree with all the assumptions, but interesting to know how bad these can be.

#metaanalysis #QRPs #minimeta #datacolada #falsepositive #replication

datacolada.org/73

#statstab #366 Type M error might explain Weisburd’s Paradox

Thoughts: Learn about type M error while you learn about the issues in criminology!

#replication #typeM #typeS #QRPs #paradox #power #effectsize #errorrate

sites.stat.columbia.edu/gelman/resea...

Experience Statistics

#statstab #363 p-checker The one-for-all p-value analyzer

Thoughts: Easy way to check for publication bias using some current tools.

#shiny #pvalue #phacking #QRPs #zcurve #bias #pcurve #rindex

shinyapps.org/apps/p-check...

seven selfish reasons for preregistration : https://www.psychologicalscience.org/observer/seven-selfish-reasons-for-preregistration

Why bother? Because PRs/RRs separates exploration from confirmation.

📉 Without it, we risk p-hacking, HARKing, and data dredging. #QRPs

🎯 With it, we build credibility, clarity, and cumulative science. #TrustScience

🙋‍♀️ Selfish reasons: www.psychologicalscience.org/observer/sev...

Stata | FAQ: Problems with stepwise regression What are some of the problems with stepwise regression?

#statstab #358 What are some of the problems with stepwise regression?

Thoughts: Model selection is not an easy task, but maybe don't naively try step wise reg.

#stepwise #regression #QRPs #issues #phacking #modelselection #bias

www.stata.com/support/faqs...

The Abuse of Power It is well known that statistical power calculations can be valuable in planning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a s...

#statstab #353 The Abuse of Power; The Pervasive Fallacy of Power Calculations for Data Analysis

Thoughts: An seminal paper on "post hoc" power calculations.

#power #QRPs #NHST #posthoc #samplesize #effectsize

www.tandfonline.com/doi/abs/10.1...

Original post on fediscience.org

Sometimes I despair about the state of #academia, but luckily I am working with a great bunch of B.A. and M.A. students on #OpenScience in #linguistics so Mondays are good days! 🥰 Today we talked about p-hacking, HARKing, preregistration and registered reports. One student remarked: But why […]

DSpace

#statstab #344 Questionable Research Practices when Using Confirmatory Factor Analysis

Thoughts: CFAs might be better than EFAs, but they are still complicated and easy to abuse.

#factoranalysis #CFA #QRPs #fitindex #guide

dr.lib.iastate.edu/bitstreams/4...

#Biostatistics #QRPs #Survey #ResearchIntegrity #MetaResearch

@aidybarnett.bsky.social @kelamb.bsky.social @tayacollyer.bsky.social

Encourage Playing with Data and Discourage Questionable Reporting Practices - Psychometrika Psychometrika -

#statstab #330 Encourage Playing with Data and Discourage Questionable Reporting Practices

Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.

#QRPs #exploratory #EDA #posthoc #phacking

link.springer.com/article/10.1...

Blue Ridge Associates Expands Reach with QRPS Acquisition in North Carolina Blue Ridge Associates has announced the acquisition of Qualified Retirement Plans Services (QRPS), enhancing its capabilities in retirement plan administration in North Carolina.

Blue Ridge Associates Expands Reach with QRPS Acquisition in North Carolina #United_States #Raleigh #Retirement_Plans #Blue_Ridge #QRPS

How Scientists Lie A book about questionable research practices (QRPs) and its remedies. A guide to misleading science and research and how we can improve it.

howscientistslie.com/index.html #QRPs #openscience #metascience #science #replication 🧪

Defense Against Dishonest Charts This is a guide to protect ourselves and to preserve what is good about turning data into visual things.

#statstab #280 Defense Against Dishonest Charts

by @flowingdata.com

Thoughts: Great interactive resource. Always important to teach #dataviz and proper presentation of results.

#stats #plots #figures #error #QRPs #data #sciencecommunication

flowingdata.com/projects/dis...

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

#statstab #279 Diagnosing the Misuse of the Bayes Factor in Applied Research

Thoughts: As with NHST, Null Hypothesis Bayesian Testing (NHBT) can also be easily misunderstood.

#bayes #bayesian #NHBT #misuse #QRPs #error

journals.sagepub.com/doi/10.1177/...

#openscience #metascience #QRPs 🧪

Navigating the Science System: Research Integrity and Academic Survival Strategies

Friday 15 Nov, 15:00 CET - Wolfgang Kaltenbrunner and I will present our study where we argue #QRPs can be conceptualised as attempts to reconcile epistemic & social uncertainties in knowledge production. #ResearchIntegrity
Seminar is hybrid, link to the session and more info here 👇