More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments | Journal of Experimental Political Science | Cambridge Core More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments - Volume 12 Issue 1

#statstab #487 More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments

Thoughts: I see a lot of papers that make at least one of the 7 errors for "no effect".

#survey #nhst #nulleffects #nonsignificant #pvalue #power

doi.org/10.1017/XPS....

#statstab #468 Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review

Thoughts: Frequentist stats must move beyond point and interval estimators, and adopt "distribution estimators".

#concurve #fisher #fiducial #pvalue

onlinelibrary.wiley.com/doi/full/10....

#statstab #463 One-and-a-half sided test

Thoughts: Alberson has a more different take on the issues from #461 and #462: human behaviour.

(excerpt from the book)

#pvalue #onesided #NHST #directional #hypothesis #testing #logic

www.routledge.com/Statistics-A...

The paradox of one-sided vs. two-sided tests of significance | OneSided.org A lot of people find as paradoxical the claim that a one-sided test of significance at a given p-value offers the same type I error guarantees as a two-sided test that produced the same p-value. Here ...

#statstab #462 The paradox of one-sided vs. two-sided tests of significance

Thoughts: A solution to Royall's paradox from #461. The "null" is not one thing.

#pvalue #Royall #paradox #onesided #nhst #null #hypothesis #logic

www.onesided.org/articles/the...

The One-Sided P-Value Paradox Today on Twitter there was some chatting about one-sided p-values. Daniel Lakens thinks that by 2018 we’ll see a renaissance of one-sided p-values due to the advent of preregistration. There …

#statstab #461 The One-Sided P-Value Paradox

Thoughts: "I have concluded the stronger proposition, probability of heads > ½, but I cannot conclude the weaker proposition, probability of heads > ½ or < ½"

#onetailed #pvalue #logic #Royall #paradox

alexanderetz.com/2015/04/20/p...

There is still only one test In 2011 I wrote an article called "There is Only One Test" , where I explained that all hypothesis tests are based on the same framework, wh...

#statstab #458 There is still only one test

Thoughts: Downey make a good point that all/any testing ensemble does essentially the same thing.

#randomization #testing #nhst #pvalue

allendowney.blogspot.com/2016/06/ther...

Significance tests, p-values, and falsificationism This thread takes its inspiration from the recent discussions in social science and statistics about significance tests, what they’re good for, whether p-values should be banned, and what all of that ...

#statstab #469 Significance tests, p-values, and falsificationism

Thoughts: An "interesting" thread of philosophy of science and debating.

#discussion #debate #pvalue #falsification #nhst

discourse.datamethods.org/t/significan...

A Vast Graveyard of Undead Theories - Christopher J. Ferguson, Moritz Heene, 2012 Publication bias remains a controversial issue in psychological science. The tendency of psychological science to avoid publishing null results produces a situa...

#statstab #429 A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null

Thoughts: Ignoring null findings keeps bad theories alive.

#nulleffects #nhst #falsification #theory #critique #reproducibility #pvalue

journals.sagepub.com/doi/full/10....

Second-generation p-values: Improved rigor, reproducibility, & transparency in statistical analyses Verifying that a statistically significant result is scientifically meaningful is not only good scientific practice, it is a natural way to control the Type I error rate. Here we introduce a novel ext...

#statstab #423 Second-generation p-values: Improved rigor, reproducibility, & transparency in statistical analyses

Thoughts: I appreciated the thought behind sgpv but I've not seen them used anywhere.

#sgpv #pvalue #error #bias #inference

journals.plos.org/plosone/arti...

#statstab #413 Counternull Sets in Randomized Experiments

Thoughts: The counternull is a lost statistic, that is woefully underused when teaching stats.

#counternull #nhst #pvalue #effectsize #teaching #randomization #rosenthal

www.tandfonline.com/doi/pdf/10.1...

APA PsycNet

La fameuse valeur p fait encore couler beaucoup d’encre… 🧪 Heureux d’avoir co-signé cet article dans la revue #CanadianPsychology pour mieux en comprendre les limites et explorer des alternatives. 👉 psycnet.apa.org/doiLanding?d... #Science #Statistiques #PValue #Significativité

Experience Statistics

#statstab #364 Distribution of Cohen's d, p-values, and power curves for an independent two-tailed t-test

Thoughts: Useful for explaining why we use 5% alpha and what power does to p-values.

#shiny #education #pvalue #power #simulation #ttest #cohend

shinyapps.org/showapp.php?...

Experience Statistics

#statstab #363 p-checker The one-for-all p-value analyzer

Thoughts: Easy way to check for publication bias using some current tools.

#shiny #pvalue #phacking #QRPs #zcurve #bias #pcurve #rindex

shinyapps.org/apps/p-check...

Experience Statistics

#statstab #362 When does a significant p-value indicate a true effect?

Understanding the Positive Predictive Value (PPV) of a p-value

Thoughts: Cool illustration of how assumptions impact our beliefs about the next study

#shiny #education #ppv #pvalue

shinyapps.org/showapp.php?...?

Experience Statistics

#statstab #361 Vovk-Sellke Maximum p-Ratio (VS-MPR)

Thoughts: Can p-values provide evidence for H1 over H0? YES!*
(*if you make some assumptions and go a smidgen Bayesian)

VS-MPR is reported in @JASPStats

#vsmpr #pvalue #evidence #shiny #r #jasp

www.shinyapps.org/apps/vs-mpr/

P hacking — Five ways it could happen to you Some data practices can lead to statistically dubious findings. Here’s how to avoid them.

"Most researchers don’t set out to cheat, but they could unknowingly make choices that push them towards a significant result. Here are five ways P hacking can slip into your research."

buff.ly/ArtMGCu

#PHacking #PValue #ScientificRigor

17.10 Jeffreys-Lindley paradox | An Introduction to Data Analysis Introductory text for statistics and data analysis (using R)

#statstab #346 Jeffreys-Lindley paradox

Thoughts: I like this short explanation of the "paradox" of why frequentist and bayesian inference can differ.

#paradox #frequentist #bayesian #inference #bayesfactor #pvalue #explanation

michael-franke.github.io/intro-data-a...

P value quitting insignificant shirt, hoodie, sweatshirt and tank top MOTHER'S DAY. Use Code "LOVEMOM" for The P value quitting insignificant shirt, hoodie and sweater available in many styles. Hot Deal ends soon!

For the stats nerds! 📊❌ This witty shirt humorously applies the concept of p-value significance to quitting. Perfect for researchers, students, and data analysts. 😂🧪📉
👉 serenashirt.com
#StatisticsHumor #PValue #DataScience #AcademicHumor #FunnyScience

Z-Skoru ve P-Değerlerine Bağlı Anlamlılık Bölgeleri
#ZSkoru #PDeğeri #ZScore #PValue #SıfırHipotezi #NullHypothesis

Data without discussion is dead data 🧐 @simonegastaldon.bsky.social & I think #LinguisticAlignment needs #OpenScience & #multiverse debate!

🔥 Our re-analysis goes beyond the #pvalue to #collectively build solid #theory & valid #measurement in #cognitive #sciences

🔗 doi.org/10.1016/j.co...

On this day, the brilliant statistician responsible for many tools we still use now (ANOVA,MLE,Exact Tests, etc.) but most importantly for popularizing significance & p-values, was born. Sir Ronald Aylmer Fisher FRS (17 Feb 1890 – 29 Jul 1962). #statsky #datascience #statistics #pvalue #significance

Like antibiotics, statistical tools work as they should when they are used as intended. #Statistics #edusky #DataScientist #STEM #pvalue #significant #DataAnalytics #MathEd #Science Art by @bonkerific.bsky.social

Blogger Weblog publishing tool from Google, for sharing text, photos and video.

Explora los conceptos de Chi-Cuadrado y P-Value con un ejemplo práctico. Aprende a evaluar asociaciones entre variables categóricas. ¡No te lo pierdas! 👇

🔗 www.blogger.com/blog/post/ed...

#Estadística #CienciaDeDatos #ChiCuadrado #PValue #AnálisisDeDatos

Statisticians are like magicians—
They make the data disappear... and then pull a p-value out of a hat. 🧙‍♂️✨
But sometimes, the magic’s just a coincidence! 😂📊
#Statistics #DataScience #PValue #Magic #Humor #Data #Jokes #StatLife #MathLaughs #AI #Follow #BlueSky

How to perform a normality test？

#ParametricAssumptions
#ProbabilityPlot
#DAgostinoTest
#JarqueBeraTest
#NormalDistribution
#ResidualAnalysis
#Transformations
#LogTransformation
#SquareRootTransformation
#BoxCoxTransformation
#PValue
#SampleSizeEffect
#NonParametricTests
#DataVisualization

The Critical Value and the p-Value Approach to Hypothesis Testing… shorturl.at/ruoIk

#statistics #pvalue #hypothesis #testing #snoopdogg

#DataScience #MachineLearning #LinearRegression #R2 #PValue #StatisticalAnalysis #ModelEvaluation #AIInsights #PredictiveAnalytics #DataAnalytics #AI #DeepLearning #DataDriven #DataVisualization #BigData #MLModel #Statistics #AIAdvancements

The ubiquitous "seductive certainty of significance"

#stat #pvalue #statisticalerrors

Scientific method: Statistical errors - Nature P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume.

www.nature.com/articles/506...
The fallacy of p values..a significant part of our research uses p value..but with very little knowledge of how to interpret it
#statistics #pvalue #science

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain rampant. A key problem is that there are no interpretations of t...

Best moment in the video:
"I'm not gonna define p-values today, forgive me."

Maybe James should.
Not that there aren't any good definitions (e.g. check www.ncbi.nlm.nih.gov/pmc/articles...).
But presented by James, at least coffee drinkers might understand it better!

#NHST #pvalue #Statistics