Data Colada | Uri Simonsohn | Substack Thinking about evidence and vice versa. Click to read Data Colada, by Uri Simonsohn, a Substack publication.

Data Colada is now cross-posting on substack.

datacolada.substack.com

[134] Figuring Out Figure 1 - Data Colada A few years ago our Journal Club discussed an interesting methods paper entitled, “Putting Psychology to the Test: Rethinking Model Evaluation Through Benchmarking and Prediction” (.htm). This post describes my attempt to understand what’s happening in Figure 1 of that paper, which shows that extremely simple experiments can generate extremely negative R2s. I learned a...

New post on Data Colada. I spent a very long time trying to figure out a figure in a methods paper that is not in my area of expertise. It shows extremely *negative* R-squared values from replications of a true effect. The question on my mind was: WHAT?? I learned some stuff. datacolada.org/134

I am sometimes asked (e.g., today) for advice for conducting meta-analysis. Shoudl i use PET-PEESE or Trim-and-fill?

I feel like being asked what hat color is best to wear during a rain dance.

Data Colada posts about (against) meta-analysis:
datacolada.org/archives/cat...

[116] Our (First?) Day In Court - Data Colada “Any update on the lawsuit?” That is the most common question any of us is asked. It is usually preceded by an apologetic preamble, like, “sorry if this is a sensitive question,” or “I don’t know if you’re tired of talking about this, but…” The reality is that, for the most part, our actual sensitivity...

An update on Gino's lawsuit against us (Data Colada). We had a hearing about our motion to dismiss, and we've learned some legal things along the way. No big news yet, but some details: datacolada.org/116

Why Is There So Much Fraud in Academia? - Freakonomics Why Is There So Much Fraud in Academia? - Freakonomics

Part 1 of a two-part series on Freakonomics: Why is there so much fraud in academia?

Interviews with @briannosek.bsky.social Leif Nelson, @joesimmons.bsky.social, @urisohn.bsky.social, Max Bazerman, and me.

Part 2 (about what journals are doing) coming next week

freakonomics.com/podcast/why-...

I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.

Finally! New policies for Psych Science in 2024 (part 1):

Editorial 1:
www.psychologicalscience.org/publications/psychologic...

Editorial 2 w/ @tomhardwicke.bsky.social
:
www.psychologicalscience.org/publications/psychologic...

Very excited that @i4replication.bsky.social is going to be doing annual stress tests of papers published in Psych Science. It’s amazing to see what they’ve done in econ & poli sci, and great that they’re expanding to psych!

Not your grandparents’ psych journal

A Post Mortem on the Gino Case | The Organizational Plumber My perspective on the Gino-Ariely scandal, and what we should learn from it.

Zoé Ziani (who isn't on BlueSky AFAICT) has posted a long post-mortem on the Gino-Ariely case.

She explains how she came to suspect Gino’s work, the resistance she met during her Ph.D., her experience working with Data Colada, and the lessons business academia should learn from these scandals...

THE REFORM IS COMING FROM INSIDE THE HOUSE.

Best case scenario. www.psychologicalscience.org/publications...

Hello BlueSky! First post to those interested in #decisionmaking #jdm #behavioralecon #consumerbehavior

🔥 SJDM Conference registration is open 🔥 Conference will be Nov 17-20 in San Fran. More info and register today at www.sjdm.org! Early registration ends Nov 5 and fees increase.