Advertisement · 728 × 90

Posts by Brent W. Roberts

Reminder: If researchers find Cohen's d = 6, no they didn't.

trustworthy.scientific.claims/posts/if-res...

1 day ago 71 18 2 1

The irreproducibility tango. It is a timeless story of repeatedly asking a dance partner to dance at a dance only to have them report that they don't dance, ever.

4 days ago 2 0 0 0
Preview
Unfalsifiable by Design: A Year of Trying and Failing to Reproduce a Human Microbiome and Autism Study The myth of open data, reproducibility, responsibility, and accountability in science, and your role in it

How every layer of science's "self-correcting machinery" failed when Iva Veseli and I simply wanted to reproduce the findings of a high-profile study on gut microbiome and autism:

merenlab.org/2026/04/15/u...

5 days ago 160 79 12 21

I visit Tübingen, Germany a lot. It is rainier, darker, and just as hilly as Seattle. The place is crawling with bicycles which are well engineered, equipped for darkness and rain, and ridden by all ages. With the advent of e-bikes it is even better than ever. The car crowd lacks imagination.

5 days ago 3 0 0 0

If we don't talk about fight club doesn't that undermine the marketing campaign? No-one will know what to say or where the gym is...

5 days ago 3 0 1 0
Preview
Opinion | Don’t Use A.I. to Do This

God bless you @colsonwhitehead.com

"Do you realize how much water and power it’d take to replicate the average writer’s narcissism, self-loathing and despair? It’d drain the Indian Ocean. You could light up Times Square for a year. We can’t afford it."

5 days ago 604 132 10 6
Preview
The UK's Proposed "In Real Life" Study of Social Media Reduction is Scientifically Unsound. Doubling down on a research strategy known to lack validity is worse than no study at all.

The UK’s proposed study of social media reduction in kids doubles down on a failed experimental protocol & is likely to produce misleading results. It’s easy to tear apart a study post-hoc so I’m putting my marker down before the study begins: This is a bad study.

open.substack.com/pub/grimoire...

6 days ago 13 8 0 5

Could be an attempt to market to Americans during Thanksgiving

5 days ago 2 0 1 0
Since They Won’t Remind You, Here’s What Drs. John Ioannidis, Jay Bhattacharya, and Scott Atlas, Actually Said 6 Years Ago The next time these doctors claim they were right, let's remind them exactly what they claim to have been right about.

As part of my efforts to combat the COVID Amnesia Project, let's accurately remember what 3 influential laptop class doctors from Stanford said 6 years ago as COVID overflowed hospitals and morgues.

They won't remind you.

I will.

My latest.

1 week ago 665 250 10 7

Or, better yet, a Monty Python GWAS..."I fart in your general direction!"

6 days ago 0 0 0 0
Advertisement
Post image

📎New Research in European Journal of Personality
"How unusual are you?"
Read the full article: doi.org/10.1177/0890...
@aebackunims.bsky.social
#PersonalityPsychology #EJP #EAPP

1 week ago 5 4 0 0
Video

Blothar The Berserker Of GWAR Explains How Independent Journalism Is The Only Force As Powerful As GWAR. Subscribe to The Onion at membership.theonion.com.

1 week ago 2534 523 31 42
Preview
To teach in the time of ChatGPT is to know pain LLM use is the most demoralizing problem I’ve faced as a college instructor.

To teach in the time of ChatGPT is to know pain arstechnica.com/science/2026...

1 week ago 45 16 0 4

Oh, the humor is from the gallows...it says a lot that @talyarkoni.com left the field. Too many people are too transactional about the incentives, I suspect.

Whatever happened to the scientific incentive to find the truth or the best possible approximation, thereof?

1 week ago 4 0 1 0

Well, we just need to give them the proper incentives and those economists will make the rational choice...

1 week ago 5 0 1 0
Preview
a man with a beard sits in a chair ALT: a man with a beard sits in a chair
1 week ago 4 0 1 0
Graph showing the proportion of clinical psychology studies that adopted four transparent research practices (preregistration and sharing of measurement instruments, data, and analysis scripts) at three time points (2012, 2018, 2024). The graph suggests adoption of these practices has increased but remains uncommon.

Graph showing the proportion of clinical psychology studies that adopted four transparent research practices (preregistration and sharing of measurement instruments, data, and analysis scripts) at three time points (2012, 2018, 2024). The graph suggests adoption of these practices has increased but remains uncommon.

Graph showing the proportion of clinical psychology studies that adopted three transparent research practices (reporting guidelines and disclosure of conflicts of interest and funding) at three time points (2012, 2018, 2024). The graph suggests use of reporting guidelines has increased but remains uncommon. Conflict of interest disclosure statements have increased and are now quite common. Funding disclosure statements were relatively common across the three time points.

Graph showing the proportion of clinical psychology studies that adopted three transparent research practices (reporting guidelines and disclosure of conflicts of interest and funding) at three time points (2012, 2018, 2024). The graph suggests use of reporting guidelines has increased but remains uncommon. Conflict of interest disclosure statements have increased and are now quite common. Funding disclosure statements were relatively common across the three time points.

Has transparency improved in clinical psychology? New cross sectional study from us (Bianca Kotoulas, Justine Blackwell & me). Adoption of transparent research practices has increased between 2012, 2018, & 2024, but aside from coi and funding disclosures, they remain uncommon osf.io/preprints/ps...

1 month ago 57 21 0 1

born to rebel, baby, born to rebel...

1 week ago 2 0 0 0
Advertisement

I'd be more judgy of the participants if it were not for the fact that a fair number of my Ph.D. friends in the academic world still believe in birth order effects, or for that matter a fair number of fictional findings that suit their purposes. 4/

1 week ago 1 0 1 0

they persisted nonetheless. This was usually aided and abetted by a science teacher who by reading intro psych text books had come to the firm belief that birth order was a thing and therefore countered my arguments. I guess their experience of the null effect was good? 3/

1 week ago 1 0 1 0

the proper guidance. In the few cases where they were intent on running a study, I told them repeatedly that they wouldn't be able to detect the .03 effect size in a sample of 100 friends. Largely because they didn't really believe our findings or understand what an effect size was 2/

1 week ago 1 0 1 0

Meh. The undergrad and grad students never come to my office hours (I'm scary?). I can spare a few hours to talk to a high school student, especially if they are interested in research. The slippage happens when they actually want to conduct a study. They typically don't have the resources, or 1/

1 week ago 1 0 1 0

Weren't you just out of high school when you did your birth order project?

1 week ago 2 0 1 0

I think the AP stuff is fine as well as doing college-level courses. After all, much of our material is easily consumed by high school students. It is the prospect of conducting their own research project that is new and potentially problematic.

1 week ago 2 0 1 0

They want to do the neuroscience of psychopathology??? If we only had a portable fMRI machine...

1 week ago 2 0 0 0
Advertisement
A McDonald’s where the sign has been reduced to McDo.

A McDonald’s where the sign has been reduced to McDo.

There is no McTry.

1 week ago 22343 3767 371 204

Relatedly, I'm now contacted about 4 times a year by high school students doing research projects on birth order. It seems the arms race to do research is now shifting earlier and earlier. And, like always, the easy targets like birth order are the first choice of AP Psychology courses.

1 week ago 3 0 2 0
Preview
Offering scientists cash to spot errors in published papers doesn’t work The ERROR project tried enticing reviewers with payments. Now, it’s launching a journal—and promising papers as rewards

The ERROR project recruits independent experts to recheck social sciences papers’ data, statistics, methodology, code; now the project plans to publish the reviews in a new peer-reviewed journal.
science.org/content/arti...
@dalmeet.bsky.social @science.org
#reproducibility

1 week ago 20 16 0 0
Post image

An exasperated Jason Collins bangs the drum he’s been beating for 10 years over a pure zombie study.

The original research suggesting a little disfluency in communication stimulates more analytical reasoning is a spectacular replication failure:

buff.ly/VxIUvYr

1 week ago 13 3 0 1

Direction of effect and success of publcation: a randomized study has really been done already!
Thanks to @floriannaudet.bsky.social for pointing it out
jamanetwork.com/journals/jam...

2 months ago 22 9 3 1