PYMS PYMS Email Forms

It's been a week, but we left inspired after #PSE8 in Leiden.

Thanks to all who participated in our mentor-mentee lunch! Hopefully you all had interesting conversations, and made new connections.

ECR and want to see more of PYMS? Sign up for the mailing list: tinyurl.com/3mkn6f2a

FYI #PSE8 folks... will likely get to this next month after all the walking and fundraising for Cats Protection is finished up and I have a bit of free time!

Still buzzing from Perspectives on Scientific Error 💡🌱
The smaller, one-stream format worked so well to create the feeling of a continuous, shared conversation across sessions (pictured: me making a cameo in @liztenney.bsky.social's slides!) #PSE8

OSF

I was reminded last week whilst chatting at #PSE8 of the changes I had planned to make to the undergraduate dissertation module in an effort to promote learning about reproducibility, replicability, and transparency (but unfortunately never got to implement before leaving academia).

1/2

despite my high expectations, #PSE8 was even better than I had imagined! I’m truly grateful to all the organizers and attendees for such a great experience, the much needed inspiration and chance to get feedback on my little #scicom research idea ⬇️

So sorry to have missed it! But #PSE8 was very good

Raphael, Max and me in front of our poster.

Conference room filled with people

That's a wrap for #PSE8 at @unileiden.bsky.social. Always amazed by the work people do in metascience, even though I only understood maybe half of the talks.
Also thanks to anyone engaging with me in some way, either at the poster session or on any other occasion, I appreciate it!

Very pleased with these new hex stickers, for the #PSE8 conference, but also for our TOSTER package, Metacheck, and my Improving Your Statistical Inferences book and course :)

The Metacheck team (www.scienceverse.org/metacheck/) and some interested collaborators are hackatonning away on how to create and validate new metacheck modules to automatically detect information in scientific papers. #PSE8

Great Crested Grebe (Podiceps cristatus) swimming in a canal in Leiden

On the way to #PSE8 this morning, I saw a Great Crested Grebe (Podiceps cristatus) and recorded it as an observation on #inaturalist . This could be seen as an assertion of the type <observer><observed><bird>
<timestamp><location><observation identifier> […]

[Original post on mastodon.social]

Nanopublications Hackathon (space) | nanodash

Of course, the #nanopublications #hackathon at #PSE8 has its own space in the nanopublication network, all built using nanopublications.

https://w3id.org/spaces/PSE8/Nanopublications-Hackathon

Making Errors and Uncertainty FAIR: A Nanopublications Hackathon for Machine-Actionable Scientific Error Reporting This repo contains the materials for the nanopublication hackathon at the "Perspectives on Scientific Error 2026" on 13 February 2026 in Leiden, The Netherlands. Abstract Communicating and reusing estimations of uncertainty and error is critical for interpreting scientifically relevant observations but currently hampered by poor consistency and documentation. These errors arise from diverse sources, including linguistic ambiguity, computational bugs, systematic biases, unstable measurements and missing data. Despite its central role in quality control, data integration, and decision-making, uncertainty is often underreported or informally expressed. Nanopublications offer an ideal, structured, and machine-actionable framework to address this challenge by providing a scalable solution that transcends traditional, narrative-based methods. Their design combines precise assertions with rich provenance, allowing researchers to clearly state an observation or claim (e.g., regarding an error or uncertain measurement) while simultaneously linking to its full supporting history and context. Expressed as interoperable RDF triples, nanopublications are openly published on a decentralized network as FAIR Digital Objects, making this essential information easily discoverable, integratable, and processable by automated systems across various scientific domains. The Metabolomics and Analytics Center (MAC) at Leiden Academic Center for Drug Research is developing a nanopublication-based reporting framework to capture three critical uncertainty types inherent in high-throughput mass spectrometry data: those related to detection limits/sensitivity, physical/chemical instabilities (such as evaporation or oxidation), and ambiguities from structural isomers. This hackathon will leverage the MAC's developments to explore nanopublications as a universal, scalable, and machine-actionable mechanism for communicating errors, uncertainty, and related concepts across scientific domains, using metabolomics as a core case study. Participants will be introduced to nanopublication principles and decentralized publication infrastructures through hands-on experience with user-friendly interfaces and templates. To lower barriers to participation, no technical prerequisites are assumed; participants only need to authenticate via ORCID in a browser [so come prepared with your ORCID credentials at hand!]. We'll show metabolomics examples from MAC that include uncertainty and error reporting. Participants are encouraged to bring their own examples of errors, uncertainties, and data quality issues from any scholarly domain. By the end of the hackathon, participants will have created and published nanopublications describing real error and uncertainty scenarios and gained practical experience with FAIR, machine-actionable error communication.

The slides are up for the #nanopublications session at the #PSE8 #hackathon today:
Making Errors and Uncertainty FAIR: A Nanopublications Hackathon for Machine-Actionable Scientific Error Reporting. Zenodo. https://doi.org/10.5281/zenodo.18627181

#openscience #FAIRdata

We are starting the 3rd day of #PSE8, which is completely dedicated to hackathons. People can join one in the morning, and one in the afternoon, and collaboratively work on projects, or develop new ideas for future projects!

Perspectives on Scientific Error 2026 (space) | nanodash

The #PSE8 #hackathon day is about to start with pitches for the individual morning sessions. https://w3id.org/spaces/PSE8

Day 12 down... Found another friendly kitty getting in some extra miles over lunch break. Bonus that my talk went down well today and inspired some wonderful discussion with attendees #PSE8

www.justgiving.com/page/james-s...

Julia Jaszczak from AMU and Milosz Kalinowski from @polskaakademianauk.bsky.social presenting a poster on testing the quantity of constructs in psychology at a conference #PSE8. We have tools (but we do not use them) to check whether the measurement provides sufficient data for statistical analysis

Final keynote and talk of the #PSE8 conference, by František Bartoš, University of Amsterdam, talking about the idea of robustness reports.

Leif’s #PSE8 keynote was ridiculously good, basically a live episode of @datacolada.bsky.social ... if anyone deserves a detective/sitcom series based in their work, it’s Leif, not Ariely – take note @netflix.com

Edith Beerdsen from Temple University, USA, continues the afternoon about the role that scientific error plays in the courtroom, providing a perspective on Scientific Error from how science influences the practice of law. #PSE8

Insights from the #PSE8 conference

Day 2: I was particularly struck by a presentation from Prof Leif Nelson on the detection of problematic data.

I wonder how many of us have came across problematic papers - or datasets and don’t what to do!?

#ResearchIntegrity #OpenScience

Very relevant following the keynote by Leif Nelson! #PSE8

Neil Nelson will give the first keynote of the day, about finding lies in the work of scientists. He argues we need to be able to detect what is not true when we interact with the scientific literature. #PSE8

#PSE8 Hey all... The incomplete theory building and testing chapter link I shared may be broken so I'll re-upload as a preprint and reshare here when I get a moment.

Thanks!

Presentation slide with title finding lies from the people who create the truths, by Leif Nelson

#PSE8 excited for this keynote

We continue with a discussion about theory specification in social psychology by Anand Krishna from Wurzburg, Germany. #PSE8 After decades of calls for stronger theory, how do we actually specify more detailed theories?

We continue with James Steele (wearing his 'stay calm and read Paul Meehl' shirt) who is in a high pace running us through his views on how we develop and test strong theories. #PSE8

We are back at the second day of #PSE8! Liz Tenney from the University of Utah is stepping in to cover for an I'll speaker, and talking about doing replication in the trenches - reflecting on the practices of doing replication studies.

Thanks to everyone that was interested in my poster for the great conversations and discussions!

The preprint on reporting, open science, and trustworthiness in simulation studies is available here: osf.io/jn9sy_v2

Ready for day two of #PSE8!

Wahou, so refreshing this first day at the meta-science conference #PSE8. How did I change my mind from science is broken to yes but great minds are working on it!

I also received very positive feedback on my work on outlier detection (that should be out as a preprint soonish)

Might be interesting to colleagues from #metasci (e.g., currently at #PSE8). Thanks for your support!