From post-publication review to post-publication enrichment 🔥🚀
#ATScience #Metascience
Posts by Joel Chan
Fantastic! I would love to help however I can!
Idea: can we make this into a @leaflet.pub manifesto, and collect verified (via PDS) signatures from builders, funders, and (most importantly), scientists?
#atprotoscience
1. Steve Jobs realized that "People hate their phones". Apple invented a better one, made bank, & changed the world.
Academics hate their scientific publishers. Bluesky invented a better publishing platform, & could bank some of the ~$20B/year sci pub revenue, changing science 🧪 @toni.bsky.team 🧵
@devezer.bsky.social i think you might enjoy this!
main case study in the paper is of predictions of "replicability" of studies!
Quote: In the past, scientific communities – when faced with increased pressure to evaluate and sort research and their authors – have decontextualized, repurposed, and aggregated newly crafted credibility markers (Lee 2022) through fallacious processes of inference by false ascent. In inference by false ascent (Cartwright et al. 2023, 48; Reiss 2016), the original, concrete purpose for which a measure is originally designed gets redescribed at a more abstract level, but in epistemically problematic ways: for example, although the journal impact factor was first introduced for the purpose of helping librarians decide which journals to purchase (Gross and Gross 1927), some embraced this metric as a more abstract measure of “scientific impact” (Garfield 2006). Because the more abstract purpose covers a range of other more concrete purposes, the original measure may be deployed for those other concrete purposes, even when doing so is epistemically problematic: for example, the journal impact factor, once elevated into an abstract measure of “scientific impact,” was repurposed as a controversial measure of article and author impact (Hicks et al. 2015; Larivière et al. 2016) and likely informs determinations of article relevance in research search engines like Google Scholar (Google Scholar, n.d.). Even open science elements shared for the purpose of facilitating the transparent evaluation of a manuscript’s claims (Begg et al. 1996; Nosek et al. 2015) can be easily decontextualized and repurposed (Leonelli 2023) to score manuscripts for their computational reproducibility (Siegel et al. 2024) and, when combined with data citation metrics, to quantify author data-impact via “S-index” metrics (Challenge.gov, n.d.).
#TIL new term!
"inference by false ascent"
a complement/alternative to goodhart's law for understanding the dangers of metric-izing research evaluation
from: arxiv.org/pdf/2601.09753
#metascience
Worse is better until it isn't.
100%!!
Diagram arguing that small, niche software built at low cost represents an underexplored 'land of opportunity' compared to the dominant model of high-scale software. 2x2 matrix with Scale on the x-axis (from 'Small, Special Snowflake Software' to 'Global Industrial Software') and Profit on the y-axis (from 'Sink Hole' to 'Billion $ Unicorn'). Three zones are highlighted: 'Most software today' sits in the high-scale, high-profit quadrant. 'Short lived failures' occupies the high-scale, low-profit quadrant. 'Land of opportunity' sits in the low-scale, medium/low-profit quadrant, labeled as low cost. The low-scale, high-profit quadrant is empty."
Quote from Ivan Illich's "Tools for Conviviality": "People need not only to obtain things, they need above all the freedom to make things among which they can live, to give shape to them according to their own tastes, and to put them to use in caring for and about others"
This is my clumsy interpretation of the lovely vision painted by @maggieappleton.com of "home-cooked software and barefoot developers": maggieappleton.com/home-cooked-...
This (+ things like Lea: atmosphereconf.org/event/ats26-...) is what excites me about the opportunity from AI-assisted coding: making awesome software-enabled things exist separate from the pressures and incentives of VC
Quote: "Pivot to Wiki" is my proposal for a cultural shift in how we organize, curate, and engage with information. we need to rely less on info formats that work by grabbing our limited attention. we've only got 24 hours in a day, and all the articles & social media posts & flashy videos have to compete for each second of that. when clicks and retention rule, conveying truth becomes an afterthought. consider the financial incentives for article-based news/journalism & social media: article-by-article journalism, as a business, must necessarily be written by a finite number of employees and derive its revenue from keeping readers informed on the news via clicks or subscriptions. if it stops producing news (new information), it won't produce any revenue. social media, as a business, has to attract a mass audience who constantly post to keep each other's attention. if nobody posts, there's no business. i'm not suggesting we reject news and social media entirely, but you need to realize at a very basic level that these organizations, without a change in what we demand, cannot escape the attention competition. we as consumers have to demand that as much information as possible be converted to and represented in Wiki formats. a Wiki, compared to a news publication, sorts information not by time but by topic. a Wiki prioritizes interlinkedness and organization, and derives its value from those properties.
hell yeahhhh
tons of synergies with what we're doing @discoursegraphs.bsky.social too (we're already collab-ing with @semble.so)
"wiki via atproto"
Annoucing Semble Connections: A new way to organize, curate and discover content in the open social web 💥
@infotainment.bsky.social shoutout!
AtmosphereConf 2026 is a wrap! We hope all the remote attendees had a great Streamplace experience.
When VODs, you ask? They're actually up right now! They're `place.stream.video` records in this repo.
One catch: no frontend yet. That's where you come in.
Welcome to the Streamplace VOD JAM.
Funding models are not binary. Beyond philanthopy and VC, there are other patterns including mission-locked, co-op, concessionary, community & oss.
Here's the updated "Funding Models Are Not Binary" slide from my Feature/Product/Business talk #ATmosphereConf. Turns out there are even more great examples already in the Atmosphere!
Screenshot of a popup from a StreamPlace live chat that allows me to view the user who sent a comment on bsky.app
neat way to conference in an interop way - see neat comment in @stream.place , directly go follow that user on @bsky.app
#atmosphereconf
"the “Black Mirror Gambit” which works by presenting your company as the villain in a Black Mirror episode to soak up this mid-2020s-era investor demand for, well, evil plots."
is highly explanatory for me for the shit we're seeing these days (hello cluely et al), along w/ "everyone is 12"
Build from the critique!!!! You can just do things <3 <3 <3
#atmosphereconf #atprotoscience
I'm on my way to Vancouver for #atscience #atmosphereconf!
Social media can be different. The internet can be different. We don't have to accept what companies have constructed; we *do* have agency to build, hack, repair, nurture, grow, create!
So excited to meet my bsky heroes and learn more!!
Can't fly there, but grateful for remote/hybrid #ATmosphereConf options!!
Let's organize and curate #ATmosphereConf resources together 🫶
who has made or will make a zotero -> @semble.so importer/sync?
This is amazing.
I'm v curious if/how the community is reflecting on their relationship to anyone who is still on BlackTwitter?
e.g., How do people negotiate, what centers of gravity still remain on Twitter, are affordances on BlackSky equal/better to what was available on BlackTwitter etc?
“I wanna see Black people happy when I open my phone”
Turns out it didn't have legs
We're very honored to have @row1.ca & @matsulab.com as keynote speakers at #ATScience!
Rowan & Matt will share their vision "Towards Modular Open Science" on moving beyond isolated papers toward a world of modular & interoperable research objects, leveraging #atproto as a decentralized backbone 🧪✨