Congratulations, Robb!
Posts by Martin Saveski
The IC2S2 deadline is right around the corner!
We really need more reviewers to make this conference work. I know (I KNOW) you all get a lot of requests but please consider signing up, especially if you submit. It’s just a few abstracts, we’ll keep the review load light. Promise!
⚙️ Working at the intersection of causality and networks?
We're organizing a satellite event at @netsciconf.bsky.social in Boston on June 1st. The focus is networks science and causal inference.
Submit your work by March 10th!
causnets.github.io
"Community Notes" are reshaping how millions encounter information on social media--but what makes them work (or not)? We term these "Crowdsourced Context Systems" (CCS) and introduce a framework for designing and evaluating them in a new #CHI26 paper 🧵
Consider submitting an ICWSM workshop proposal! It’s a great opportunity to create space for discussions around emerging research threads, new methods, or even old but exciting topics. Deadline: Jan 30.
I feel like colleagues are winking at me when they write a descent letter but don't select the highest option 😀
I didn't expect this until I was on the other side, but I do find them a bit informative. The culture is such that ppl feels they need to write a "good" letter and you can emphasize the positive aspects in the letter. But when explicitly asked, I think most people find it hard to be untruthful.
The Center for Information Technology Policy at Princeton invites applications for a Postdoctoral Fellow to work with Andy Guess (Politics/SPIA), Brandon Stewart (Sociology), and me (CS).
puwebp.princeton.edu/AcadHire/app...
Please apply before Sunday, the 13th of December!
Some social media algorithms are feeding us antidemocratic attitudes and intergroup hostility.
But a new field experiment finds that an algorithmic feed can reduce out-group animosity & affective polarization by down-ranking this hostile political content.
www.science.org/doi/10.1126/...
Sure, the "dosage" of the decreased exposure intervention depends on how much AAPA participants had in their feed (per party breakdown in Fig. S3); increased exposure was similar for everyone. But reweighting by party, education, and race doesn’t change the point estimates much (see Sec. S10).
Screenshot of research article in Science titled "Reranking partisan animosity in algorithmic social media feeds alters affective polarization." Full text available at https://www.science.org/doi/10.1126/science.adu5584.
What if you could see fewer hostile political posts on social media? A new paper out in Science by Martin Saveski @msaveski.bsky.social of the iSchool, along with @tiziano.bsky.social, @jiachenyan.bsky.social, Jeff Hancock, Jeanne Tsai and @mbernst.bsky.social, explores this: doi.org/10.1126/scie...
Nice! I'm glad you enjoyed it! Actually, @jugander.bsky.social strongly recommended it to me when I was there a few years ago.
Re SUTVA: My experience doing empirical and methodological work on interference (e.g., doi.org/10.1145/3097...) has kept me humble when trying to predict total treatment effects.
(Also, that's where we got the idea to contextualize with historical change.)
We actually did a thorough lit review when doing the power analysis and, if you look closely, there aren’t many experiments that used the same outcome to compare with. My best reference point is the excellent paper by Santoro & @dbroockman.bsky.social : doi.org/10.1126/scia...
That’s why we tried to contextualize the results in terms of historical change in the metric.
Well, they ask whether a 2-degree change is a small effect, and I think it’s a reasonable question. I’ve discussed this with quite a few people who have done extensive empirical work in this area and whose opinions I value. For some, 2 degrees is small; for others, it’s huge ...
Thank you! I have been meaning to send all of your a note for while, but I can't overstate how helpful your Green Lab SOP was in analyzing the data!
Thanks for the shoutout! Obviously many possible reasons for the differences but my best guess is (i) content vs. user level intervention (i.e., reranking content likely to polarize) and (ii) much higher prevalence of political content on X (32% on X vs. 13.4% on FB). Curious to hear your thoughts.
Finally, in this work, we focused on affective polarization, but our framework for LLM-based feed ranking is general and can be applied to other outcomes, including well-being, mental health, and civic engagement.
/fin
We hope that other researchers will use our methodology to run experiments that are longer, span multiple platforms, and extend beyond the US.
/13
Important limitations to keep in mind: (i) this was a 10-day experiment, (ii) run on a single platform, and (iii) during a politically charged time.
/12
Increasing exposure to AAPA didn’t lead to any detectable effects on engagement, likely because we reranked far fewer posts.
/11
Reducing exposure to AAPA led to a decrease in engagement in absolute terms: less time spent, less posts viewed, and liked. However, among the posts that the participants viewed, they liked them at a significantly higher rate.
/10
Effects of reducing and increasing exposure to AAPA content in participants’ feeds on their experiences of emotion compared with that of the corresponding control group. (Left) Participants were surveyed within the feed during the intervention [scale ranged from 0 (“none at all”) to 100 (“extremely”)] and (right) off-platform after the experiment [scale ranged from 1 (“never”) to 5 (“all the time”)]. The filled circles represent statistical significance (Padj < 0.05, adjusted for multiple hypothesis testing), and the error bars represent 95% CIs.
Decreasing exposure to AAPA made participants less angry and sad in the moment while increasing exposure had the opposite effect. The reranking didn’t have any effect on calm and excitement.
/9
Average fraction of AAPA posts seen by participants for each day of the experiment.
While the effects are symmetric, it’s worth noting that we upranked a few APAA posts and downranked all AAPA posts in the corresponding conditions.
/8
Effects of reducing and increasing exposure to AAPA content in participants’ feeds on their feeling toward the out-party relative to the corresponding control group. (Left) Participants were surveyed within the feed during the intervention and (right) off-platform after the experiment. The feeling thermometer scale was between 0 (cold) and 100 (warm). The error bars represent 95% CIs.
In a field experiment with 1,256 consenting participants, we found that downranking AAPA posts leads to a decrease and upranking to an increase in affective polarization of 2 degrees on the 0-100 out-party feeling thermometer.
/7
There are many reasonable ways to define “polarizing content.” We focused on antidemocratic attitudes and partisan animosity (AAPA), drawing on the eight factors defined in the excellent study by Voelkel et al.
doi.org/10.1126/scie...
/6
In contrast to previous work that intervened at the level of users (e.g., downranking in-party content) or platform affordances (e.g., switching to a chronological feed), we intervened at the content level, exploiting recent advances in NLP.
/5
We used this method to test how reranking content that is likely to polarize affects participants’ affective polarization and emotions.
/4