Advertisement · 728 × 90

Posts by Brian Schaffner

This feels like a pretty significant development that's not likely to reverse.

3 weeks ago 5 2 2 1

in conjunction with this report, we are also today releasing the data for the 2025 CES common content. includes interviews with 17,000 American adults conducted in late 2025. dig in! doi.org/10.7910/DVN/...

3 weeks ago 2 2 0 0
Preview
The long-standing Democratic advantage in party identification is gone A new report shows how much the partisan landscape has shifted.

there's a new report out from YouGov using CES data to plot trends in partisanship over the past two decades. i've got a piece up today in @goodauth.bsky.social summarizing some key findings. check out both!

GA piece: goodauthority.org/news/long-st...
YouGov report: yougov.com/en-us/articl...

3 weeks ago 12 11 1 4
About & Methodology Learn about how teams can participate in the CES by purchasing survey modules, the sampling and weighting methods used to ensure representative data, and how the questionnaire is structured.

we've put out the call for teams for the 2026 cooperative election study! be the unsung hero who organizes your colleagues for a module tischcollege.tufts.edu/research-fac...

1 month ago 2 2 0 0
About & Methodology Learn about how teams can participate in the CES by purchasing survey modules, the sampling and weighting methods used to ensure representative data, and how the questionnaire is structured.

we've put out the call for teams for the 2026 cooperative election study! be the unsung hero who organizes your colleagues for a module tischcollege.tufts.edu/research-fac...

1 month ago 2 2 0 0
Preview
Most Americans don’t see compromise as central to good citizenship Most Americans don’t see compromise as central to good citizenship. Our election survey data reveal some surprising findings.

Most Americans don’t see compromise as central to good citizenship.

Our election survey data reveal some surprising findings.

The latest from @bfschaffner.bsky.social, see the data here: goodauthority.org/news/most-am...

2 months ago 11 5 2 0
Preview
Trump’s support increased the most in counties with the fewest transplants by Toby Winick (class of 2026)

in 2024, Trump improved most on his vote share in counties that saw the smallest numbers of people moving there. the newest @TuftsUniversity Public Opinion Lab blog post from Toby Winick. tufts-pol.medium.com/trumps-suppo...

2 months ago 5 2 1 0
Post image

there are a lot of things that Americans think are important for being a good citizen, engaging in compromise is not one of them ... my latest post with @goodauth.bsky.social
goodauthority.org/news/most-am...

2 months ago 7 6 2 0
It must be very hard to publish null results
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

It must be very hard to publish null results Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

2 months ago 644 222 30 52
Post image

it is actually a question to respondents, though I think YouGov grabs the meta data and it lines up closely with how people respond to this item. the question is available in public releases, variable name is comptype, I believe. curious to see what you find!

2 months ago 2 0 1 0
Advertisement
Preview
Brian Schaffner on X: "2022 was the first time that a majority of CES respondents took the survey on a smart phone rather than a computer or tablet. just 10 years ago, nearly everyone took it on a (desktop or laptop) computer. https://t.co/y9vFyT3y3b" / X 2022 was the first time that a majority of CES respondents took the survey on a smart phone rather than a computer or tablet. just 10 years ago, nearly everyone took it on a (desktop or laptop) computer. https://t.co/y9vFyT3y3b

it was a tweet a while back... x.com/b_schaffner/...

2 months ago 1 0 1 0
Preview
“Queers for Palestine”: Ironic, or a representation of Queer Theory in action? by Seona Maskara (class of 2026)

in a new Tufts Public Opinion Lab post, Seona Maskara (class of '26) shows that LGBTQ liberals are more supportive of Gaza than other liberals tufts-pol.medium.com/queers-for-p...

2 months ago 2 1 0 1
Post image Post image

📝Inattentive respondents are a growing concern in online surveys.

➡S Blatte & @bfschaffner.bsky.social that 4 to 6% of respondents pass attention checks yet remain inattentive, biasing public opinion estimates for small subgroups www.cambridge.org/core/journal... #FirstView

3 months ago 9 4 0 0
Post image

Very interesting new study using CES data from Scott Platte and @bfschaffner.bsky.social new in @psrm.bsky.social

www.cambridge.org/core/journal...

3 months ago 12 10 1 1
Surviving the screens: the problem of hidden inattentive respondents in online surveys | Political Science Research and Methods | Cambridge Core Surviving the screens: the problem of hidden inattentive respondents in online surveys

i have a new article out in @psrm.bsky.social with Scott Blatte exploring respondent attentiveness in the Cooperative Election Study. we find fairly low rates of inattentiveness but our intervention failed to nudge respondents to pay more attention (thread)
www.cambridge.org/core/journal...

3 months ago 8 5 1 0

tldr: the fairly low rate of inattentiveness is unlikely to affect estimates with the full sample or large subgroups, but may bias estimates for smaller subgroups.

this was Scott's pet project & everyone on the CES team is grateful to him for helping us learn more about inattentiveness in the CES!

3 months ago 0 0 0 0
Post image Post image

we also tested an experimental intervention where we flagged respondents' contradictory responses to one set of items, but that intervention did not produce more attentiveness on subsequent items in the survey compared to the control group

3 months ago 0 0 1 0

it is important to note that the inattentiveness we document occurs in the final sample provided by @today.yougov.com, after they have applied their own extensive quality control checks. these rates are much higher in raw samples obtained from lower quality vendors

3 months ago 2 0 1 0
Advertisement
Post image Post image

while these low rates of inattentiveness are ignorable for analyses using the full sample, inattentive respondents tend to become a bigger share of small subgroups and can affect those subgroup estimates more.

3 months ago 0 0 1 0
Post image

respondents who were consistently inattentive moved through the survey much quicker, were more likely to straight-line and take the survey on a mobile device and less likely to answer the post-election wave and be validated voters

3 months ago 0 0 1 0
Post image Post image

we utilize two pairs of items for which it would be logically inconsistent to indicate support for both items. about 5% of respondents gave logically inconsistent responses to these items and just 2% gave inconsistent responses on both sets of items

3 months ago 0 0 1 0
Surviving the screens: the problem of hidden inattentive respondents in online surveys | Political Science Research and Methods | Cambridge Core Surviving the screens: the problem of hidden inattentive respondents in online surveys

i have a new article out in @psrm.bsky.social with Scott Blatte exploring respondent attentiveness in the Cooperative Election Study. we find fairly low rates of inattentiveness but our intervention failed to nudge respondents to pay more attention (thread)
www.cambridge.org/core/journal...

3 months ago 8 5 1 0

If you need a cite backing up that issues commonly associated with African Americans (like criminal justice and poverty) *are actually perceived to be* associated with African Americans and we aren't just all talking out of our @$$ assuming that criminal justice=Black, Tatishe and I did the work:

3 months ago 6 2 0 0
Preview
The X-perience Factor: What polls miss about Black experience with college and support for… by Miles Kendrick (class of 20026) and Rachel Kuhn (class of 20026)

in the newest Tufts Public Opinion Lab post, Miles Kendrick and Rachel Kuhn show that while Black Americans with college experience strongly support affirmative action, those without such experiences oppose it tufts-pol.medium.com/the-x-perien...

3 months ago 1 0 0 1

really interesting analysis from Tufts Public Opinion Lab alum Zoe Kava!

5 months ago 7 3 0 0
Advertisement

really interesting analysis from Tufts Public Opinion Lab alum Zoe Kava!

5 months ago 7 3 0 0
Preview
How Americans Feel About Immigrants and Immigration

this deep dive on immigration attitudes from Tufts (and CES) alum Caroline Soler and her co-authors is really good! www.nytimes.com/2025/11/19/p...

5 months ago 8 3 0 0

This is out today in open access, and while it's very much a methodology piece, I think it's really important to building the foundation for how we move forward with understanding the role of gender in politics.

5 months ago 14 8 1 0

worth noting that some of this tension was clear in the NYC mayoral, as exit polls show that Mamdani received 79% of the secular white vote, but just 56% among black voters.

5 months ago 4 0 0 0
Preview
Secular Democrats are on the rise Fewer Democrats identify as religious. That’s creating tension with Black voters.

atheist/agnostic Americans are now the biggest single voting bloc in the Democratic Party, and their leftist views may be alienating another of the party's traditional sources of strength ... new piece from me and Steve Ansolabehere @goodauth.bsky.social goodauthority.org/news/secular...

5 months ago 16 10 0 2