A Note on Dropping Experimental Subjects who Fail a Manipulation Check | Political Analysis | Cambridge Core A Note on Dropping Experimental Subjects who Fail a Manipulation Check - Volume 27 Issue 4

#statstab #510 A Note on Dropping Experimental Subjects who Fail a Manipulation Check

Thoughts: Another paper to consider when "removing participants who failed our manipulation check"🤷‍♂️

#manipulationcheck #estimand #experiment #design #bias #guide #assumptions #missingdata

doi.org/10.1017/pan....

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

#statstab #497 On the Statistical Analysis of Experiments
With Manipulation Checks

Thoughts: All psychologists reading this title will panic. Yes, you can't just delete data and assume all is well.

#assumptions #QRPs #estimand #causalinference #ITT #ATE #bias

journals.sagepub.com/doi/pdf/10.1...

Some Common Dose–Exposure–Response Estimands and Conditions for Their Causal Identifiability Exposure–response analyses are central to dose selection in drug development. The estimand framework, formalized in ICH E9(R1) regulatory guidance, provides a structured approach to define scientific...

We apply the estimand framework to dose–exposure–response analyses. ... strategy to improve exposure–response analyses for dose selection, particularly when the relevant evidence includes data from multiple studies.

#estimand #exposure-response #dose-response #causal

doi.org/10.1002/psp4...

#statstab #485 Bayesian ANCOVA and the ATE

Thoughts: Still grappling with the implications of using the causal inference approach to randomized experiments. But it's interesting.

#ATE #causalinference #ancova #ANOVA #rstats #estimand #counterfactuals

solomonkurz.netlify.app/blog/2025-07...

Analysis resources

#statstab #471 Analysis Resources for N-of-1 research

Thoughts: Some cool and some questionable stuff, but a good place to start looking.

#Nof1 #analysis #resources #estimand #methods #sced #stats #smallsample #scd

www.nof1sced.org/analysis

Race as a Bundle of Sticks: Designs that Estimate Effects of Seemingly Immutable Characteristics Although understanding the role of race, ethnicity, and identity is central to political science, methodological debates persist about whether it is possible to estimate the effect of something immuta...

#statstab #457 Race as a Bundle of Sticks: Designs that Estimate Effects of Seemingly Immutable Characteristics

Thoughts: The theoretical framework a researcher uses will affect the causal inference they can make.

#estimand #causalinference #rubin

www.annualreviews.org/content/jour...

Shall we count the living or the dead? In the 1958 paper "Shall we count the living or the dead?", Mindel C. Sheps proposed a principled solution to the familiar problem of asymmetry of the relative risk. We provide causal models to clarif...

#statstab #456 Shall we count the living or the dead?

Thoughts: survival ratio -> if the intervention increases risk of the outcome
risk ratio -> if the intervention reduces risk of the outcome

#causalinference #riskratios #survivalanalysis #estimand

arxiv.org/abs/2106.063...

An #estimand is effectively a more precise specification of the research question(s) and how the treatment effect is to be estimated (hence estimand). It also specifically describes how so called “intercurrent events” will be handled in the analysis. 2/8

The term #estimand is now part of the technical language of trials - but it remains a concept that many find hard to understand. Recent work has aimed to make the term more accessible to researchers, patients & public 1/8
#MethodologyMonday #127

Interessantes Framing (bzw. Forschungsfrage oder #Estimand), dass hier die "Hacke" in der ökologischen Landwirtschaft die Alternative (das #Counterfactual) zur neuen Technologie (dem #Treatment) ist und nicht die Herbizide in der konventionellen.

#Kausalanalyse #WissKomm

Bayes-by Shower

#statstab #441 Bayes-by Shower

Thoughts: Comprehensive (read: long) tutorial on bayesian analysis and how to think about research.

#bayes #rstats #bayesian #tutorial #DAGs #estimand #observational #design

betanalpha.github.io/assets/chapt...

Are estimands being correctly used? A review of UK research protocols - Trials Background The use of estimands in clinical trials was formalised with the adoption of the final International Conference on Harmonisation E9 Addendum on Estimands and Sensitivity Analysis in Clinical Trials (ICH E9(R1) Addendum) in November 2019. The declared objective of the ICH E9(R1) Addendum is to bring clarity and transparency to the research question of interest. For this to be achieved, the estimand must be described in accordance with the requirements of the ICH E9(R1) Addendum so that the target treatment effect is clear to all stakeholders. Previous reviews of publications and published protocols have found that few trials explicitly defined the primary estimand. To obtain a more complete picture of how the use of estimands has changed over time, whether trials are using estimands correctly (i.e. correctly defining the five attributes of an estimand), and which strategies are being used to handle intercurrent events, we obtained access to an extensive database of original research protocols (n = 29,212) submitted to the United Kingdom’s Health Research Authority, which oversees ethical review of clinical trials. Methods Protocols were eligible for review if they included the term ‘estimand’ and attempted to define at least one attribute of the primary estimand. For eligible protocols, we extracted information on trial characteristics such as whether the trial was randomized and the therapeutic area, as well as whether the estimand attributes used for the primary outcome were correctly defined, and which strategies were used to handle intercurrent events. Results We found that the number of protocols defining a primary estimand increased starkly with publication of the ICH E9(R1) Addendum (approximately 3 protocols/year pre-ICH E9(R1) Addendum vs. 18 protocols / year during the consultation period vs. 23 protocols in the year following the adoption of the ICH E9(R1) Addendum). However, the description of the primary estimand was suboptimal; many protocols failed to mention specific attributes (such as population or treatment conditions) in the estimand description, and many protocols incorrectly defined estimand attributes (e.g. by describing the estimand population based on their analysis population). Conclusions Although release of the ICH E9(R1) Addendum has dramatically increased the use of estimands in clinical trials, their reporting is suboptimal. There is still work to be done to ensure estimands reach their full potential in bringing clarity and focus to research questions.

A review of UK MHRA protocols (k=122) of the use of #Estimand -s offers insights for improvement of protocols due to incomplete or incorrect specifications:
trialsjournal.biomedcentral.com/articles/10....

#RCT #StudyDesign #Registration #Causality

Two good resources explaining what estimands are 👇

Causal inference for N-of-1 trials The aim of personalized medicine is to tailor treatment decisions to individuals' characteristics. N-of-1 trials are within-person crossover trials that hold the promise of targeting individual-specif...

#statstab #412 Causal inference for N-of-1 trials

Thoughts: Only skimmed this, curious what the #causalinference ppl think of this.

#Nof1 #causalinference #ATE #effect #estimand #inference

arxiv.org/abs/2406.103...

#statstab #407 Choosing the Causal Estimand for Propensity Score Analysis of Observational Studies

Thoughts: Doing obs. research? Do you know the difference b/w the ATE, ATT, ATU, and ATO?

#observational #estimand #ATE #biomedical #clinical #effect

arxiv.org/pdf/2106.105...

Trigg et al recently discussed several conceptualisations of meaningful between-group differences:
rdcu.be/ehHdD

A follow-up comment advances the discussion around this issue further with four points @kevinweinfurt.bsky.social summarises below - or you can read the paper! 👇

#RCT #Estimand #HRQL

Do Covariates Change the Estimand? Adjustment for covariates has been underused in trials intended to support approval of medical products. This underuse results partly from confusion about whether adjusting changes the thing being ...

#statstab #285 Do Covariates Change the Estimand?

Thoughts: "covariates should be taken into account in estimation. Doing so does not change the question but gives better answers"

#estimand #covariate #causalinference #effects #estimation

doi.org/10.1080/1946...

Is caviar a risk factor for being a millionaire? Anders Huitfeldt argues that the answer depends on your definition of “risk factor” and calls for greater clarity in research The risk factor approach to epidemiology was introduced by the Framingham...

#statstab #283 Is caviar a risk factor for being a millionaire?

Thoughts: Depends on how do you define "risk factor". For diagnosis, prognosis, treatment effect, or aetiology?

#research #clinical #diagnosis #estimand #prognosis #riskfactors #treatment

doi.org/10.1136/bmj....

#statstab #263 What is a research design? {book}

Thoughts: If you're new to research, this might be a good start. Entire book on research design.

#book #pedagogy #research #education #resources #design #estimand #science

book.declaredesign.org/introduction...

Carrots or mince pies for the reindeers🦌? That is the question Santa is puzzling over this Christmas in this fun festive piece from @suziecro.bsky.social and I. Find out how the #estimand framework can help Santa clearly specify his research question & answer this important question rdcu.be/d3vwe

British Association of Dermatologists Professional membership body for dermatologists in the UK and abroad.

Thanks to the British Association of Dermatologists for inviting me to write a 2-part blog on designing a clinical research study:

1. Ask the question. 2. Answer it

1st part now out on the BAD website.

#estimand #trials #NRSI #registry

www.bad.org.uk/how-t...

I'll dig this one out next time someone starts one of the good ol' "can't you just run a mixed effects mediated moderation ordinal mixture regression model on this cross-sectional data? I heard these are cool"-conversation with me...

#WhatIsYourEstimand #Estimand

Why estimands are needed to define treatment effects in clinical trials - BMC Medicine Background The estimand for a clinical trial is a precise definition of the treatment effect to be estimated. Traditionally, estimates of treatment effects are based on either an ITT analysis or a per...

#statstab #122 Why estimands are needed to define treatment effects

Thoughts: An "estimand" is a complicated notion to grasp at first, but articles like this one helped explain why method choices matter.

#medicine #estimand #ITT #research #bmc

bmcmedicine.biomedcentral.com/articles/10....

But in all these years I found it difficult to get a grasp on how #EducationalResearch understands and conceptualises #ControlGroups.
 
In my health-oriented research this discussion is very prevalent.
#OutcomeDefinition #Estimand
 
And while I admired the early uptake of...