ExplainabilityAccountabilityFairnessstat.ME
Causes of Effects: Learning individual responses from population data
Scott Mueller, Ang Li, Judea Pearl
April 28, 2021
International Joint Conference on Artificial Intelligence
65 citations
7 influential
Key Takeaways
-
Counterfactual reasoning is essential but impossible to measure directly: The paper addresses a fundamental challenge in responsible AI—determining whether a specific individual would have benefited from a treatment or decision requires knowing two contradictory outcomes (what happened if treated AND what would have happened if untreated), which cannot both be observed in reality.
-
Combining different types of data can narrow uncertainty about individual outcomes: Rather than relying solely on population-level statistics or experiments, the research shows that combining experimental data with observational data and structural causal models can produce tighter bounds on the probability that a treatment caused a specific person's outcome, making predictions more reliable for individual cases.
-
This approach directly enables fairer AI decisions in high-stakes domains: The paper explicitly identifies three critical applications—explainable AI, legal responsibility, and personalized medicine—where understanding individual causal effects is necessary. For example, determining whether an algorithm's decision caused harm to a specific person, or whether a medical treatment would have helped a particular patient, requires this type of counterfactual analysis.
-
Structural knowledge about how systems work improves personalization: The research demonstrates that incorporating causal models (understanding the mechanisms behind outcomes) can significantly improve estimates of individual responses compared to methods that only condition on observable features, suggesting that domain expertise and system understanding are valuable for responsible AI implementation.