ExplainabilityTransparencyTrustworthinesscs.LG
Context-Aware Concept Distillation for Trustworthy Flood Prediction
Eli Levinkopf, Efrat Morin, Claudia V. Goldman
July 25, 2026
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence
Key Takeaways
-
Interpretability is essential for public safety decisions: The paper demonstrates that "black box" AI models create accountability barriers in flood forecasting, a high-stakes domain where emergency responders need to understand why a system makes predictions to make informed decisions about resource allocation and evacuation orders.
-
Explainability methods alone are insufficient: While existing XAI techniques provide local explanations, they don't offer the "verifiable, operationally meaningful causal narratives" that disaster response authorities actually need—highlighting a gap between current explainability research and real-world operational requirements.
-
Domain expertise should guide AI design: The framework was "developed in collaboration with domain experts" to create hydrology-aware models, suggesting that responsible AI in specialized fields requires involving practitioners who understand both the technical and human stakes of the system's decisions.
-
Interpretable models can match complex ones in accuracy: The proposed model achieved a median NSE of 0.70 across 5,203 global basins while remaining interpretable, "significantly outperforming black-box baselines," demonstrating that transparency doesn't require sacrificing predictive performance in flood forecasting.
-
Human-understandable concepts can capture complex phenomena: By successfully reconstructing flood dynamics using interpretable concepts rather than opaque neural patterns, the work proves that environmental decision-making systems can be both accurate and trustworthy enough for public accountability.