ExplainabilityTransparencyTrustworthinesscs.LG
From Black Box to Insight: Explainable AI for Extreme Event Preparedness
Kiana Vu, İsmet Selçuk Özer, Phung Lai, Zheng Wu, Thilanka Munasinghe, Jennifer Wei
November 17, 2025
BigData Congress [Services Society]
4 citations
Key Takeaways
-
AI models alone aren't enough for emergency response: While AI can accurately predict extreme events like wildfires, decision-makers hesitate to use these predictions because they don't understand how the models reach their conclusions. The paper demonstrates that making AI "explainable"—showing why a model makes a prediction—is essential for building trust with emergency responders and policymakers who must act on these forecasts.
-
Explainability reveals hidden biases and problems: By using SHAP analysis to examine wildfire prediction models, the researchers uncovered key features driving predictions and identified potential biases in model behavior. This means that explaining AI doesn't just help users understand decisions—it helps developers catch and fix problems that could lead to unfair or inaccurate predictions in real-world deployment.
-
Visual explanations make AI practical for non-technical users: The paper emphasizes that technical explanations alone aren't sufficient; presenting feature importance and temporal patterns through clear visualizations makes AI insights accessible to emergency managers and policymakers who need to make rapid decisions during crises. This bridges the gap between what data scientists understand and what practitioners can actually use.
-
Explainable AI is critical infrastructure for climate adaptation: As extreme events become more frequent due to climate change, the paper argues that trustworthy, interpretable AI systems are not optional—they're essential tools for disaster preparedness and climate resilience planning. Organizations cannot effectively prepare for and respond to crises using AI systems they don't understand or trust.