ExplainabilityTransparencyTrustworthinesscs.AI
Explainable AI-Based Interface System for Weather Forecasting Model
Soyeon Kim, Junho Choi, Yeji Choi, Subeen Lee, Artyom Stitsyuk, Minkyoung Park, Seongyeop Jeong, Youhyun Baek, Jaesik Choi
April 1, 2025
Interacción
12 citations
Key Takeaways
-
Users need three specific types of explanations for weather forecasting AI: statistical performance across different rainfall scenarios (to spot model bias), reasoning for predictions, and confidence levels—suggesting that responsible AI deployment requires understanding what information decision-makers actually need, not just providing explanations.
-
Intuitive explanations outperform technical XAI algorithms: The study found that users preferred straightforward, easy-to-understand explanations over those based on formal explainable AI methods, even for simple cases, indicating that technical sophistication in explanations doesn't necessarily serve end-users better.
-
Proper explanations increase both trust and decision utility: When weather forecasting models included appropriate explanations through a user-centered interface, both user trust in the system and the practical usefulness of decisions improved, demonstrating that transparency directly impacts how AI systems perform in real-world applications.
-
User-centered design is missing from XAI research in meteorology: The authors note that while explainable AI literature is growing, few studies actually involve the people who will use these systems, suggesting a gap between AI research and practical deployment that responsible AI development should address.