ExplainabilityBiasTrustworthinessphysics.ao-ph
Transferability and explainability of deep learning emulators for regional climate model projections: Perspectives for future applications
Jorge Bano-Medina, Maialen Iturbide, Jesus Fernandez, Jose Manuel Gutierrez
November 1, 2023
Artificial Intelligence for the Earth Systems
35 citations
2 influential
Key Takeaways
-
Deep learning can reduce climate modeling costs but requires careful validation: The study found that AI-based emulators of regional climate models can replicate certain climate properties across different time periods and scenarios, offering a potentially cost-effective alternative to running expensive computational simulations repeatedly.
-
Not all AI approaches are equally trustworthy for climate science: The research compared two emulation methods (PP and MOS) and found significant differences in their reliability. The PP approach learned "robust and physically meaningful patterns," while the MOS approach produced results that were "GCM-dependent and lack physical consistency in some cases"—highlighting that the choice of AI method matters substantially.
-
Explainability tools are essential for validating climate AI models: The authors used explainable AI (XAI) methods to examine whether the patterns learned by deep learning models matched real physical climate processes, not just statistical correlations. This approach revealed that some models produced outputs that couldn't be justified by actual climate physics.
-
AI transferability in climate modeling remains limited: While the emulators showed "soft transferability" to new time periods and scenarios, the paper indicates both approaches "face problems" in certain transfer situations, suggesting these tools cannot yet be reliably applied to all future climate prediction scenarios without additional validation.
-
Bias in training data affects AI reliability: The study emphasizes that "inherent biases of both GCMs and RCMs play a significant role" in emulator performance, meaning AI models trained on imperfect climate simulations may perpetuate or amplify those errors.