ExplainabilityTransparencyAccountabilitycs.LG
Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing
Adrian Höhl, Ivica Obadic, Miguel Ángel Fernández Torres, Hiba Najjar, Dario Oliveira, Zeynep Akata, Andreas Dengel, Xiao Xiang Zhu
February 21, 2024
Key Takeaways
-
Black-box AI models dominate remote sensing but lack transparency: Machine learning approaches have become the primary method for analyzing satellite and aerial imagery, yet these models often function as "black boxes" where their decision-making processes remain unclear—a significant gap the paper addresses through systematic review of explainable AI solutions.
-
Explainable AI reveals how models make critical decisions about Earth observation: The paper identifies that explainable AI methods help uncover which features in satellite images (such as specific land characteristics or environmental indicators) drive model predictions, enabling scientists and policymakers to understand and trust AI-based environmental monitoring and land-use classification systems.
-
Multiple explanation approaches exist but lack standardized evaluation: The review reveals that various explainable AI techniques are being applied to remote sensing, but there is no consistent framework for evaluating whether these explanations are actually accurate or useful—a critical challenge for responsible deployment in real-world applications.
-
Scientific insights improve when AI decisions are transparent: By examining extracted insights from explainable AI studies, the paper demonstrates that understanding why models make predictions leads to better scientific understanding of remote sensing data and more reliable conclusions for applications like climate monitoring and disaster response.
-
The field needs clearer standards for responsible AI development: The paper highlights emerging research directions and methodological challenges, suggesting that the remote sensing community must establish better practices for evaluating and validating explainable AI to ensure these systems can be responsibly deployed in high-stakes environmental and societal applications.
Abstract
In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in remote sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI, a comprehensive overview summarizing the explainable AI methods used and their objectives, findings, and challenges in remote sensing applications is still missing. In this paper, we address this gap by performing a systematic review to identify the key trends in the field and shed light on novel explainable AI approaches and emerging directions that tackle specific remote sensing challenges. We also reveal the common patterns of explanation interpretation, discuss the extracted scientific insights, and reflect on the approaches used for the evaluation of explainable AI methods. As such, our review provides a complete summary of the state-of-the-art of explainable AI in remote sensing. Further, we give a detailed outlook on the challenges and promising research directions, representing a basis for novel methodological development and a useful starting point for new researchers in the field.
Paper Info
arXiv ID2402.13791
PublishedFebruary 21, 2024
RevisedNovember 6, 2024
Citations
0
Relevance82%
Categorycs.LG
Responsible AI Topics
ExplainabilityTransparencyAccountability
Links
Citation data from Semantic Scholar