ExplainabilityTransparencyAccountabilitycs.AI
VitrAI -- Applying Explainable AI in the Real World
Marc Hanussek, Falko Kötter, Maximilien Kintz, Jens Drawehn
February 12, 2021
arXiv.org
3 citations
1 influential
Key Takeaways
-
XAI methods perform differently depending on context: The paper evaluates four different explainability algorithms across three real-world scenarios, finding that no single approach works equally well in all situations—suggesting organizations need to carefully match explanation methods to their specific use cases rather than adopting a one-size-fits-all approach.
-
Practical implementation of XAI faces real obstacles: Beyond theoretical development, the research identifies concrete challenges when deploying explainable AI in actual business and organizational settings, indicating that the gap between XAI research and real-world application is significant and requires attention.
-
Human comprehensibility varies across explanation types: The study evaluates how well different XAI methods communicate to actual people, revealing that technical explanation quality doesn't automatically translate to human understanding—a critical finding for organizations seeking to build trust with users and stakeholders.
-
Standardized evaluation frameworks are needed: By creating VitrAI as a uniform platform to demonstrate and compare XAI algorithms, the paper highlights the absence of consistent standards for assessing explanation quality, suggesting the field needs better benchmarks for responsible AI deployment.
Abstract
With recent progress in the field of Explainable Artificial Intelligence (XAI) and increasing use in practice, the need for an evaluation of different XAI methods and their explanation quality in practical usage scenarios arises. For this purpose, we present VitrAI, which is a web-based service with the goal of uniformly demonstrating four different XAI algorithms in the context of three real life scenarios and evaluating their performance and comprehensibility for humans. This work reveals practical obstacles when adopting XAI methods and gives qualitative estimates on how well different approaches perform in said scenarios.
Accepted for IntelliSys 2021
Paper Info
arXiv ID2102.06518
PublishedFebruary 12, 2021
Citations
3
Influential
1
Relevance75%
VenuearXiv.org
TypeJournalArticle
Categorycs.AI
Responsible AI Topics
ExplainabilityTransparencyAccountability
Links
Citation data from Semantic Scholar