ExplainabilityTransparencyTrustworthinesscs.AI
Towards an Evaluation Framework for Explainable Artificial Intelligence Systems for Health and Well-being
Esperança Amengual-Alcover, Antoni Jaume-i-Capó, Miquel Miró-Nicolau, Gabriel Moyà-Alcover, Antonia Paniza-Fullana
April 11, 2025
International Conference on Evaluation of Novel Approaches to Software Engineering
3 citations
Key Takeaways
-
Explainability is critical in healthcare AI: The paper emphasizes that transparency in AI decision-making is especially vital in health and well-being contexts, where healthcare professionals need to understand and trust automated decisions before relying on them in clinical practice.
-
A practical evaluation framework is needed: The authors developed a structured evaluation framework to guide developers in creating explainable AI systems, addressing a gap in tools available for building trustworthy AI in high-stakes domains like healthcare.
-
The framework has broader applications beyond healthcare: While focused on health and well-being, the authors note their framework can serve as a valuable tool "for any AI system that has a significant impact on individuals," suggesting explainability principles are important across multiple sectors affecting people's lives.
-
Real-world validation matters: The paper includes a case study demonstrating how the framework works in practice, suggesting that evaluation frameworks for explainable AI should be tested and refined through actual implementation rather than remaining theoretical.
Abstract
The integration of Artificial Intelligence in the development of computer systems presents a new challenge: make intelligent systems explainable to humans. This is especially vital in the field of health and well-being, where transparency in decision support systems enables healthcare professionals to understand and trust automated decisions and predictions. To address this need, tools are required to guide the development of explainable AI systems. In this paper, we introduce an evaluation framework designed to support the development of explainable AI systems for health and well-being. Additionally, we present a case study that illustrates the application of the framework in practice. We believe that our framework can serve as a valuable tool not only for developing explainable AI systems in healthcare but also for any AI system that has a significant impact on individuals.
Paper Info
arXiv ID2504.08552
PublishedApril 11, 2025
Citations
3
Relevance90%
VenueInternational Conference on Evaluation of Novel Approaches to Software Engineering
TypeJournalArticle
Categorycs.AI
Responsible AI Topics
ExplainabilityTransparencyTrustworthiness
Links
Citation data from Semantic Scholar