ExplainabilityTransparencyAccountabilitycs.LG
Visualisation and knowledge discovery from interpretable models
Sreejita Ghosh, Peter Tino, Kerstin Bunte
May 7, 2020
IEEE International Joint Conference on Neural Network
14 citations
1 influential
Key Takeaways
-
Interpretable models can match performance of complex "black box" systems: The paper demonstrates that simpler, explainable machine learning models (angle-based Learning Vector Quantization variants) achieved performance comparable to more complex models on real-world datasets like the UCI heart disease dataset, suggesting organizations don't necessarily sacrifice accuracy when choosing interpretability.
-
Visual understanding of AI decisions is achievable: The developed models can visualize decision boundaries and classifier behavior, allowing non-experts to see how and why a model makes predictions—a critical capability for sectors affecting human lives where understanding decision-making is essential for accountability.
-
Handling real-world data challenges improves trustworthiness: The models were designed to handle missing values, a common problem in real datasets, demonstrating that interpretable AI systems can be practical for actual use cases rather than just theoretical exercises.
-
Interpretability enables deeper problem investigation: When applied to the heart disease dataset as a multiclass problem, the interpretable classifiers helped researchers investigate dataset complexities that might remain hidden in black-box models, potentially uncovering important medical insights.
-
Explainable AI is becoming essential as ML expands into high-stakes domains: The paper emphasizes that as machine learning increasingly influences human lives across sectors, understanding how these systems work and evaluating their fairness is no longer optional but "paramount."