ExplainabilityTransparencyAccountabilitycs.LG
Transparent Anomaly Detection via Concept-based Explanations
Laya Rafiee Sevyeri, Ivaxi Sheth, Farhood Farahnak, Samira Ebrahimi Kahou, Shirin Abbasinejad Enger
October 16, 2023
arXiv.org
6 citations
2 influential
Key Takeaways
-
Transparency in anomaly detection is now achievable without sacrificing accuracy: The paper demonstrates that ACE provides human-interpretable explanations for anomaly predictions while maintaining performance equal to or better than traditional "black-box" models that offer no explanations, suggesting that interpretability and accuracy are not inherently at odds.
-
Concept-based explanations make AI decisions understandable to humans: Rather than opaque numerical outputs, ACE explains why something is flagged as anomalous using human-interpretable concepts, which is particularly critical for safety-sensitive applications like medical imaging (histopathology slides) where stakeholders need to understand the reasoning behind alerts.
-
This approach enables meaningful human-AI collaboration: By providing clear concept-based reasoning, ACE allows domain experts to interact with and potentially correct the model's logic, rather than simply accepting or rejecting its predictions as a "black box"—an important step toward responsible AI deployment.
-
The method is practical and adaptable across different domains: The researchers validated ACE on three diverse real-world datasets (bird classification, medical imaging, and gender classification), and demonstrated the approach can be integrated with other existing anomaly detection methods, suggesting broad applicability.
-
This represents a shift toward "interpretable by design" in anomaly detection: The paper claims to be the first proposing anomaly detection systems built with interpretability as a core feature from the start, rather than adding explanations as an afterthought—a meaningful step forward for responsible AI in safety-critical applications.