ExplainabilityFairnessBiascs.CL
NoMatterXAI: Generating "No Matter What" Alterfactual Examples for Explaining Black-Box Text Classification Models
Tuc Nguyen, James Michels, Hua Shen, Thai Le
August 20, 2024
AAAI Conference on Artificial Intelligence
3 citations
Key Takeaways
-
Alterfactual explanations reveal hidden biases: Unlike traditional explanations that only show which features matter, this research introduces "alterfactual explanations" that test whether AI text classifiers are unfairly influenced by irrelevant attributes like gender, race, religion, or political affiliation—a critical gap for ensuring fair AI systems.
-
The method works by swapping sensitive attributes: NoMatterXAI generates explanations by replacing sensitive characteristics (e.g., changing "republicans" to "democrats") while keeping predictions the same, allowing users to verify whether the model's decision truly depends on these protected attributes or remains unbiased.
-
High accuracy with practical applicability: The algorithm achieves up to 95% fidelity while maintaining over 90% context similarity, meaning the generated explanations are both realistic and faithful to the original text—making them practically useful for auditing real-world AI systems.
-
Addresses a blind spot in current XAI methods: Most existing explainability tools focus only on important features that drive predictions, but ignore irrelevant features that shouldn't influence decisions; this work fills that gap by systematically examining what shouldn't matter to the model.
-
Enables proactive bias detection: Rather than waiting for complaints about biased outcomes, organizations can now use this method to proactively test their text classifiers for unwanted demographic or political biases before deployment.