ExplainabilityTransparencyAccountabilitycs.CL
A Survey of the State of Explainable AI for Natural Language Processing
Marina Danilevsky, Kun Qian, Ranit Aharonov, Yannis Katsis, Ban Kawas, Prithviraj Sen
October 1, 2020
AACL
492 citations
23 influential
Key Takeaways
Key Takeaways on Explainable AI for NLP
-
The interpretability-performance tradeoff is real: Recent advances in NLP model quality have made these systems more powerful but simultaneously less interpretable, creating a tension between building better-performing models and understanding how they work—a critical issue for responsible deployment.
-
Multiple explanation approaches exist but lack standardization: The survey identifies various categorizations and techniques for generating explanations in NLP systems, but the diversity of approaches suggests the field has not yet converged on standard methods, making it difficult for practitioners to choose appropriate explainability tools.
-
Visualization and communication of explanations matters: The survey emphasizes that how explanations are presented and visualized is as important as the explanations themselves, indicating that responsible AI requires not just technical explainability but also clear communication to stakeholders and end-users.
-
Significant gaps remain in XAI for NLP: The authors identify current limitations and gaps in explainability techniques, suggesting that existing tools may be insufficient for fully understanding why NLP models make specific predictions—an important consideration for high-stakes applications like hiring, lending, or content moderation.
-
Developer resources are needed to advance responsible practices: By positioning the survey as "a resource for model developers," the authors highlight that closing the explainability gap requires practical guidance and tools accessible to practitioners, not just theoretical research.