ExplainabilityTransparencyTrustworthinesscs.CL
Integration of Explainable AI Techniques with Large Language Models for Enhanced Interpretability for Sentiment Analysis
Thivya Thogesan, Anupiya Nugaliyadde, Kok Wai Wong
March 15, 2025
arXiv.org
9 citations
Key Takeaways
-
Breaking down AI "black boxes" helps us understand why systems make decisions: The research demonstrates that by examining different internal components of language models (embedding, encoder, decoder, and attention layers), researchers can trace exactly which parts of the model are responsible for sentiment predictions, moving beyond treating the model as an unexplainable whole.
-
Layer-by-layer analysis reveals how AI processes language differently at each stage: Different layers of the model focus on different aspects of sentiment—the study shows that examining these layers separately provides clearer insights than traditional explanation methods, helping stakeholders understand the complete decision-making process.
-
Explainability is essential for high-stakes applications: The paper emphasizes that in important real-world uses of sentiment analysis (such as healthcare, finance, or legal contexts), understanding why an AI system reached a conclusion is just as important as the conclusion itself, making interpretability a responsibility rather than an optional feature.
-
Current explanation methods have limitations that this approach addresses: The research shows that existing whole-model explainability techniques fall short compared to the proposed layer-wise approach, suggesting that responsible AI requires continuous improvement in how we make systems transparent and understandable.
-
Standardized testing validates improvements in interpretability: By evaluating the method on the Stanford Sentiment Treebank dataset, the researchers provide measurable evidence that their approach genuinely enhances our ability to understand AI decision-making, rather than simply claiming improvements.