ExplainabilityTransparencyTrustworthinesscs.AI
Learning by Self-Explaining
Wolfgang Stammer, Felix Friedrich, David Steinmann, Manuel Brack, Hikaru Shindo, Kristian Kersting
September 15, 2023
Trans. Mach. Learn. Res.
20 citations
1 influential
Key Takeaways
-
Self-explanations improve model generalization: The paper demonstrates that when AI models are trained to explain their reasoning during learning, they generalize better to new data—suggesting that the process of generating explanations helps models learn more robust patterns rather than memorizing dataset-specific quirks.
-
Self-explaining reduces reliance on confounding factors: By optimizing models based on whether their explanations are useful to an internal critic, LSX reduces the influence of irrelevant or misleading patterns in data, meaning models become less likely to make decisions based on spurious correlations rather than genuine task-relevant features.
-
Explanations become more faithful and task-relevant: The paper shows that explanations generated through self-explaining are more aligned with what actually matters for the task, rather than post-hoc explanations that may rationalize decisions without reflecting true model reasoning—an important distinction for trustworthiness.
-
Explanations serve a dual purpose in model development: Rather than treating explanations only as tools for inspecting already-trained models, this work shows they can actively improve the learning process itself, drawing on psychological research about how self-explanation benefits human learning and applying it to AI systems.
-
The approach is practical across different implementations: The authors demonstrate the method works across multiple different instantiations of their framework, suggesting the core principle of learning through self-explanation has broad applicability rather than being limited to one specific technical approach.