ExplainabilityTransparencyAccountabilitycs.LG
xEEGNet: Towards Explainable AI in EEG Dementia Classification
Andrea Zanola, Louis Fabrice Tshimanga, Federico Del Pup, Marco Baiesi, Manfredo Atzori
April 30, 2025
Journal of Neural Engineering
14 citations
1 influential
Key Takeaways
-
Explainability doesn't require complexity: xEEGNet achieved comparable performance to standard models while using 200 times fewer parameters (168 vs. thousands), demonstrating that simpler, more interpretable AI systems can match the accuracy of "black box" approaches in medical applications.
-
Transparency enables clinical validation: By examining the learned patterns in the model, researchers could assess whether the AI was identifying medically relevant features rather than spurious correlations—a critical step for building trust in AI-assisted diagnosis of conditions like Alzheimer's and frontotemporal dementia.
-
Smaller models reduce overfitting risks: The dramatic parameter reduction in xEEGNet not only made the model interpretable but also reduced overfitting and variability across different data samples, suggesting that responsible AI design can improve both reliability and trustworthiness simultaneously.
-
Rigorous validation methods matter: The researchers used "Nested-Leave-N-Subjects-Out cross-validation" rather than standard testing approaches, providing more realistic performance estimates and preventing overoptimistic claims—a best practice for responsible AI development in healthcare.
-
Model behavior should be explainable through data: The team explained performance variations by analyzing how well the model's internal representations separated different patient groups, making the "why" behind predictions visible rather than hidden.
Abstract
This work presents xEEGNet, a novel, compact, and explainable neural network for EEG data analysis. It is fully interpretable and reduces overfitting through major parameter reduction. As an applicative use case, we focused on classifying common dementia conditions, Alzheimer's and frontotemporal dementia, versus controls. xEEGNet is broadly applicable to other neurological conditions involving spectral alterations. We initially used ShallowNet, a simple and popular model from the EEGNet-family. Its structure was analyzed and gradually modified to move from a "black box" to a more transparent model, without compromising performance. The learned kernels and weights were examined from a clinical standpoint to assess medical relevance. Model variants, including ShallowNet and the final xEEGNet, were evaluated using robust Nested-Leave-N-Subjects-Out cross-validation for unbiased performance estimates. Variability across data splits was explained using embedded EEG representations, grouped by class and set, with pairwise separability to quantify group distinction. Overfitting was assessed through training-validation loss correlation and training speed. xEEGNet uses only 168 parameters, 200 times fewer than ShallowNet, yet retains interpretability, resists overfitting, achieves comparable median performance (-1.5%), and reduces variability across splits. This variability is explained by embedded EEG representations: higher accuracy correlates with greater separation between test set controls and Alzheimer's cases, without significant influence from training data. xEEGNet's ability to filter specific EEG bands, learn band-specific topographies, and use relevant spectral features demonstrates its interpretability. While large deep learning models are often prioritized for performance, this study shows smaller architectures like xEEGNet can be equally effective in EEG pathology classification.
Paper Info
arXiv ID2504.21457
PublishedApril 30, 2025
Citations
14
Influential
1
Relevance82%
VenueJournal of Neural Engineering
TypeJournalArticle
Categorycs.LG
Responsible AI Topics
ExplainabilityTransparencyAccountability
Links
Citation data from Semantic Scholar