BiasFairnessAccountabilitycs.LG
Promises and pitfalls of deep neural networks in neuroimaging-based psychiatric research
Fabian Eitel, Marc-André Schulz, Moritz Seiler, Henrik Walter, Kerstin Ritter
January 20, 2023
Experimental Neurology
60 citations
Key Takeaways
Key Takeaways on Deep Neural Networks in Psychiatric Neuroimaging
-
Small and biased datasets are a major obstacle: The paper identifies that psychiatric neuroimaging datasets are typically small, heterogeneous, and biased, making it difficult to train reliable deep learning models—a fundamental challenge that limits the real-world applicability of these tools in clinical settings.
-
Clinical labels themselves may be unreliable: A critical finding is that psychiatric diagnoses used to train these models lack sufficient validity, meaning the AI systems may be learning from imprecise or inconsistent diagnostic categories, potentially perpetuating diagnostic errors rather than improving them.
-
Algorithmic bias poses a significant risk: The paper explicitly flags algorithmic bias as a current challenge, suggesting that deep learning models in psychiatric neuroimaging may produce unfair or inaccurate results for certain populations, which could worsen health disparities.
-
Confounding variables can mislead models: The influence of confounding variables (such as medication use, socioeconomic factors, or scanner differences) can cause models to learn spurious patterns rather than genuine psychiatric markers, leading to false confidence in unreliable predictions.
-
Promises must be tempered with caution: While deep neural networks offer potential benefits like more accurate diagnostics and personalized treatment recommendations, the paper's focus on "pitfalls" suggests these tools are not yet ready for widespread clinical deployment without addressing fundamental methodological and ethical concerns.