ExplainabilitySafetyEthicscs.CL
Detecting Suicidal Ideation in Text with Interpretable Deep Learning: A CNN-BiGRU with Attention Mechanism
Mohaiminul Islam Bhuiyan, Nur Shazwani Kamarudin, Nur Hafieza Ismail
November 10, 2025
International Conference on Software Engineering and Computer Systems
1 citations
Key Takeaways
-
Early intervention potential: The model achieved 93.97% accuracy in detecting suicidal ideation from social media text, suggesting AI systems could help identify at-risk individuals who openly express concerning thoughts online—potentially enabling timely mental health interventions for adolescents, a particularly vulnerable population.
-
Interpretability is essential for trust: The researchers used SHAP (SHapley Additive exPlanations) to explain which specific words and patterns the AI flagged as indicators of suicidal ideation. This transparency is critical for responsible deployment, as mental health professionals need to understand why the system made a prediction before acting on it.
-
Addressing suppressed vs. expressed ideation: The paper acknowledges that while some people hide suicidal thoughts, many signal their intentions on social media. This distinction matters for responsible AI use—the system targets a specific, detectable population rather than claiming to identify all at-risk individuals.
-
Validation against existing methods matters: The authors compared their approach against other machine learning and deep learning models, demonstrating superiority over competing techniques. This comparative rigor is important for responsible AI development, ensuring new systems represent genuine improvements rather than incremental changes.
-
Dataset limitations not fully addressed: While the paper mentions using "a publicly available dataset," it doesn't discuss potential biases in that data, demographic representation, or how performance might vary across different populations—gaps that could affect equitable real-world deployment in suicide prevention.