ExplainabilityTrustworthinessEthicscs.HC
Trustworthy AI Psychotherapy: Multi-Agent LLM Workflow for Counseling and Explainable Mental Disorder Diagnosis
Mithat Can Ozgun, Jiahuan Pei, Koen Hindriks, Lucia Donatelli, Qingzhi Liu, Junxiao Wang
August 15, 2025
International Conference on Information and Knowledge Management
18 citations
1 influential
Key Takeaways
-
LLMs currently underperform in mental health diagnosis compared to general tasks, highlighting that specialized domains like mental health require tailored approaches rather than generic AI solutions.
-
The framework addresses a critical privacy concern: by generating synthetic therapist-client dialogues rather than relying on scarce, sensitive real patient data, DSM5AgentFlow reduces dependence on difficult-to-obtain mental health datasets while maintaining diagnostic capability.
-
Explainability is built into the diagnostic process: the system provides "transparent, step-by-step disorder predictions" rather than black-box outputs, allowing clinicians and patients to understand the reasoning behind AI-generated assessments—a key requirement for responsible AI in healthcare.
-
The tool is explicitly positioned as complementary, not replacement: the paper emphasizes this workflow "serves as a complementary tool for mental health diagnosis" and ensures "adherence to ethical and legal standards," acknowledging that AI should support rather than substitute human clinical judgment.
-
Open-sourcing enables accountability: by making datasets and implementations publicly available, the researchers facilitate independent evaluation and scrutiny of the system's performance across conversational realism, diagnostic accuracy, and explainability—supporting transparency in responsible AI development.