ExplainabilityTrustworthinessTransparencycs.HC
A Pilot Study on Clinician-AI Collaboration in Diagnosing Depression from Speech
Kexin Feng, Theodora Chaspari
October 23, 2024
2024 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI)
5 citations
Key Takeaways
-
More explanations increase trust but add complexity: The study found that providing detailed AI explanations enhanced clinicians' trust in the system, but simultaneously made it more difficult to use—suggesting a critical trade-off that designers must carefully balance when building AI tools for healthcare.
-
Clinicians lack familiarity with AI/ML systems: A key barrier to adoption is that clinicians have limited experience with machine learning tools, highlighting the need for user-friendly interfaces and intuitive visualizations rather than assuming medical professionals will naturally understand AI outputs.
-
Speech-based AI shows promise for depression screening: The system successfully detected depression through analysis of vowel patterns in speech and could potentially be integrated into existing diagnostic workflows, offering a non-invasive screening tool that complements traditional clinical methods.
-
Multiple levels of explanation matter: Providing explanations at different time scales (from individual utterances to groups of utterances) allows clinicians to understand AI decisions at varying levels of detail, though the study suggests this feature needs better design to avoid overwhelming users.
-
Real-world integration requires more than accuracy: Beyond technical performance, successful deployment of AI in clinical settings depends on addressing practical concerns like usability, visualization design, and clinician comfort with the technology—factors that go beyond the algorithm itself.