ExplainabilityTransparencyAccountabilitycs.HC
DASS Good: Explainable Data Mining of Spatial Cohort Data
Andrew Wentzel, Carla Floricel, Guadalupe Canahuate, Mohamed A. Naser, Abdallah S. Mohamed, Clifton David Fuller, Lisanne van Dijk, G. Elisabeta Marai
April 10, 2023
Computer graphics forum (Print)
13 citations
Key Takeaways
-
Human expertise remains essential in clinical AI: The paper demonstrates that effective medical machine learning requires close collaboration between data scientists and domain experts (oncologists), rather than fully automated model development. The researchers used "human-in-the-loop visual steering," meaning clinicians actively guided the model development process rather than passively receiving results.
-
Explainability is critical for clinical adoption: DASS incorporated explainable AI methods specifically because clinicians need to understand why a model makes predictions about patient toxicity risks. Without transparency into model reasoning, doctors cannot trust or safely implement AI recommendations in patient care decisions.
-
Spatial context matters for medical data: The paper highlights a specific challenge in healthcare AI—radiation dose distributions affect multiple organs differently depending on their location and proximity. Standard machine learning approaches often miss these spatial relationships, so specialized systems are needed to handle complex medical data accurately.
-
Visual tools help bridge human and machine intelligence: The system used interactive visualization to help clinicians steer model development, suggesting that effective clinical AI requires thoughtful interface design. This collaborative approach produced two practical stratification models that domain experts validated as useful for real clinical work.
-
Design lessons from real-world collaboration are valuable: By documenting their co-design experience, the authors provide guidance for other teams building clinical AI systems, emphasizing that responsible AI development in healthcare requires iterative collaboration and attention to how systems will actually be used by medical professionals.