ExplainabilityTransparencyTrustworthinesscs.HC
Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisition
Catalina Gomez, Lalithkumar Seenivasan, Xinrui Zou, Jeewoo Yoon, Sirui Chu, Ariel Leong, Patrick Kramer, Yu-Chun Ku, Jose L. Porras, Alejandro Martin-Gomez, Masaru Ishii, Mathias Unberath
August 4, 2025
HAIC@MICCAI
4 citations
1 influential
Key Takeaways
-
AI can provide objective, consistent feedback at scale: The study demonstrates that explainable AI systems can analyze surgical videos to assess skill performance and generate personalized feedback, addressing a critical bottleneck where expert instructors have limited availability to provide individualized guidance to trainees.
-
Explainability matters for learner confidence: By highlighting specific deviations from expert performance through understandable visual proxies rather than black-box AI scores, the XAI-guided feedback improved trainees' confidence and reduced cognitive load compared to traditional video coaching, suggesting that transparency in AI recommendations helps learners trust and effectively use the system.
-
AI feedback shows promise but isn't a complete replacement: While the intervention improved cognitive load and confidence, the study found "no differences emerged between the two feedback types in reducing performance gaps," indicating that AI-assisted feedback complements rather than fully replaces traditional expert coaching for actual skill improvement.
-
Responsible AI deployment requires human-centered design: The research emphasizes that effective AI systems for high-stakes domains like surgery must be designed with user needs in mind—comparing performance to expert benchmarks, providing actionable guidance, and measuring outcomes like cognitive load and learner perception, not just technical accuracy.
-
Simulation-based training enables safe AI validation: By testing the AI system in controlled surgical simulations with medical students before potential clinical deployment, the researchers followed responsible AI practices of validating system effectiveness in lower-risk settings first.