ExplainabilityTrustworthinessSafetycs.AI
Adaptive XAI in High Stakes Environments: Modeling Swift Trust with Multimodal Feedback in Human AI Teams
Nishani Fernando, Bahareh Nakisa, Adnan Ahmad, Mohammad Naim Rastgoo
July 25, 2025
MAI-XAI@ECAI
6 citations
Key Takeaways
-
Swift trust requires adaptive explanations, not one-size-fits-all approaches: The paper argues that uniform AI explanations fail in high-stakes environments like emergency response. Instead, explanations should dynamically adjust based on each operator's real-time cognitive state—a shift from current XAI practice that could improve decision-making when seconds matter.
-
Monitoring physiological signals (EEG, heart rate, eye tracking) can detect when operators need different types of AI explanations: Rather than asking busy emergency responders to provide feedback, the framework proposes using implicit signals like brain activity and eye movements to infer whether someone is overwhelmed, stressed, or confused, then automatically adjust explanation complexity accordingly.
-
Trust in AI systems is measurable and dynamic, not static: The paper introduces a "personalized trust estimation model" that treats trust as something that fluctuates based on workload, stress, and emotion. This challenges the assumption that operators either trust an AI system or they don't, suggesting trust can be actively managed through responsive design.
-
Non-intrusive monitoring respects the time constraints of high-pressure work: By using passive physiological sensors rather than asking operators to rate explanations or provide feedback, the framework acknowledges that emergency responders cannot afford cognitive overhead—a practical consideration often overlooked in responsible AI design.
-
This framework is conceptual and requires real-world validation: The paper presents a theoretical model rather than tested results, meaning the actual effectiveness of adaptive XAI in emergency settings remains to be demonstrated before deployment.