ExplainabilityTrustworthinessSafetycs.RO
Incorporating Explanations into Human-Machine Interfaces for Trust and Situation Awareness in Autonomous Vehicles
Shahin Atakishiyev, Mohammad Salameh, Randy Goebel
April 10, 2024
2024 IEEE Intelligent Vehicles Symposium (IV)
16 citations
Key Takeaways
-
Transparency builds appropriate trust: The paper demonstrates that explaining autonomous vehicle decisions in real-time helps users develop calibrated trust—neither over-trusting nor under-trusting the system. This is critical because both excessive confidence and excessive skepticism can lead to unsafe outcomes on the road.
-
One-size-fits-all explanations don't work: Using a "3W1H" framework (what decisions are made, whom they affect, when they occur, and how they're made), the research shows that different road users need different types of explanations. Tailoring explanations to specific audiences and situations improves understanding and safety awareness.
-
Explanations enhance hazard awareness: Beyond building trust, the paper finds that user-friendly interfaces that convey upcoming hazards help both passengers and other road users better understand dangerous situations. This shared awareness can help prevent accidents by keeping humans informed and engaged.
-
Human-machine teaming requires good interface design: The research emphasizes that explainability alone isn't enough—how explanations are presented through the vehicle's interface matters significantly. Poorly designed interfaces can undermine the benefits of having explanations available.
-
User studies validate real-world impact: The paper's empirical validation through hypothesis testing with actual users demonstrates that these findings translate from theory to practice, suggesting that implementing explanation-based interfaces could meaningfully improve safety and user confidence in autonomous vehicles.