ExplainabilitySafetyTransparencycs.CV
Explainability of deep vision-based autonomous driving systems: Review and challenges
Éloi Zablocki, Hédi Ben-Younes, Patrick Pérez, Matthieu Cord
January 13, 2021
International Journal of Computer Vision
248 citations
7 influential
Key Takeaways
Key Takeaways on Explainability in Autonomous Driving
-
Explainability is critical for safety: The paper emphasizes that self-driving systems are "safety-critical applications," making it essential to understand why these systems make driving decisions rather than simply accepting their outputs as black boxes.
-
Two main approaches exist: The survey identifies both "post-hoc" methods (explaining decisions after the system makes them) and "interpretable by design" approaches (building transparency into systems from the start), suggesting there's no single solution to the explainability challenge.
-
Current systems lack transparency: Vision-based autonomous vehicles trained with behavior cloning—a common approach where AI learns by mimicking human drivers—are described as "black-box" systems, meaning their decision-making processes are largely opaque even to their creators.
-
Multiple fields must collaborate: The paper draws from computer vision, deep learning, autonomous driving, and explainable AI, indicating that solving explainability requires expertise across disciplines rather than isolated technical fixes.
-
Significant challenges remain unsolved: The survey identifies "open challenges" and calls for "future research directions," suggesting that despite existing methods, we still lack fully satisfactory ways to explain how self-driving systems perceive and respond to road conditions.