ExplainabilityTransparencyTrustworthinesscs.RO
Human-AI Interaction in Industrial Robotics: Design and Empirical Evaluation of a User Interface for Explainable AI-Based Robot Program Optimization
Benjamin Alt, Johannes Zahn, Claudius Kienle, Julia Dvorak, Marvin May, Darko Katic, Rainer Jäkel, Tobias Kopp, Michael Beetz, Gisela Lanza
April 30, 2024
Procedia CIRP
12 citations
1 influential
Key Takeaways
-
Explainable AI interfaces can be tailored to different user expertise levels: The paper demonstrates that the same AI system can be made accessible to both novice and expert users through adaptive user interface design, suggesting that XAI doesn't require a one-size-fits-all approach to explanation.
-
Deep learning adoption in manufacturing has been limited despite its potential: The authors identify a significant gap between the demonstrated capabilities of deep learning and its actual use in real-world industrial settings, indicating that technical capability alone is insufficient for responsible AI deployment.
-
User satisfaction and cognitive load matter for AI system adoption: The research evaluates not just whether users can complete tasks, but also their satisfaction levels and mental effort required, recognizing that sustainable AI implementation depends on the user experience, not just functionality.
-
Explainability features are essential for real-world AI applications: The paper emphasizes that providing explanations for AI-driven recommendations (in this case, robot program optimization) is necessary to facilitate trust and appropriate use of AI systems in manufacturing environments.
-
Empirical evaluation of AI interfaces is still in early stages: The authors present preliminary survey results and propose a larger follow-up study, suggesting that rigorous, evidence-based research on how to design responsible AI systems for industrial use is still developing.