ExplainabilityTransparencyTrustworthinesscs.AI
Iterative Planning with Plan-Space Explanations: A Tool and User Study
Rebecca Eifler, Jörg Hoffmann
November 19, 2020
arXiv.org
2 citations
1 influential
Key Takeaways
-
Iterative refinement helps bridge the AI preference gap: The paper addresses a practical challenge in responsible AI—that users often struggle to clearly specify what they want from an AI system upfront. By allowing users to iteratively modify and refine plans rather than getting a single "final" recommendation, the system enables better alignment between user preferences and AI outputs.
-
Explanations about alternatives matter more than just explaining chosen plans: The research focuses specifically on answering "Why doesn't the plan satisfy property X?" rather than simply explaining why a plan was chosen. This plan-space explanation approach helps users understand not just what the AI recommends, but why other options don't work—a key insight for building user trust and understanding in AI systems.
-
User study validates the practical value of explanations: The authors conducted a user study that "indicates the usefulness of plan-property dependency explanations in iterative planning," suggesting that providing these types of explanations actually helps users work more effectively with AI planning systems, rather than just being a theoretical improvement.
-
Accessible implementation supports responsible AI adoption: By creating a tool that "runs in standard Web browsers" with "simple user interfaces for both developers and users," the authors demonstrate that human-centered AI design doesn't require specialized expertise to deploy, potentially making responsible AI practices more widely adoptable.