TransparencySafetyTrustworthinesscs.HC
AI-Resilient Interfaces
Elena L. Glassman, Ziwei Gu, Jonathan K. Kummerfeld
May 14, 2024
arXiv.org
2 citations
Key Takeaways
-
Users often fail to notice AI errors because systems are designed for efficiency rather than visibility. The paper highlights that when AI systems generate summaries or filtered outputs, users may not catch critical omissions—especially when the original information is lengthy or when the summary itself discourages careful review of the source material.
-
Current AI interaction guidelines prioritize quick recovery from errors, but this misses the fundamental problem: users must notice the error first. The paper argues that existing recommendations for "efficient dismissal or modification" of AI choices are insufficient if users don't recognize something went wrong in the first place.
-
AI-resilient interfaces need to provide context and information that helps users make sound judgments about AI outputs. Rather than just making it easy to reject AI suggestions, interfaces should equip users with enough background information to understand why an AI choice might be wrong or inappropriate for their specific situation.
-
Designing for AI-resilience improves safety, usability, and utility simultaneously. The paper suggests that interfaces helping users better notice and evaluate AI decisions aren't just about catching errors—they make AI systems more trustworthy and effective overall, particularly in high-stakes contexts where AI mistakes carry real consequences.