TransparencyTrustworthinessAccountabilitycs.AI
Bridging the Communication Gap: Evaluating AI Labeling Practices for Trustworthy AI Development
Raphael Fischer, Magdalena Wischnewski, Alexander van der Staay, Katharina Poitz, Christian Janiesch, Thomas Liebig
January 21, 2025
AAAI/ACM Conference on AI, Ethics, and Society
6 citations
Key Takeaways
-
AI labels show promise for bridging communication gaps: The study found "a broad range of practitioners" interested in AI labeling as a tool to help non-experts understand AI model properties, addressing a significant barrier to informed decision-making across developers, users, and stakeholders.
-
Simplicity improves comprehension but risks oversimplification: Compared to other reporting formats, interviewees "positively evaluated the reduced complexity of labels, increasing overall comprehensibility," yet the research identifies a fundamental trade-off between making information accessible and avoiding dangerous oversimplification of complex AI properties.
-
Credibility of the labeling authority is critical for trust: Trust in AI labels depends most on "usability and the credibility of the responsible labeling authority," with practitioners showing "mixed preferences for self-certification versus third-party certification"—suggesting that who creates and verifies labels matters as much as the labels themselves.
-
One-size-fits-all labels won't work: The research found diverse user needs among practitioners, leading to a key recommendation that "customizable and interactive labeling frameworks" could better serve different audiences rather than static, uniform labels.
-
Practical limitations remain underexplored in current proposals: While AI labeling frameworks (inspired by models like EU energy labels) have been theoretically proposed, this study reveals that "practical benefits and limitations of AI labeling remain underexplored," indicating a gap between concept and real-world implementation.