TrustworthinessTransparencyAccountabilitycs.CY
Know Your Model (KYM): Increasing Trust in AI and Machine Learning
Mary Roszel, Robert Norvill, Jean Hilger, Radu State
May 31, 2021
arXiv.org
9 citations
Key Takeaways
-
Trustworthiness requires systematic evaluation: The paper identifies specific elements of trustworthiness that need to be analyzed and measured, rather than assumed, suggesting that organizations must actively assess AI systems rather than relying on intuition about their reliability.
-
A comprehensive framework of 20 guidelines exists: The authors provide an implementation-agnostic set of 20 guidelines applicable across sectors and AI types, offering practical, sector-independent standards that organizations can use to build and evaluate trustworthy AI systems.
-
Prediction errors have real-world consequences: The paper emphasizes that AI mistakes aren't merely technical failures but can significantly impact society, underscoring why trustworthiness matters beyond performance metrics and extends to ethical and practical considerations for affected communities.
-
Trustworthiness must be demonstrable, not just claimed: The guidelines are designed to make trustworthiness provable and transparent, meaning organizations should be able to show evidence of trustworthiness rather than simply asserting that their systems are reliable.
-
Trust in AI requires multi-dimensional accountability: By addressing ethical, technical, and practical impacts simultaneously, the paper suggests that responsible AI cannot focus on any single dimension alone—organizations must balance performance, ethics, and real-world applicability to build systems society can genuinely rely on.
Abstract
The widespread utilization of AI systems has drawn attention to the potential impacts of such systems on society. Of particular concern are the consequences that prediction errors may have on real-world scenarios, and the trust humanity places in AI systems. It is necessary to understand how we can evaluate trustworthiness in AI and how individuals and entities alike can develop trustworthy AI systems. In this paper, we analyze each element of trustworthiness and provide a set of 20 guidelines that can be leveraged to ensure optimal AI functionality while taking into account the greater ethical, technical, and practical impacts to humanity. Moreover, the guidelines help ensure that trustworthiness is provable and can be demonstrated, they are implementation agnostic, and they can be applied to any AI system in any sector.
10 pages
Paper Info
arXiv ID2106.11036
PublishedMay 31, 2021
Citations
9
Relevance90%
VenuearXiv.org
TypeJournalArticle
Categorycs.CY
Responsible AI Topics
TrustworthinessTransparencyAccountability
Links
Citation data from Semantic Scholar