BiasFairnessExplainabilityPrivacySecurityTransparencyTrustworthinesscs.CY
Trustworthy AI
Richa Singh, Mayank Vatsa, Nalini Ratha
November 2, 2020
COMAD/CODS
277 citations
12 influential
Key Takeaways
-
AI systems have significant blind spots that undermine trust: Modern AI exhibits brittleness to small input changes, lacks transparency about how decisions are made, and cannot reliably explain its reasoning—fundamental problems that affect whether users and the public should rely on these systems.
-
Bias in training data is a persistent problem requiring active solutions: The paper identifies bias as a prominent limitation of current AI systems, suggesting that without deliberate efforts to identify and address prejudices embedded in training data, AI systems will perpetuate unfair outcomes.
-
Explainability is essential but currently lacking: AI systems operate as "black boxes" with high opacity regarding their decision-making processes, training methods, and performance conditions—users cannot understand why an AI made a particular decision, which is critical for accountability in high-stakes applications.
-
Privacy, security, and data attribution deserve equal attention to accuracy: Trustworthy AI requires protecting the data used to build systems, properly crediting data sources, and ensuring security throughout the model-building process—not just optimizing for performance metrics.
-
A comprehensive framework addressing six interconnected issues is necessary: Rather than solving problems in isolation, trustworthy AI requires simultaneous attention to fairness, explainability, adversarial robustness, privacy/security, ethical outputs, and transparency about model lineage and data sources.