EthicsTrustworthinessSafetycs.AI
A blindspot of AI ethics: anti-fragility in statistical prediction
Michele Loi, Lonneke van der Plas
June 21, 2020
arXiv.org
2 citations
Key Takeaways
-
AI systems optimized purely for accuracy may reduce societal resilience: The paper argues that current AI systems focused on minimizing errors and short-term objectives can inadvertently eliminate the diversity and flexibility that societies need to adapt to unexpected challenges—a concept the authors frame as losing "anti-fragility."
-
Trustworthiness alone is insufficient for responsible AI: While AI ethics discussions typically emphasize building trustworthy and unbiased systems, this paper identifies a counterintuitive blind spot: highly optimized, reliable AI systems may actually pose risks by making society less adaptable and more brittle.
-
Homogenization through AI decision-making threatens progress: The authors warn that widespread reliance on dominant AI systems driven by similar objectives could lead to societal homogenization, potentially stifling the diversity of approaches and perspectives needed for genuine innovation and social progress.
-
Current AI optimization methods may create hidden vulnerabilities: By focusing narrowly on avoiding prediction errors, AI systems may inadvertently remove the "slack" and redundancy that help societies absorb shocks and recover from disruptions—making systems appear efficient but actually fragile.
-
AI ethics needs to expand beyond bias and trustworthiness: The paper calls for the responsible AI community to add anti-fragility and systemic resilience to its agenda, suggesting that ethical AI development requires considering not just individual fairness and accuracy, but broader societal adaptability.