SafetySecurityEthicscs.CY
Current and Near-Term AI as a Potential Existential Risk Factor
Benjamin S. Bucknall, Shiri Dori-Hacohen
September 21, 2022
AAAI/ACM Conference on AI, Ethics, and Society
50 citations
1 influential
Key Takeaways
-
Current AI systems pose existential risks without waiting for AGI: The paper argues that already-existing AI technologies—not just hypothetical future artificial general intelligence—can contribute to existential risks by amplifying other known threats to humanity, establishing "causal pathways from AI systems to existential risks that do not presuppose hypothetical future AI capabilities."
-
AI can destabilize power dynamics in dangerous ways: The research identifies how AI affects power dynamics as a key mechanism through which existential risks emerge, suggesting that concentration of AI capabilities could shift geopolitical balance in ways that increase humanity's vulnerability to catastrophic outcomes.
-
Information security vulnerabilities created by AI are a critical concern: The paper highlights information security as a major causal pathway, indicating that AI systems can compromise our ability to protect critical information and infrastructure, potentially making humanity more susceptible to other existential threats.
-
Near-term AI developments (within the next decade) could significantly worsen these risks: Rather than being a distant concern, the paper warns that improvements to current AI over the coming years have the potential to substantially magnify existing risk factors, even without achieving artificial general intelligence.
-
Multiple documented AI effects already act as risk multipliers: The research points to "certain already-documented effects of AI" that can amplify previously identified existential risks, suggesting that responsible AI governance must address how current capabilities interact with and worsen other global threats.