SafetyTrustworthinessAccountabilitycs.AI
A Psychopathological Approach to Safety Engineering in AI and AGI
Vahid Behzadan, Arslan Munir, Roman V. Yampolskiy
May 23, 2018
SAFECOMP Workshops
17 citations
Key Takeaways
-
Traditional safety methods may be insufficient for advanced AI: The paper argues that as AI systems grow in complexity, traditional formal methods like controllability and reachability analysis become impractical, suggesting we need fundamentally different approaches to ensure AI safety rather than relying solely on mathematical verification.
-
AI misbehaviors can be understood through a psychological lens: Rather than treating problematic AI behaviors as purely technical glitches, the authors propose modeling them as "psychological disorders," which could enable new diagnostic and intervention strategies borrowed from clinical psychology and psychiatry.
-
AGI will inherit complexity challenges from current AI: The paper indicates that the safety challenges we're already facing with today's AI systems—stemming from their complexity as adaptive systems—will only intensify with AGI, making proactive new frameworks essential before AGI development advances further.
-
A three-part framework is needed for AI safety: The authors propose that addressing AI safety requires research in three areas: (1) modeling deleterious behaviors, (2) diagnosing when problems occur, and (3) treating or correcting identified issues—mirroring how we approach human psychological disorders.
-
Interdisciplinary approaches may be necessary: By drawing parallels between AI safety and psychopathology, the paper suggests that responsible AI development may benefit from insights outside traditional computer science and engineering, potentially including clinical and behavioral expertise.