SafetyTrustworthinessAccountabilitycs.LG
An overview of 11 proposals for building safe advanced AI
Evan Hubinger
December 4, 2020
arXiv.org
28 citations
1 influential
Key Takeaways
-
No single proposal excels across all dimensions: The paper evaluates 11 safety proposals against four key criteria (outer alignment, inner alignment, training competitiveness, and performance competitiveness), finding that each approach has distinct strengths and weaknesses rather than one clear winner—suggesting the field may need to combine multiple approaches rather than rely on a single solution.
-
Inner alignment deserves equal attention to outer alignment: Historically, AI safety research has focused more on "outer alignment" (ensuring AI systems pursue the right goals), but this analysis emphasizes that "inner alignment" (ensuring the training process actually produces systems that follow intended goals) is equally critical and often overlooked in safety proposals.
-
There's a tradeoff between safety and practical performance: The distinction between "training competitiveness" (how efficiently a method trains AI systems) and "performance competitiveness" (how well the final system performs) reveals that some safety approaches may slow down AI development or reduce final capabilities—a practical constraint that safety researchers must address to gain adoption.
-
Major proposals like debate and iterated amplification have different risk profiles: By comparing leading approaches like AI safety via debate and iterated amplification across multiple dimensions, the paper helps stakeholders understand which safety methods might work best for different scenarios rather than assuming all proposals are equally viable.
-
Comprehensive evaluation frameworks are needed for responsible AI development: This comparative analysis demonstrates the value of systematically evaluating safety proposals across multiple components, suggesting that future AI development should employ similar multi-dimensional assessment tools rather than single-metric evaluations.