▶

Instrumental Convergence and AI's Basic Drives

Robert Miles AI Safety · Explainer · 11 min · 2018 · YouTube title: Why Would AI Want to do Bad Things? Instrumental Convergence
Why it's here

HN commenters repeatedly recommend it as the clearest introduction to why smart AI might behave badly by default.

What it covers

Robert Miles explains instrumental convergence: why an AGI with almost any goal would tend to pursue sub-goals like self-preservation and resource acquisition. It builds on Omohundro's basic AI drives and his orthogonality thesis video.