Researchers Demonstrate Inner Misalignment in AI Systems

Pointed to as evidence that AI misalignment is an empirically demonstrated problem, for people who dismiss it.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.