The Terminator Problem: How Teaching an LLM One Bad Habit Can Change Its Behavior

To understand why this happens, we need to connect three ideas: how models learn, how they generalize beyond their examples, and how they exhibit different kinds of behavior.