I Tried to Measure That One Weird Failure Mode in [LLMs / Agents]

The failure mode I couldn't stop thinking about Every time I use [a model / an agent] for [multi-step reasoning / code generation / tool use], I notice the same thing: [describe the failure in one or two sentences, e.g. "it confidently skips a step and the final answer looks right but isn't"].