Multi-Agent Systems6 min read
Three incidents in 141,006 runs: why sampling misses them
Anthropic found 3 incidents in 141,006 eval runs. A 5% sample expects 0.15 hits. The math shows why sampling concludes "all clear" when it shouldn't.
By Matt DoughtyPrefactor Blog

Read the full story
Originally published by Prefactor Blog on Oct 3, 2026.
Comments
Sign in to join the discussion.