CarrotParsnipBench: A Lightweight Multi-Agent Deception and Detection Eval
TL:DR Earlier this year I introduced the very simple Social Deduction game of Carrot-Parsnip and showed that most models are better-than-random at identifying Parsnips (the hidden, deceptive role) and that being a strong Parsnip (skilled at strategic deception) does not perfectly correlate with…
LessWrong17 min read