Behind Aggregate Scores: What Systematically Varying Arena-Hard's LLM Judge Reveals
LLM judges are used to determine which of two answers is better. Trusting these verdicts requires knowing how repeatable they are and how much they depend on the judge's instructions.
By Louise YorkearXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Oct 23, 2026.
Comments
Sign in to join the discussion.