LLM As A Judge12 min read
LLM-as-a-Judge: Score AI Agent Outputs Automatically
An LLM judge is a second model that scores an agent's output against criteria you write in plain language. This guide explains where a judge fits beside deterministic tests and human review, then shows how to add one to an Ori Eval test, compare candidate models, calibrate the threshold against…
By OpenRouterOpenRouter Blog

Read the full story
Originally published by OpenRouter Blog on Sep 14, 2026.
Comments
Sign in to join the discussion.