Even (very) noisy LLM evaluators are useful for improving AI agents

Noisy evaluators have limited value for production decisions that hinge on judging a single output (e.g. guardrails).