A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models

An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not what the majority said but who is credible. Most ensemble methods assign each expert a fixed reputation, often learned from labels.