Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement

LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates.