My arithmetic grader reads the first number in the sentence, not the answer

Originally published at erikhill.dev. The numbers below are checked against the repository they come from. My arithmetic grader reads the first number in the sentence, not the answer This is a finding about my own harness. No model got the arithmetic wrong.