How I cut LLM batch costs with time-of-use scheduling

Every batch job I run against LLM APIs used to cost the same at 2 a.m. as at 2 p.m. Then I started routing workloads through a unified gateway that charges different rates at different hours, and my overnight evaluation runs dropped to half the token cost — without touching a single prompt.