The Price of Token Boundaries: Compression Certificates and Prediction

Pre-tokenisation restricts which text fragments can become prediction units, but its compression cost is obscured when tokenisers are compared only under the same boundaries.