A general recipe for data-adaptive anytime-valid envelopes for iterative algorithms

Most convergence guarantees for iterative stochastic algorithms are stated at a fixed iteration count and do not justify stopping at a data-dependent time.