Replay in the Silent Degrees of Freedom: Continual Learning Without an Offline Phase

Replay-based continual learning almost always consolidates in a dedicated offline phase or by interleaving replayed samples with the input stream, whereas brains also consolidate during wakefulness through local sleep, brief use-dependent off-periods of individual circuits.