Compress to Remember: Learning Compact Memory via On-Policy Distillation for Long Video Generation

Standard video generators do not natively compact historical context into reusable memory tokens. As generation continues, the growing history makes it increasingly difficult to retain information from earlier frames due to long-context degradation.