PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
On-policy self-distillation (OPSD) uses a self-teacher conditioned on privileged information to turn the sparse outcome signal of reinforcement learning with verifiable rewards (RLVR) into dense token-level supervision.
arXiv cs.LG2 min read