ATI-OPD: Adaptive Teacher Intervention for Stable Long-Sequence On-Policy Distillation
On-policy distillation (OPD) trains a student on its own responses using token-level feedback from a teacher. As responses grow longer, the student's prefix can depart from the teacher's own reasoning, weakening its feedback on later tokens.
arXiv - cs.CL (NLP)2 min read