Know a great AI tool or AI news source? Submit it to AiByts
MOPD2 min read

P$^2$-MOPD: Accelerating Multi-Teacher On-Policy Distillation via Parameter Priors

Multi-teacher on-policy distillation consolidates expert capabilities by supervising student-generated trajectories, whereas task arithmetic offers a training-free alternative through linear parameter combinations.

By Sinuo Wang, Jiacheng Lu, Zeyu Zhang, Maojia Song, Rui Sun, Beidi Luan, Yutong Xie, Jing Li, Daxin Jiang, Qi Wu, Zuo BaiarXiv cs.LG

Read the full story

Originally published by arXiv cs.LG on Nov 5, 2026.

Read on arXiv cs.LG(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.