RL2 min read
Balancing Reference Guidance and Free Generation in Trajectory Rollouts for Reasoning RL
A verified reference solution provides a correct trajectory for training a reasoning model. Alternatively, a prefix of the reference can guide the model in generating a trajectory of its own. How much reference guidance should we provide?
By Hanyu Wang, Nakul Agarwal, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Makoto Fukushima, Jinghui Chen, Vaishnav TadiparthiarXiv - cs.AI
Read the full story
Originally published by arXiv - cs.AI on Oct 9, 2026.
Comments
Sign in to join the discussion.