CoTranslator: Reverse to Forward Chain-of-Thought Translator for Reasoning Distillation
Reasoning distillation requires chain-of-thought (CoT) data with correct answers, but obtaining such data efficiently remains challenging. Forward CoT generation (FCG) followed by rejection sampling (RS) produces verified, question-only responses, yet may require many teacher calls for difficult…
arXiv - cs.CL (NLP)2 min read