Route-and-Generate: KL-Regularized Router Improvement for Reasoning Routing in LLMs
Large language models often apply complex reasoning indiscriminately, leading to overthinking on simple tasks and underthinking on harder ones. We present Route-and-Generate (Rouge), a hierarchical training framework that enables LLMs to adaptively decide when and how much reasoning is required for…
arXiv - cs.AI2 min read