retrieval augmented generation2 min read
Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG
Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding.
By Zehao Lin, Qianfeng Shen, Xixuan Hao, Shaobo Cui, Chunyu Li, Kai Chen, Bo Tang, Zhenjun Wang, Jin Yan, Zhiyu Li, Feiyu XiongarXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Oct 23, 2026.
Comments
Sign in to join the discussion.