RoLaQ2 min read
RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention
Multi-head latent attention (MLA) compresses the content of a key-value cache into a shared latent per token, making low-bit storage attractive for long-context inference.
By Shiyu Ji, Peng Ling, Chen Lin, Shupeng Li, Yixuan Wang, Qingfu Zhu, Wanxiang ChearXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 16, 2026.
Comments
Sign in to join the discussion.