NanoQuant2 min read
ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights
We introduce ShamAN-Q, a sub-1-bit post-training quantization method that extends NanoQuant by replacing each its diagonal reconstruction geometry with a tractable dense curvature metric, using a general paradigm popularized by the Shampoo optimizer.
By Jonathan Mei, Sang Hyub Kim, Oliver Knitter, Chi Chen, Martin RoettelerarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 1, 2026.
Comments
Sign in to join the discussion.