Know a great AI tool or AI news source? Submit it to AiByts
NanoQuant2 min read

ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights

We introduce ShamAN-Q, a sub-1-bit post-training quantization method that extends NanoQuant by replacing each its diagonal reconstruction geometry with a tractable dense curvature metric, using a general paradigm popularized by the Shampoo optimizer.

By Jonathan Mei, Sang Hyub Kim, Oliver Knitter, Chi Chen, Martin RoettelerarXiv cs.LG

Read the full story

Originally published by arXiv cs.LG on Oct 1, 2026.

Read on arXiv cs.LG(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.