AttSVD:Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD

The key-value (KV) cache of autoregressive transformers grows linearly with context length and dominates memory at long context. Most training-free remedies evict low-importance tokens, an irreversible choice along the sequence axis.