FourierQK2 min read
FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law
Frequency-collapse attention [Zeris, 2026e] achieves large gains over standard dot-product attention by replacing the Q/K dot product with a bandpass-filtered inner product at a learned frequency. A natural follow-up question is: which filter shape works best, and why?
By Athanasios ZerisarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 2, 2026.
Comments
Sign in to join the discussion.