Fewer Heads, Fewer Memories: Pruning Redundant Attention Heads Suppresses Verbatim Memorisation
Large language models have been shown to memorise and reproduce verbatim sequences from their training data, raising concerns about privacy leakage, intellectual property exposure, and the limits of generalisation.
By Aryan Chowdhury, Riza Batista-NavarroarXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Nov 2, 2026.
Comments
Sign in to join the discussion.