Know a great AI tool or AI news source? Submit it to AiByts
2 min read

Do LMs Know What Variables Do? Interpreting Code Representations via Variable Roles

Variable roles describe recurring behaviors such as accumulation, traversal, and retaining the best candidate encountered. We use Sajaniemi's independently defined taxonomy to study which role distinctions can be recovered from large language models, how sparse autoencoders (SAEs) retain those…

By C\'elian Vasson, Daniil Ognev, Kentaro Inui, Benjamin HeinzerlingarXiv - cs.CL (NLP)

Read the full story

Originally published by arXiv - cs.CL (NLP) on Oct 21, 2026.

Read on arXiv - cs.CL (NLP)(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.