LessWrong6 min read
Towards an Architecture-Agnostic Definition of "Attention"
This brief post is meant to inspire and to start an open dialogue. I am genuinely curious to listen and incorporate your opinions, challenges, and insights.The ContextI have been pondering for some time about the fact that Multi-Layer Perceptrons are known to be universal approximators and good…
By Gianluca CalcagniLessWrong

Read the full story
Originally published by LessWrong on Oct 26, 2026.
Comments
Sign in to join the discussion.