Apple Machine Learning Research2 min read
On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models
State Space Models (SSMs) have emerged as a compelling alternative to Transformers, enabling sequence modeling with constant memory and linear compute. Although SSMs exhibit reasonable performance and favorable computational characteristics, they continue to lag behind Transformers on tasks that…
By Apple ML Research

Read the full story
Originally published by Apple ML Research on Nov 10, 2026.
Comments
Sign in to join the discussion.