TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory
We introduce TurboMamba, a language-model architecture for faster inference, faster training, and better token prediction. A global Mamba-3 model runs once per completed token block. A small Transformer uses this global context and earlier tokens within the block to predict the next token.
arXiv cs.LG2 min read