AlterNet2 min read
AlterNet: Adaptive-Depth Mixture-of-Experts with Learned Halting for Elastic Inference
Most LLM architectures have fixed compute demands determined at training time. We propose a novel architecture that combines the Mixture-of-Experts architecture with shallow experts and a novel dynamic-depth system to make the extent of a forward pass dynamically adjustable.
By Alexander KastiusarXiv - cs.AI
Read the full story
Originally published by arXiv - cs.AI on Nov 9, 2026.
Comments
Sign in to join the discussion.