MoEs6 min read
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
Today we’re releasing Olmo-core 3, a significant upgrade to our framework for developing large language models featuring a redesigned open mixture-of-experts (MoE) training system.
By Kyle WiggersHugging Face Blog

Read the full story
Originally published by Hugging Face Blog on Oct 1, 2026.
Comments
Sign in to join the discussion.