Modular LLMs at scale: how FlexOlmo is helping to pool national expertise without pooling sensitive data

Danish Foundation Models is using FlexOlmo as the basis for FlexMoRE, a more efficient modular LLM architecture that lets institutions contribute specialized experts trained on sensitive or proprietary data without sharing that data—and run the resulting models on highly accessible hardware.