Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
Allen Institute for AI released Olmo-core 3, an open and scalable training framework designed for large mixture-of-experts language models targeting up to trillion-parameter scales.
Why it matters: New open frameworks allow smaller labs and researchers to build and scale mixture-of-experts models efficiently.









