{"type":"post","id":"ai2-releases-olmo-core-3-to-make-developing-bb866d","slug":"ai2-releases-olmo-core-3-to-make-developing-bb866d","title":"Ai2 releases Olmo-core 3 to make developing large mixture-of-experts LLMs more efficient","description":"**Thesis:** Olmo-core 3 treats MoE training efficiency as a systems problem: distribute model and optimizer state so larger expert pools need not be replicated in full on every GPU.","retrieval_nugget":"**Thesis:** Olmo-core 3 treats MoE training efficiency as a systems problem: distribute model and optimizer state so larger expert pools need not be replicated in full on every GPU.","published_at":"2026-10-10","updated_at":"2026-10-10","record_date":"2026-10-10","date_kind":"published_at","topics":[],"source_urls":["https://siliconangle.com/2026/10/02/ai2-releases-olmo-core-3-to-make-developing-large-mixture-of-experts-llms-more-efficient"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:ai2-releases-olmo-core-3-to-make-developing-bb866d","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:8c815b2fd9c5bedb1a8cc002dea99674a9f66559f39e8801f0b3a6d2201007f6","reviewed_at":"2026-10-10T09:04:10.120Z","source_evidence_count":1,"verified_claim_count":2,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":2,"implication_count":1,"watch_condition_count":1,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"Olmo-core 3 treats MoE training efficiency as a systems problem: distribute model and optimizer state so larger expert pools need not be replicated in full on every GPU.","observed_facts":[{"text":"SiliconANGLE reports Ai2 says Olmo-core 3 can expand its expert pool from eight to 128 while selecting four experts per token, and can scale to models above one trillion parameters.","source_urls":["https://siliconangle.com/2026/10/02/ai2-releases-olmo-core-3-to-make-developing-large-mixture-of-experts-llms-more-efficient"]},{"text":"Ai2’s reported benchmark for a 47-billion-parameter model is 52,000 tokens per second on Nvidia B300 GPUs, versus about 19,400 for Nvidia Megatron-core.","source_urls":["https://siliconangle.com/2026/10/02/ai2-releases-olmo-core-3-to-make-developing-large-mixture-of-experts-llms-more-efficient"]}],"mechanism":"The account describes expert parallelism across GPUs, layer splitting across GPU groups, a distributed optimizer that avoids full copies of optimizer state on every GPU, and MXFP8 support. Together, these techniques target memory overhead and data movement as the expert pool grows, while maintaining sparse activation.","why_now":"Access to the code and related systems is now reported for developers and the open-source community, making the release an implementable training-stack option rather than only a design proposal.","implications":["For teams building large MoEs, the framework offers a concrete alternative to treating dense-model tooling as the default; throughput and fit will depend on the cluster and workload."],"evidence_boundary":"The figures and scale claims are attributed to Ai2 through SiliconANGLE; the supplied source does not establish independently reproduced results or performance across other hardware, model sizes, or workloads.","watch_conditions":["Look for independently reproducible benchmarks and evidence that the memory and throughput gains persist on varied GPU configurations."],"related_records":[],"new_branch_reason":"This starts a distinct analytical record because no prior New Runtime record was supplied for this release."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/ai2-releases-olmo-core-3-to-make-developing-bb866d/","markdown":"https://newruntime.com/posts/ai2-releases-olmo-core-3-to-make-developing-bb866d.md","json":"https://newruntime.com/posts/ai2-releases-olmo-core-3-to-make-developing-bb866d.json"},"next_reads":[{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}