{"type":"post","id":"introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f","slug":"introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f","title":"Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs","description":"Thesis: Olmo-core 3 makes large-scale MoE training infrastructure more accessible by publishing a stack designed to reduce the cost of distributing experts across GPUs.","retrieval_nugget":"Thesis: Olmo-core 3 makes large-scale MoE training infrastructure more accessible by publishing a stack designed to reduce the cost of distributing experts across GPUs.","published_at":"2026-10-01","updated_at":"2026-10-01","record_date":"2026-10-01","date_kind":"published_at","topics":[],"source_urls":["https://allenai.org/blog/olmocore3"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:a451f2165bfdafcfbf9f4fc14297d705d504352c42802930bbebd4a8f48a75ab","reviewed_at":"2026-10-01T16:02:34.065Z","source_evidence_count":1,"verified_claim_count":3,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":3,"implication_count":2,"watch_condition_count":2,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"Olmo-core 3 makes large-scale MoE training infrastructure more accessible by publishing a stack designed to reduce the cost of distributing experts across GPUs.","observed_facts":[{"text":"Ai2 reports a preliminary eight-NVIDIA-B300-GPU test in which a 47-billion-parameter MoE processed 52,000 tokens per second per GPU, compared with 19,400 on its earlier implementation.","source_urls":["https://allenai.org/blog/olmocore3"]},{"text":"Ai2 says increasing the expert pool from 8 to 128 while selecting four experts per token raised total capacity from 4.6B to 47B parameters with throughput down less than 5%.","source_urls":["https://allenai.org/blog/olmocore3"]},{"text":"Ai2 reports benchmarking a 1.2-trillion-parameter configuration across 512 GPUs, with 58.36B active parameters per token and peak observed throughput of 858 TFLOP/s/GPU.","source_urls":["https://allenai.org/blog/olmocore3"]}],"mechanism":"The reported mechanism is a move from FSDP weight gathering to DDP with experts resident on GPUs, alongside expert and pipeline parallelism, distributed optimization, and routing and computation optimizations.","why_now":"Ai2 says its next-generation Olmo will use an MoE architecture, making this training stack part of the foundation for that planned model and potentially usable by outside researchers now.","implications":["The first implication is that open access to training infrastructure, not only model weights, gives researchers a route to experiment with MoE scaling and implementation choices.","The release may let outside researchers adapt the stack and test its techniques on their own hardware and workloads."],"evidence_boundary":"The largest-scale measurements used random routing and describe system performance, not trained-model quality; the reported 2.38-trillion-parameter test was short-capacity, not a full training run. The eight-GPU throughput comparison is described as preliminary, so it should not be treated as a general result across hardware, workloads, or sustained runs.","watch_conditions":["The first watch condition is whether independent users can reproduce these throughput and scaling results on different clusters and workloads.","Further evidence on sustained training, model quality, and practical deployment will be needed to assess how broadly the reported gains transfer."],"related_records":[],"new_branch_reason":"No prior New Runtime record was supplied, so this release starts a distinct analytical record focused on open MoE training infrastructure and its benchmark claims."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f/","markdown":"https://newruntime.com/posts/introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f.md","json":"https://newruntime.com/posts/introducing-olmo-core-3-open-scalable-training-infrastructure-d3032f.json"},"next_reads":[{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}