---
type: "post"
id: "how-cerebras-deploys-trillion-parameter-ai-models-06db8d"
slug: "how-cerebras-deploys-trillion-parameter-ai-models-06db8d"
title: "How Cerebras Deploys Trillion-Parameter AI Models"
description: "Cerebras has published a technical description of how it says it deploys trillion-parameter models across its wafer-scale systems."
retrieval_nugget: "Cerebras has published a technical description of how it says it deploys trillion-parameter models across its wafer-scale systems."
published_at: "2026-10-22"
updated_at: "2026-10-22"
record_date: "2026-10-22"
date_kind: "published_at"
topics: ["harness-engineering","agent-runtime"]
entities: ["Cerebras","WSE-3T","Kimi K3"]
related_patterns: ["harness-architecture-outlives-model-choice"]
novelty_label: "new_fact"
what_changed: "Cerebras details a multi-wafer deployment method for Kimi K3, including memory mapping and claimed 1,000–2,000+ tokens-per-second performance."
prior_refs: ["memory:649f4854-fac4-8784-a494-533843bf1db5","memory:b01c8472-a9e5-8d98-a629-34e2d7fab75e","memory:8e511205-51d4-85cb-ad54-6ad39ce7843c"]
source_url: "https://www.cerebras.ai/blog/how-we-deploy-trillion-parameter-frontier-models-on-cerebras"
source_urls: ["https://www.cerebras.ai/blog/how-we-deploy-trillion-parameter-frontier-models-on-cerebras"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:how-cerebras-deploys-trillion-parameter-ai-models-06db8d"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/how-cerebras-deploys-trillion-parameter-ai-models-06db8d/","markdown":"https://newruntime.com/posts/how-cerebras-deploys-trillion-parameter-ai-models-06db8d.md","json":"https://newruntime.com/posts/how-cerebras-deploys-trillion-parameter-ai-models-06db8d.json"}
---

# How Cerebras Deploys Trillion-Parameter AI Models

## Retrieval answer

Cerebras has published a technical description of how it says it deploys trillion-parameter models across its wafer-scale systems.

Cerebras has published a technical description of how it says it deploys trillion-parameter models across its wafer-scale systems. The post uses the open-source Kimi K3, described as a roughly 3-trillion-parameter model with 69 linear-attention layers and 24 dense layers, as its worked example.

Under the article’s assumptions—4-bit weights, an 8-bit KV cache, and an average request size of 256,000 tokens—each layer occupies about 16 GB. A WSE-3T wafer has 44 GB of on-chip memory. Cerebras says the example mapping puts two linear-attention layers on a wafer and one dense layer per wafer, yielding 35 wafers for linear layers and 24 for dense layers: 59 wafers in total.

The company says the wafers form a pipeline, with model weights remaining on their assigned wafers while activations move between stages over RDMA over Ethernet. It cites roughly two microseconds per network hop and claims this approach can run multi-trillion-parameter models at 1,000–2,000+ tokens per second.

The source does not establish an independently measured production result, a customer deployment, power consumption, pricing, or the actual concurrency achieved by this configuration.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Harness Engineering](https://newruntime.com/topics/harness-engineering.md): Explore the harness-engineering topic hub.
- topic hub: [Agent Runtime](https://newruntime.com/topics/agent-runtime.md): Explore the agent-runtime topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)