Field noteOct 26, 20261 min read1 source

vLLM blog: Serving DeepSeek-V4.1-Flash at scale, matching DeepInfer and scaling to GB300 NVL72

In one minute

Inferact and the vLLM team published a performance study on October 23, 2026, covering online serving of DeepSeek-V4.1-Flash on a single NVIDIA GB300 NVL72 rack.

What changed: Same event as Serving DeepSeek-V4.1-Flash at Scale: vLLM Matches DeepInfer and Scales to GB300 NVL72 | vLLM Blog

The tested configuration combines prefill/decode disaggregation with Wide-EP expert parallelism.

On the SemiAnalysis AgentX workload, vLLM reports 954,000 tokens per second per GPU and a P90 rate of 196 tokens per second per user. That is 7.9 times the team's earlier single-node result. It estimates the configuration at $38.96 per GPU-hour using DeepSeek off-peak pricing. A specialized small-batch decode path reached 826 tokens per second for one user.

Against DeepInfer, DeepSeek's offline engine, vLLM says its GB200 decode throughput was within 6% across batch sizes from 8 to 256 under DeepSeek's 131K-context configuration. Its prefill curve was compared with DeepInfer's published chart, but the hardware and setup differ, so the post does not establish an engine-to-engine prefill speed advantage.

The source reports vendor-run benchmarks and implementation details including DEP2 prefill, EPLB balancing, CPU-overhead reductions, and kernels released by DeepSeek. It does not establish equivalent performance on other models, workloads, hardware, or production deployments.

Evidence / sources

  1. 1blog.vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicInferenceExplore the inference topic hub.
  2. 02topicAi InfrastructureExplore the ai-infrastructure topic hub.
  3. 03topicComputeExplore the compute topic hub.
  4. 04archiveField NotesOpen the latest editorial analysis.
  5. 05source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract