The team reports 954,000 tokens per second per GPU on the SemiAnalysis AgentX benchmark, with P90 per-user throughput of 196 tokens per second. It describes this as a 7.9x increase over its earlier aggregated single-node result, and cites DeepSeek off-peak pricing of $38.96 per GPU-hour. A specialized small-batch decode path reached 826 tokens per second for one user.
For comparison, vLLM says its GB200 decode results were within 6% of DeepInfer's published throughput across batches of 8 to 256 at 131K context. Its prefill comparison uses different hardware and configurations, so the post says it does not treat the difference as an engine-to-engine speedup.
The post attributes the work to DEP2 prefill, Wide-EP decode, expert parallel load balancing, and reductions in CPU overhead. It does not establish equivalent performance for other models, workloads, hardware, pricing tiers, or production deployments.