DeepSeek V4.1 Flash hits 848 tokens per second on Nvidia’s GB300 NVL72

Per-agent decode speed climbed from 596 tokens per second in roughly a month, showing how fast software and hardware tuning is moving. DeepSeek V4.1 Flash now generates 848 tokens per second per agent on Nvidia’s GB300 NVL72 system. A month ago, that number was 596. That is an extra 252 tokens per second without swapping out the hardware. What changed in a month The figure that matters here is per-agent decode speed. Think of it as how fast a single AI session can type out its answer once it starts responding. Going from 596 to 848 tokens per second on the same GB300 NVL72 setup points to gains in the software layer. That covers serving stacks, kernels, and model-level tweaks, not new silicon. The research findings frame this as a joint effort across model design, serving software, and hardware. No single breakthrough did the heavy lifting. There are bigger numbers floating around too. In specialized configurations, aggregate throughput reportedly topped 1 million tokens per second per GPU. The reported cost in those setups is about $0.002 per million tokens. That estimate applies under large-hyperscaler pricing scenarios, so your average startup should not expect that invoice. Ins...