Kimi K3 decode path written with coding agents: 842 tokens/s on 16 GB300 GPUs, 1.73x over stock vLLM
Kimi K3's decode path in vLLM is now a unified CuTe DSL implementation built with agent assistance, fusing attention, MoE and cross-GPU communication. On 16 NVIDIA GB300 GPUs with DSpark at synthetic acceptance length 6, decode reaches 842 tokens/s, 1.73x stock vLLM under the same speculative setup, and without speculation TP16 keeps 1.62-1.71x at batches 16-64. A proposed fast-track process pairs such work with isolated changes, bounded hardware scope and both kernel and model-level validation.