# NVIDIA CMX

NVIDIA reframes AI-factory memory from how much capacity a GPU has to how many useful tokens each byte produces, combining NVFP4 weight and KV-cache compression, wide expert parallelism for MoE weights, Dynamo KV-cache reuse, Vera CPU staging of context during tool calls, and CMX pod-level context storage. On SemiAnalysis AgentX, which replays recorded coding-agent sessions, Vera Rubin NVL72 delivers up to 30x the throughput per megawatt of GB300 NVL72 at 160 tokens per second per user, with both at 288 GB per GPU.

NVIDIA reframes AI-factory memory from how much capacity a GPU has to how many useful tokens each byte produces, combining NVFP4 weight and KV-cache compression, wide expert parallelism for MoE weights, Dynamo KV-cache reuse, Vera CPU staging of context during tool calls, and CMX pod-level context storage. On SemiAnalysis AgentX, which replays recorded coding-agent sessions, Vera Rubin NVL72 delivers up to 30x the throughput per megawatt of GB300 NVL72 at 160 tokens per second per user, with both at 288 GB per GPU.