# Agentic Inference

For coding, math and computer-use agent workloads, Evolving Infra decouples compute allocation between prefill and decode from KV cache management: a node switches phase without a restart, and its KV stays readable from a shared pool. On up to 256 GB300 GPUs it cuts mean end-to-end latency and P95 time to first token by up to 4.1 and 14 relative to NVIDIA Dynamo, and a phase switch takes 6.2 seconds on average against 754 seconds for a Dynamo relaunch.

For coding, math and computer-use agent workloads, Evolving Infra decouples compute allocation between prefill and decode from KV cache management: a node switches phase without a restart, and its KV stays readable from a shared pool. On up to 256 GB300 GPUs it cuts mean end-to-end latency and P95 time to first token by up to 4.1 and 14 relative to NVIDIA Dynamo, and a phase switch takes 6.2 seconds on average against 754 seconds for a Dynamo relaunch.

JevSpawn introduces a training-free compositional policy that turns natural-language task specifications into executable finite action fields, exploring them through parallel action spawning, feedback-driven branch selection, representation revision, and recovery from retained branches; across eight benchmark tasks against seven agent baselines and a TypeSafe Jev variant it achieves the highest scores on five of eight tasks and, on Maze and Grid, raises success rates to 0.96 and 0.95 while reducing end-to-end latency from the fastest baselines' 47.91 and 61.44 seconds to 40.91 and 40.58 seconds.

JevSpawn introduces a training-free compositional policy that turns natural-language task specifications into executable finite action fields, exploring them through parallel action spawning, feedback-driven branch selection, representation revision, and recovery from retained branches; across eight benchmark tasks against seven agent baselines and a TypeSafe Jev variant it achieves the highest scores on five of eight tasks and, on Maze and Grid, raises success rates to 0.96 and 0.95 while reducing end-to-end latency from the fastest baselines' 47.91 and 61.44 seconds to 40.91 and 40.58 seconds.