Baseten cuts a 770 GB checkpoint sync from 36 seconds to 15, with a 0.8-second pause
Baseten moved the parent copy of its delta weight sync back onto the GPU, cutting a roughly 770 GB GLM-5.3 checkpoint sync from 36 seconds with a 6-second request pause to 15 seconds with a 0.8-second pause, and raising throughput by as much as 3.2x. The earlier design kept the full parent in host memory, which on an 8×B300 node could not coexist with a 1.1 TB host KV cache, so the cache shrank to 275 GB. The new path reads only changed GPU positions and verifies updates with delta checksums before writing.