Tensor-parallel traffic drops to 4 bits: Echo feeds each rounding error into later calls, beating NCCL by 2.09x on 1 GB messages
Echo turns the tensor-parallel all-reduce into 4-bit transport with a high-precision sum and feeds each rounding error back into later calls so the accumulated error stays bounded with depth, running 2.09x faster than the 16-bit NCCL all-reduce on 1 GB messages while Qwen3-8B stays within 0.4 points of 16-bit inference across seven benchmarks.