NVIDIA open-sources NVCRE: running real distributed workloads on Kubernetes turns pre-512-GPU-training cluster readiness into a provable property
NVIDIA released NVCRE (Cluster Readiness Engine), an open-source Kubernetes controller that runs real distributed workloads (NCCL communication, DCGM level-4 diagnostics, NeMo Nemotron 5 pretraining), measures results across topology-aware node groups, and reports exactly which nodes failed and why, verifying GPU cluster readiness before production workloads land instead of hand-writing NCCL manifests and bisecting racks manually.