Skip to main content
Search

# GPU Fractioning Operator

2 related articles

Subscribe to updates
  1. GPUs stop being handed out whole: CUDA 13.4 enforces a memory boundary, and Kubernetes carves cards into fractions

    NVIDIA CUDA 13.4 adds an application-transparent time-sharing mode that confines each workload to a fraction of GPU memory, so an allocation above the requested size fails as it would on a smaller GPU. KAI Scheduler offers an NvFractions sharing mode from v0.18.0 that picks GPU slices and writes memory and compute mode into Pod annotations, and the new open-source gpu-fractioning operator enforces those limits on each node and measures per-fraction use.

  2. NVIDIA Open-Sources the Full Run:ai Platform: GPU Orchestration Leaves the Subscription, Four Components Stand Alone

    NVIDIA has released the complete Run:ai platform as open source software within its DSX AI Factory platform, giving customers, developers and ecosystem partners access to production-grade AI workload and GPU orchestration. The platform previously shipped as a commercial product that dynamically allocated GPU resources on Kubernetes and managed workloads across the full lifecycle, from data processing and training to inference. The release includes four components that can also be adopted independently: KAI Scheduler, GPU Fractioning Operator, KAI Resource Management and Workload Map, so partners can take the whole platform, build on it, or integrate single pieces.

You’re all caught up