Skip to main content
Search

# AI factory

9 related articles

Subscribe to updates
  1. NVIDIA Blog

    NVIDIA Packs an AI Factory Into a Container: Onsite Build Drops From Six Months to 14 Days, and Agents Get a Kernel-Level Sandbox

    At GTC Berlin, NVIDIA introduced DSX POD, a reference design for complete Vera Rubin AI factories that partners integrate and validate inside modular containers before delivery, cutting onsite deployment from six months to 14 days once site utilities are ready. A companion OpenShell reference architecture places a policy-controlled runtime with kernel-level sandboxing between an agent and the systems it can affect, since each launched agent carries different privileges.

  2. NVIDIA Wires AI-Factory Telemetry Into One Causal Graph: 81 Alerts Become One Incident, Saving About 54 Cluster Hours

    NVIDIA has introduced Minerva, an AIOps platform for AI factories that feeds telemetry from GPUs, switches, storage and training jobs into a knowledge graph updated as jobs move, then applies supervised and unsupervised models to catch the gray failures static thresholds miss. In one NVIDIA case, 81 separate events triggered by a switch restart were merged into a single incident, saving about 54 hours of cluster uptime; in another, the platform found one quietly degrading NVLink connection among roughly 400,000 interfaces. These figures come from NVIDIA's internal testing and case descriptions, within its supported scenarios.

  3. NVIDIA Blog

    NVIDIA's Minerva maps GPUs, networks and jobs into one live graph so AI factories fix faults before jobs stall

    NVIDIA released Minerva, an AIOps platform for end-to-end observability of AI factories built from large GPU fleets. Previously networking, compute, site reliability and machine learning teams each saw a separate slice of the data center, and alerts arrived disconnected. Minerva pools telemetry from GPUs, SuperNICs, switches, cables, storage, schedulers and workloads into a dynamic knowledge graph, then uses supervised and unsupervised learning to detect anomalies, predict failures and correlate events by topology, collapsing an alert storm into one incident with a likely root cause.

  4. NVIDIA cuts voltage droop by over 60% with Groq 3 LPX deterministic execution to get more inference tokens per megawatt

    NVIDIA describes the deterministic execution model of the Groq 3 LPX low-latency accelerator within its Vera Rubin platform: the LPU compiler schedules compute and data movement down to the clock cycle, letting it predict per-cycle current demand and use Preemptive Power (PEP) and Clock Period Synthesis (CPS) to reduce voltage droop and shrink the voltage guardband, with internal testing showing over 60% less voltage drop, an estimated high single-digit percentage decrease in the baseline voltage that must be continually supplied, a potentially low-double-digit percentage reduction in power for the same workload, and up to 35x higher throughput per megawatt at the platform level versus the previous-generation GB200 NVL72 for 2T+ parameter models at long context and high interactivity.

  5. NVIDIA details NVLink 6 multi-layer resiliency: physical-layer correction plus Dynamo shadow engine cut inference downtime from 283 seconds to 7.3 seconds

    In this technical article, NVIDIA explains how NVLink 6 supports large-scale AI factories through a multi-layer resiliency framework spanning the physical, link, application, and system layers: the physical layer combines lightweight FEC with Physical Layer Retry (PLR) and UPHY recovery for a natively lossless fabric, the link layer uses credit-based flow control (CBFC) to eliminate packet drops by design, and the application layer uses Dynamo Shadow Engine Recovery and checkpointing to shorten interruptions, with the article reporting that in benchmarked deployments on B200 GPUs shadow engine recovery reduced inference downtime from 283 seconds to 7.3 seconds.

  6. NVIDIA and Nscale test DSX MaxLPS in Iceland: GPUs rise from 140 to 192 and aggregate throughput gains 49.2% under the same 264.4 kW budget

    NVIDIA and Nscale jointly evaluated DSX MaxLPS policy-governed dynamic power allocation with Kimi K2.5 (FP4) inference workloads on NVIDIA GB300 NVL72 systems at Nscale's data center at the Verne campus in Keflavík, Iceland: under the same 264.4 kW approved power budget, managed GPUs rose from 140 to 192 (+37.1%), aggregate throughput rose from 1,084,503 to 1,618,443 tokens/s (+49.2%), throughput per provisioned watt rose from 4.10 to 6.12 tokens/s/W (+49.2%), median and P75 latency stayed within 5% of baseline, while P99 time to first token increased 17% from the 15.7-second baseline.

  7. NVIDIA Research

    NVIDIA Launches DSX Ready: A Qualification Program for Power and Cooling Products in AI Factories

    NVIDIA introduced DSX Ready, a qualification program for partner products and solutions that meet applicable NVIDIA DSX AI factory reference design requirements, launching with two initial categories, battery energy storage systems (BESS) and cooling distribution units (CDUs), and naming the first qualified BESS and CDU suppliers.

  8. NVIDIA Research

    From Enablement to Execution: Egypt and Africa's AI Ecosystem Reaches Production Scale

    Using a reception at the Grand Egyptian Museum as its entry point, this article traces how Egypt's and Africa's AI ecosystems are moving from a "potential" narrative to production-scale execution, citing a more than tenfold one-year growth in Egypt's Deep Learning Institute learner base, an estimated $400 million Hassan Allam and A15 data center investment, four AI factories announced or online across Africa within a year with another 656 megawatts in the pipeline, Cassava Technologies' deployments across Egypt, Kenya, Nigeria and Morocco that could reach $720 million, Stratos Lab's more than 50 NVIDIA HGX B300 systems delivering over 7 exaflops, Morocco's Nexus AI factory outside Casablanca with a $1.

  9. NVIDIA Research

    Emerald AI, Google and NVIDIA Launch Alliance to Advance Flexible AI Data Centers

    Emerald AI, Google and NVIDIA announced the launch of the AI Energy Management Alliance (AEMA), a coalition convening the full AI and power value chain around a technology-neutral, performance-based approach that lets data centers dynamically manage electricity use to speed interconnection, strengthen reliability and protect affordability.

You’re all caught up