Skip to main content
Search

# Root Cause Analysis

6 related articles

Subscribe to updates
  1. NVIDIA hands DGX SuperPOD operations to AI agents: cross-layer root-cause hunting, read-only access first

    NVIDIA built the AI Factory Operations Agent for its own DGX SuperPOD operations so site reliability engineers no longer have to check compute, network, hardware and scheduling dashboards one by one. The agent is a set of domain-specific sub-agents that communicate over MCP, detect failures in production, correlate root causes across layers and surface recommendations through a chat interface. The framework runs as a Kubernetes control-plane application, its tool calls are constrained by read-only credentials and RBAC, and the orchestration framework is released as experimental open source software.

  2. NVIDIA's FOX blueprint puts a factory manager agent in charge of inspection, rework and root-cause agents

    NVIDIA released the Factory Operations Blueprint (FOX), a reference architecture that adds a factory manager agent to existing factory systems and has it coordinate specialist agents for inspection, root-cause analysis and fleet management. Previously, factory teams had to gather evidence across systems, consult specialists and coordinate the next step, which took substantial time and manual querying. FOX's SMT reference example follows an AOI alert through secondary inspection, rework transport in a digital twin and analysis of reflow oven readings, then returns a PDF report with source records and recommended actions.

  3. NVIDIA Wires AI-Factory Telemetry Into One Causal Graph: 81 Alerts Become One Incident, Saving About 54 Cluster Hours

    NVIDIA has introduced Minerva, an AIOps platform for AI factories that feeds telemetry from GPUs, switches, storage and training jobs into a knowledge graph updated as jobs move, then applies supervised and unsupervised models to catch the gray failures static thresholds miss. In one NVIDIA case, 81 separate events triggered by a switch restart were merged into a single incident, saving about 54 hours of cluster uptime; in another, the platform found one quietly degrading NVLink connection among roughly 400,000 interfaces. These figures come from NVIDIA's internal testing and case descriptions, within its supported scenarios.

  4. Steel foundry defect analysis drops prompt rules for code gates, lifting defect-location mentions from zero to 16

    Root-cause analysis of steel casting defects and equipment failures has moved its key checks out of prompts and into code. Previously a general-purpose model answered wrong and right with equal confidence, once calling temperatures above 1,300°C physically impossible and recommending a sensor replacement. The system constrains the model with deterministic decision gates, page-level documentation cards and verbatim citation checks, and on one casting raised mentions of the defect location from zero to 16, 11 and 3, while quantification density stayed far below the reference analysis.

  5. arXiv

    An SRE agent stops starting from scratch: it writes detectors and playbooks, resolving recurring faults 2.1x faster

    SDO, an operator agent for Kubernetes applications, distills each resolved incident into reusable operational memory: parameterized playbooks that record diagnosis and repair steps, non-LLM detectors that decide from cluster state which playbook applies, and an architecture summary that binds playbook roles to the current application. Across 11 open-source microservice applications, SDO cuts resolution time on recurring faults by 52%, with median resolution falling from 584 s to 282 s and tokens from 5.4M to 2.2M; when deploying applications from source, operational memory reduces deployment time and token use by 47.5%.

  6. NTT DOCOMO and the authors show at MWC that cascaded graph algorithms plus agentic orchestration cut root cause analysis on commercial networks from hours to minutes

    The article traces how graph intelligence for networks evolved from topology modeling through ontologies, alarm correlation, dependency graphs, causal subgraphs and graph neural networks, and proposes root cause analysis built on a network digital twin graph, a cascaded graph-algorithm pipeline (decomposition, clustering, alarm-relative centrality ranking) and agentic orchestration, which the authors say achieved root cause analysis in minutes on commercial networks in a demonstration with NTT DOCOMO at MWC.

You’re all caught up