Causal AI in production operations
NOFire AI
How does causal AI find the root cause of a production incident?
Causal AI infers cause and effect rather than co-occurrence. In production it traces a symptom backwards through a time-versioned dependency graph to the change that started it, so the answer is a named deploy or config event rather than a ranked list of signals that moved at the same time.
VerdictThe distinction that matters operationally is not accuracy in the abstract. It is whether the output names a change you can act on or a correlation you still have to investigate.
At a glance
| Approach | What it answers | Published Top-1 accuracy on RCAEval |
|---|---|---|
| Threshold alerting | Something crossed a line | Not applicable, it does not rank causes |
| Correlation and AIOps clustering | What moved at the same time | 17 to 42 percent across 12 academic baselines |
| Topology-aware correlation | What moved at the same time, on connected services | Within the same band |
| Causal inference over a versioned graph | Which change propagated to the symptom | 89 percent |
| Human investigation | Whatever the responder thinks to check | Not benchmarked, and highly variable |
How it works
A correlation model asks which signals moved together. During an incident in a distributed system, many do. Three services deployed at 14:02, latency rose at 14:03, and a correlation model surfaces all three as suspects with no way to separate them.
A causal model asks which change propagated through which dependency path to produce the symptom. That requires something a metrics store does not hold: the topology as it was at the moment in question. A dependency that was added an hour before the incident is the interesting one, and a graph that only knows its current state cannot tell you it was new.
Production causality shows up in five distinct forms, and a model has to handle each differently. Temporal causality covers lagged effects, such as a memory leak that triggers an out-of-memory kill three hours after the deploy that introduced it. Structural causality covers changes to the shape of the system itself. Multi-hop causality covers propagation across service boundaries, where pressure on one service exhausts a connection pool in a second and surfaces to the user as an error from a third. Counterfactual causality answers what would have happened otherwise, which is what makes pre-deploy risk analysis possible. Interventional causality measures the effect of an action actually taken.
The practical consequence is the shape of the output. A correlation model returns a ranked list of candidates. A causal model returns a specific event and the path from it to the symptom, which is the difference between a lead and an answer. See the short definition of causal AI for the underlying concept.
How it is measured
Top-1 accuracy on a public fault-injection benchmark is the measurement that separates these approaches, and it is deliberately harsh: the ranked first answer either matches the injected fault or it does not, with no credit for a plausible second guess.
RCAEval, published at the ACM Web Conference in 2025, injects 735 known faults into running systems and scores each method on whether its first answer is the real one. Correlation-based approaches land between 17 and 42 percent across twelve academic baselines. A causal approach reaches 89 percent, as recorded in the AI SRE Benchmark.
Top-1 matters more than Top-5 for an operational reason rather than a statistical one. A responder acts on the first answer at 2am. A system that is right four times in ten teaches the team to investigate independently, at which point the tool is overhead rather than acceleration. Commercial platforms in this category have largely not published results against a public benchmark, so a buyer usually has to reproduce the measurement on their own resolved incidents.
Common misconceptions
That a knowledge graph is a causal graph. A knowledge graph records that service A depends on service B. A causal graph records that a rise in B's 99th-percentile response time drives a proportional rise in A's error rate with a median lag of four seconds. The second is learned from production behaviour and is not in anyone's schema.
That more data fixes correlation. More signals give a correlation model more things that moved together. Volume raises the number of candidates rather than lowering it.
That accuracy is a nice-to-have. It is the precondition for automation. A remediation step cannot be executed without a human if the root cause behind it is wrong four times in ten, which is why accuracy and unattended operation are the same conversation rather than two.
Frequently asked questions
- Is causal AI the same as explainable AI?
- No. Explainable AI makes a model's predictions interpretable after the fact. Causal AI models the cause-and-effect structure itself, which supports explanation but also prediction and intervention.
- Can correlation-based tools reach the same answer?
- Sometimes, on simple incidents with one obvious change. They degrade when several things move together, which is the normal condition during an incident in a distributed system.
- What data does a causal model need that a correlation model does not?
- Topology over time. Correlation needs metrics that move. Causality needs to know what depended on what at the moment the symptom appeared, which means a dependency graph that is versioned rather than current.
- Does this remove the need for observability?
- No, it depends on it. A causal model is built from the telemetry, deploy history and dependency signals a team already collects. A thin stack produces a thin model.
Go deeper: the AI SRE Benchmark
Book a demo