Ontology‐Driven Observability: Building the E2E Knowledge Graph at Netflix Scale

QCon London 2026

Session Generative AI

Ontology‐Driven Observability: Building the E2E Knowledge Graph at Netflix Scale

Tuesday Mar 17 / 10:35AM GMT, Fleming (3rd Fl.) at The QEII Centre, London

Abstract

As Netflix scales hundreds of client platforms, microservices, and infrastructure components, correlating user experience with system performance has become a hard data problem, not just an observability one. Existing metrics, traces, and logs are siloed by system boundaries, making it slow and brittle to answer even basic questions like: “Is this user-visible regression caused by the client, the network, or a backend dependency?”

In this talk, we’ll walk through the design and implementation of E2EGraph: an end-to-end knowledge graph that models every Netflix user experience as a connected graph of users, clients, services, infrastructure, and their interactions. Each user session, client app, microservice, and network component is a node; requests, user interactions, and dependencies are edges enriched with attributes such as latency, error rates, QoE impact, versions, geo, and more.

We will focus on the data engineering challenges behind this system:

  • How we ingest heterogeneous data sources (client telemetry, server logs, traces, infra metrics, experiments, deployments) and normalize them into a unified ontology for observability.
  • How we design a domain ontology that encodes concepts like “user session,” “API call,” “deployment event,” “experimentation,” and “QoE regression,” and how that ontology enables consistent reasoning across the stack.
  • How we construct and maintain the knowledge graph at scale, including snapshotting the graph at regression time to support temporal comparison between “healthy” and “degraded” states.

On top of this graph, we are building automatic Root Cause Analysis for SRE operations (AutoSRE) using a mixture‐of‐experts architecture:

  • A coordinator agent decomposes a question like “Why is TV UI lolomo TTR regressing in the latest version?” into tasks.
  • Specialized “expert” agents (metrics/Atlas, alerts/Radar, experiments/ABlaze, client platforms, events/deploys) query the knowledge graph via the shared ontology.
  • The coordinator then synthesizes these graph‐backed insights to propose the most likely root causes. E.g., a specific client rollout, a misconfigured experiment, or a backend dependency regression.

We’ll close with our roadmap for predictive and self-healing capabilities:

  • Using graph‐based models to predict issues before they materially impact QoE, by learning patterns of failing subgraphs, propagation paths, and risky combinations of versions and experiments.
  • Driving self-healing behaviors where detected or predicted problems can trigger automated mitigations, like targeted rollbacks, traffic shifting, feature flag changes, or capacity adjustments, guided by the knowledge encoded in the E2EGraph ontology.

Attendees will come away with a concrete blueprint for using knowledge graphs as a unifying data layer for observability, how an ontology unlocks cross-domain reasoning and Auto RCA, and how such a foundation can evolve toward predictive, self‐healing infrastructure in large-scale distributed systems.

Topics

Generative AI Symbolic AI Ontologies Observability
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2026 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 17 March

10:35 Fleming (3rd Fl.) Session Generative AI Ontology‐Driven Observability: Building the E2E Knowledge Graph at Netflix Scale Prasanna Vijayanathan, Renzo Sanchez-Silva 11:45 Windsor (5th Fl.) Session Machine Learning Infrastructure From S3 to GPU in One Copy: Rethinking Data Loading for ML Training Onur Satici Staff Engineer @SpiralDB & a Core Maintainer of Vortex (LF AI & Data), Previously Building Distributed Systems @Palantir 13:35 Whittle (3rd Fl.) Session Kafka Introducing Tansu.io -- Rethinking Kafka for Lean Operations Peter Morgan Founder @tansu.io 14:45 Mountbatten (6th Fl.) Session AI/ML Chronon - Mixed-Workload Data Processing Framework Nikhil Simha Co-Founder & CTO @zipline.ai, Author of "Chronon Feature Platform", Previously @Airbnb, @Meta, and @Walmartlabs 15:55 Whittle (3rd Fl.) Session streaming The Rise of the Streamhouse: Idea, Trade-Offs, and Evolution Giannis Polyzos, Anton Borisov 17:05 Rutherford (4th Fl.) Event Connecting the Dots: Modern Data Engineering & Architectures (Limited Space - Registration Required)