You are viewing content from a past/completed QCon -


Kafka: a Modern Distributed System

You may have heard that Apache Kafka plays a central role in modern event-driven architectures. It lies at the heart of successful microservices implementations -- its loyal following is well versed in Kafka's key APIs: the Producer and Consumer, Kafka Streams, and maybe even KSQL. But have you ever wanted to take a peek under the hood and understand how it all works?

In this talk, we’ll cover Kafka's distributed system fundamentals: the role of the Controller, the mechanics of leader election, the role of Zookeeper today and in the future. We’ll look at how read and write consistency work, how they are tunable, and how how recent innovations like exactly-once semantics and observer replicas work. Come to this talk to view Kafka through the lens of distributed systems fundamentals.


Tim Berglund

Senior Director of Developer Experience @Confluent

Tim is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director of Developer Experience. He can frequently be found at speaking at conferences in the United States and all over the world. He is the co-presenter of various O’Reilly training videos on...

Read more


Whittle, 3rd flr.


Modern CS in the Real World


Apache KafkaDistributed Systems


Slides are not available


From the same track

SESSION + Live Q&A Database Design

Infinite Parallel Universes: State at the Edge

Databases and other systems of state often rely on abstractions that break down at large physical scale. In this talk I'll describe the problems with some of these traditional assumptions, and suggest better approaches for effectively managing data in geographically large networks. With...

Peter Bourgon

Principal Engineer @fastly

SESSION + Live Q&A Serverless

Cloudstate—Towards Stateful Serverless

Serverless experience is revolutionary and will grow to dominate the future of Cloud. Function-as-a-Service (FaaS) however—with its ephemeral, stateless, and short-lived functions—is only the first step. FaaS is great for processing-intensive, parallelizable workloads, moving data...

Sean Walsh

Field CTO @Lightbend

SESSION + Live Q&A Debugging

Record, Replay, Rinse, & Repeat: Easily Rebuilding Programmatic State

Join this talk to learn about the various implementations of record and replay systems that can be used to debug software applications. The talk begins with a discussion of the current state of the art, from both academia and the real world. We then provide an overview of the pros and cons,...

Greg Law

Co-founder & CTO @undo_io

SESSION + Live Q&A Silicon Valley

Applying AI/ML for Trusted Commerce Connections @Facebook Marketplace

Facebook Marketplace is aimed at making buying and selling seamless for people locally within their communities and open up economic opportunity through social commerce. Given that Trust is a key driver of consumer decisions in Commerce, it is important for Facebook to build trust amongst buyers...

Liza Fireman

Engineering Manager @Facebook Marketplace Trust & Safety

SESSION + Live Q&A Interview Available

Coccinelle: 10 Years of Automated Evolution in the Linux Kernel

Over the last 10+ years, we have been developing the Coccinelle C-program matching and transformation tool. Coccinelle allows developers to match and transform C code via a generalization of the familiar patch syntax. As Coccinelle is independent of the C preprocessor, Coccinelle rules can be...

Julia Lawall

Senior Researcher @Inria

View full Schedule