You are viewing content from a past/completed QCon

Presentation: Kafka: a Modern Distributed System

Track: Modern CS in the Real World

Location: Whittle, 3rd flr.

Duration: 4:10pm - 5:00pm

Day of week: Monday

Share this on:

Abstract

You may have heard that Apache Kafka plays a central role in modern event-driven architectures. It lies at the heart of successful microservices implementations -- its loyal following is well versed in Kafka's key APIs: the Producer and Consumer, Kafka Streams, and maybe even KSQL. But have you ever wanted to take a peek under the hood and understand how it all works?

In this talk, we’ll cover Kafka's distributed system fundamentals: the role of the Controller, the mechanics of leader election, the role of Zookeeper today and in the future. We’ll look at how read and write consistency work, how they are tunable, and how how recent innovations like exactly-once semantics and observer replicas work. Come to this talk to view Kafka through the lens of distributed systems fundamentals.

Speaker: Tim Berglund

Senior Director of Developer Experience @Confluent

Tim is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director of Developer Experience. He can frequently be found at speaking at conferences in the United States and all over the world. He is the co-presenter of various O’Reilly training videos on topics ranging from Git to Distributed Systems, and is the author of Gradle Beyond the Basics. He tweets as @tlberglund, blogs very occasionally at http://timberglund.com, and lives in Littleton, CO, USA with the wife of his youth and their youngest child, the other two having mostly grown up.

Find Tim Berglund at

Last Year's Tracks