You are viewing content from a past/completed QCon

Presentation: Operating Multi-Tenant Kafka Services for Developers on Heroku

Track: Solutions Track II

Location: Westminster, 4th flr.

Duration: 4:10pm - 5:00pm

Day of week: Tuesday

Share this on:

Abstract

Operating Kafka as a service, at scale, is one challenge. Operating multi-tenant Kafka as a service, at scale, brings all kinds of new challenges. How do you determine the optimum packing density? How do you define and enforce resource limits so all tenants can coexist? How do you handle a large number of partitions? Learn how we worked our way through these problems, formed the opinions built into our service today, and designed a product that developers love. And see what some of our most advanced data-driven customers are doing with Kafka and Heroku.

Speaker: Tom Crayford

Infrastructure Engineer @Heroku

Tom Crayford is an infrastructure engineer at Heroku, on the team that runs hundreds of Kafka clusters and millions of datastores. He likes teaching people things, like how to write faster or more reliable (or both) software.

Find Tom Crayford at

Last Year's Tracks

Monday, 4 March

Tuesday, 5 March

Wednesday, 6 March