Presentation: Operating Multi-Tenant Kafka Services for Developers on Heroku

Track: Solutions Track II

Location: Westminster, 4th flr.

Duration: 4:10pm - 5:00pm

Day of week: Tuesday

Share this on:

Abstract

Operating Kafka as a service, at scale, is one challenge. Operating multi-tenant Kafka as a service, at scale, brings all kinds of new challenges. How do you determine the optimum packing density? How do you define and enforce resource limits so all tenants can coexist? How do you handle a large number of partitions? Learn how we worked our way through these problems, formed the opinions built into our service today, and designed a product that developers love. And see what some of our most advanced data-driven customers are doing with Kafka and Heroku.

Speaker: Tom Crayford

Infrastructure Engineer @Heroku

Tom Crayford is an infrastructure engineer at Heroku, on the team that runs hundreds of Kafka clusters and millions of datastores. He likes teaching people things, like how to write faster or more reliable (or both) software.

Tracks

  • Career Hacking

    Strategies for advancing the skills that advance your career. Look for mentoring, speaking, empathy, and career paths.

  • Advances in FinTech

    Finance is king in London. What's happening and what should you be paying attention to with modern #FinTech

  • Security Transformation

    How do you actually start with a security mindset? Learn techniques for making security a first-class concern.

  • Tech Ethics: The Intersection of Human Welfare & STEM

    What does it mean to be ethical in software? Hear how the discussion is evolving and what is being said in ethics today.

  • Bare Knuckle Performance

    Killing latency and getting the most out of your hardware.

  • Evolving Java & the JVM

    6 month cadence, cloud-native deployments, scale, Graal, Kotlin, and beyond. Learn how the role of Java and the JVM is evolving.

The all-new QCon app!

Available on iOS and Android

The new QCon app helps you make the most of your conference experience. Easily browse and follow the conference schedule, star the talks you want to attend, and keep tabs on your personal itinerary. Download the app now for free on iOS and Android.