Presentation: Cloud Native Data Pipelines With Apache Kafka

Track: Architecting for the Cloud / Streaming Architectures

Location: Fleming, 3rd flr.

Duration: 4:10pm - 5:00pm

Day of week: Wednesday

Share this on:

Abstract

As microservices, data services and serverless APIs proliferate in a cloud-native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution – the way to manage data in a cloud native environment is to build cloud native data pipelines.
 
In this presentation, we’ll discuss how data engineering requirements changed in a cloud-native world, and how the solutions change with them. We’ll share architectural patterns that are commonly used to build cloud native data infrastructure, and how they help you build flexible, scalable and reliable pipelines to give your business visibility on all your data.

Speaker: Gwen Shapira

Principal Data Architect @Confluent, PMC Member @Kafka, & Committer Apache Sqoop

Gwen is a principal data architect at Confluent helping customers to achieve success with their Apache Kafka implementation. She has 15 years of experience working with code and customers to build scalable data architectures, integrating microservices, relational and big data technologies. She currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an author of “Kafka - the Definitive Guide”, "Hadoop Application Architectures", and a frequent presenter at industry conferences. Gwen is also a committer on the Apache Kafka and Apache Sqoop projects. When Gwen isn't coding or building data pipelines, you can find her pedaling on her bike exploring the roads and trails of California, and beyond.

Find Gwen Shapira at

Tracks

The all-new QCon app!

Available on iOS and Android

The new QCon app helps you make the most of your conference experience. Easily browse and follow the conference schedule, star the talks you want to attend, and keep tabs on your personal itinerary. Download the app now for free on iOS and Android.