Track host
About the track
Data engineering has become an indispensable function in most software engineering organizations today. Data engineering as a discipline has broadened to encompass all practices, systems, and architectures involved in storing and serving data for a myriad of needs. From OLTP systems that power user experiences to the analytics systems that power business & user insights to all of the connective tissue that keeps data consistent between these systems, data engineers have their hands full managing complex systems and architectures. The promise of the modern data stack was to simplify these architectures to reduce the operational burden many of us still wrestle with today. But, what really works? Which technologies and practices live up to their promises? What patterns and technologies have stood the test of time? What are some pitfalls that you need to be aware of? Come to this track to learn from data engineers facing & solving these problems today.
Sessions in this track
Tuesday 9 April. 6 sessions per track, chosen and introduced by the Track Host.
10:35 Windsor (5th Fl.) Session database Powering User Experiences with Streaming Dataflow Alana Marzoev Founder & CEO @ReadySet Streaming dataflow provides a unique solution to scaling OLTP applications by allowing for an efficient cache implementation that does not diverge from the relational model of the underlying data store. 11:45 Windsor (5th Fl.) Session ML Feature Store The Harsh Reality of Building a Realtime ML Feature Platform Ivan Burmistrov Principal Software Engineer @ShareChat In a world where AI and ML are rapidly evolving, the need for efficient Realtime Feature Platforms has never been greater. But the journey to create one is far from straightforward. 13:35 Windsor (5th Fl.) Session architecture High Performance Time-Series Database Design With QuestDB Vlad Ilyushchenko Co-Founder & CTO @QuestDB, OG Author of PSY-Probe, Geek In this talk we will explore the world of time series and unique set of problems time series present to the developers. We will discuss the engineering principles behind QuestDB's design, focusing on high performance. 14:45 Whittle (3rd Fl.) Session architecture Improving Developer Experience Using Automated Data CI/CD Pipelines Noémi Ványi, Simona Pencea Validating your code against actual production data can be challenging. We have all been at least once on the receiving end of a "test1" email subject because somebody somewhere did a test with the production database. 15:55 Windsor (5th Fl.) Session Building Databases Rockset - Building a Modern Analytics Database on Top of RocksDB Igor Canadi Founding Engineer and Architect @Rockset, Previously at RocksDB and Facebook RocksDB, a key-value store built on the foundation of Log-Structured Merge-Tree data structures and originally open-sourced by Facebook, has played a significant role in shaping data systems over the past decades. 17:05 Rutherford (4th Fl.) Unconference Unconference: Innovations in Data Engineering An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.