Abstract
In this talk, we will describe the design of InfluxDB 3.0's new high performance time series database engine using Apache Arrow, DataFusion, Parquet and Rust.
This design provides a fast and highly interoperable analytic system without a tightly integrated codebase built from scratch. It is part of a larger trend in database system design, so called deconstructed databases, where high performance interchange standards and high quality open source components form the foundation for high performance and highly interoperable specialized analytic systems.
Sponsored session
Session sponsored by
The Time Series Data Platform where developers build IoT, analytics, and cloud applications.
QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Sponsored Solution Track IIIFrom the same track
Wednesday 10 April
10:35 Westminster (4th Fl.) Sponsored Simplifying Streaming Data Transforms with WebAssembly James Kinley, Paul Wilkinson The majority of stream processing work is spent on mundane transformation tasks like scrubbing, normalisation, and filtering. Yet to perform these relatively simple tasks involves standing up multiple distributed systems that add complexity and take time to learn. 11:45 Westminster (4th Fl.) Sponsored GraphRAG - Connecting the Dots for Information Discovery Andreas Kollegger Software Engineer @Neo4J The classic RAG application extends an LLM with private information, able to fetch answers to questions that are contained in a single chunk of text. What if the answer requires connecting the dots across multiple chunks that may not be directly similar to the question? 13:35 Westminster (4th Fl.) Sponsored Elevating Developer Experiences with AI-Powered API Testing & Documentation Jamie White Strategic Solutions Engineer @Postman In the modern era, APIs have exploded in their popularity, powering absolutely everything we interact with on a daily basis (whether we know it or not). Maintaining their coherence and functionality has become, to say the least, a difficult task for developers and engineering leaders. 14:45 Westminster (4th Fl.) Sponsored An Introduction to Event APIs Linus Hakansson Field CTO @Gravitee Learn how asynchronous communication can revolutionize business, positively impact scalability and real-time decision-making, and grasp synchronous-asynchronous federation technologies for seamless integration. 15:55 Westminster (4th Fl.) Sponsored Building InfluxDB 3.0 using Modular Open Source Components Raphael Taylor-Davies Senior software engineer @InfluxData In this talk, we will describe the design of InfluxDB 3.0's new high performance time series database engine using Apache Arrow, DataFusion, Parquet and Rust.