Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar

QCon London 2023

Session performance

Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar

Wednesday Mar 29 / 11:50AM BST, Whittle (3rd Fl.)

Abstract

Thread-per-core programming models are well known in software domains where latency is important. Pinning application threads to physical cores and handling data in a core-affine way can yield impressive results, but what is it like to build a large scale general purpose software product within these constraints?

Redpanda is a high performance persistent stream engine, built on the Seastar framework. This session will describe practical experience of building high performance systems with C++20 in an asynchronous runtime, the unexpected simplicity that can come from strictly mapping data to cores, and explore the challenges & tradeoffs in adopting a thread-per-core architecture.

Topics

performance latency streaming case study
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 29 March

10:35 Whittle (3rd Fl.) Session performance Adventures in Performance Thomas Dullien Distinguished Engineer, Mathematician, World-Renowned Security Researcher 11:50 Whittle (3rd Fl.) Session performance Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar John Spray Storage Engineering Lead @neon.tech, Formerly Redpanda, Inktank (Ceph), Whamcloud (Lustre) 13:40 Whittle (3rd Fl.) Session performance Providing a Personalized Experience to Millions of Users @BBC Manisha Lopes Principal Software Engineer @BBC 14:55 Whittle (3rd Fl.) Session performance What We Talk About When We Talk About Networks Keith Winstein Associate Professor of Computer Science and, by courtesy, of Electrical Engineering @Stanford 16:10 Whittle (3rd Fl.) Session performance WebGPU is Not Just About the Web Élie Michel Research Scientist @Adobe