What We Talk About When We Talk About Networks

QCon London 2023

Session performance

What We Talk About When We Talk About Networks

Wednesday Mar 29 / 02:55PM BST, Whittle (3rd Fl.)

Abstract

Networks, and the applications they support, sometimes treat each other as strangers. By shaking things up a bit—expressing networked systems as compositions of small, pure functions and making their dataflow a first-class consideration—we can often achieve friendlier couplings across the stack, to the benefit of performance, robustness, and understandability. This approach has proved helpful in several contexts: networking algorithms learned "in situ," feeding data from deployment back into training; real-time video conferencing, especially for musicians and actors during the pandemic; image compression in a distributed network filesystem; and a serverless computing framework that lets software burst to 10,000 cores that we have used for software compilation and testing, film-scale 3D rendering, video encoding and inference, and other jobs. In ongoing work, we're building a "functional" operating system that enforces a separation between IO (declared to the OS) and computation (reproducible by default). This suggests an end-to-end argument for serverless computing, shifting the service model from “renting CPUs by the second” to “providing the unambiguously correct result of a computation.” Holding infrastructure accountable to these higher-level abstractions could permit agility and innovation on other axes.

Topics

performance network infrastructure
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 29 March

10:35 Whittle (3rd Fl.) Session performance Adventures in Performance Thomas Dullien Distinguished Engineer, Mathematician, World-Renowned Security Researcher 11:50 Whittle (3rd Fl.) Session performance Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar John Spray Storage Engineering Lead @neon.tech, Formerly Redpanda, Inktank (Ceph), Whamcloud (Lustre) 13:40 Whittle (3rd Fl.) Session performance Providing a Personalized Experience to Millions of Users @BBC Manisha Lopes Principal Software Engineer @BBC 14:55 Whittle (3rd Fl.) Session performance What We Talk About When We Talk About Networks Keith Winstein Associate Professor of Computer Science and, by courtesy, of Electrical Engineering @Stanford 16:10 Whittle (3rd Fl.) Session performance WebGPU is Not Just About the Web Élie Michel Research Scientist @Adobe