Speaker
Abstract
Networks, and the applications they support, sometimes treat each other as strangers. By shaking things up a bit—expressing networked systems as compositions of small, pure functions and making their dataflow a first-class consideration—we can often achieve friendlier couplings across the stack, to the benefit of performance, robustness, and understandability. This approach has proved helpful in several contexts: networking algorithms learned "in situ," feeding data from deployment back into training; real-time video conferencing, especially for musicians and actors during the pandemic; image compression in a distributed network filesystem; and a serverless computing framework that lets software burst to 10,000 cores that we have used for software compilation and testing, film-scale 3D rendering, video encoding and inference, and other jobs. In ongoing work, we're building a "functional" operating system that enforces a separation between IO (declared to the OS) and computation (reproducible by default). This suggests an end-to-end argument for serverless computing, shifting the service model from “renting CPUs by the second” to “providing the unambiguously correct result of a computation.” Holding infrastructure accountable to these higher-level abstractions could permit agility and innovation on other axes.
Topics
QCon London 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Performance: Designing and Tuning Hosted by Justin Cormack CTO @DockerFrom the same track
Wednesday 29 March
10:35 Whittle (3rd Fl.) Session performance Adventures in Performance Thomas Dullien Distinguished Engineer, Mathematician, World-Renowned Security Researcher The end of the economical version of Moore's Law (exponential decrease in transistor unit costs), the advent of metered cloud computing, and the shift of the economy toward digital goods and SaaS-based business models has shifted performance engineering from the fringes ("CPU progress will fix… 11:50 Whittle (3rd Fl.) Session performance Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar John Spray Storage Engineering Lead @neon.tech, Formerly Redpanda, Inktank (Ceph), Whamcloud (Lustre) Thread-per-core programming models are well known in software domains where latency is important. 13:40 Whittle (3rd Fl.) Session performance Providing a Personalized Experience to Millions of Users @BBC Manisha Lopes Principal Software Engineer @BBC Personalization can be a very effective and impactful way for your organisation to attract new customers as well as to retain your existing customer base – if you get it right! 14:55 Whittle (3rd Fl.) Session performance What We Talk About When We Talk About Networks Keith Winstein Associate Professor of Computer Science and, by courtesy, of Electrical Engineering @Stanford Networks, and the applications they support, sometimes treat each other as strangers. 16:10 Whittle (3rd Fl.) Session performance WebGPU is Not Just About the Web Élie Michel Research Scientist @Adobe Since OpenGL has been deprecated, writing portable native apps that leverage the massively parallel computing capabilities of GPUs has become tedious because no single graphics API can fit all targets.