warning icon QCon London 2021 has been canceled. See our current virtual and in-person events.

Stream Processing

Past Presentations

Straggler Free Data Processing in Cloud Dataflow

One of the main causes of performance problems in distributed data processing systems (from the original MapReduce to modern Spark and Flink) is "stragglers." Stragglers are parts of the input that take an unexpectedly long time to process, delaying the completion of the whole job, and wasting...

Eugene Kirpichov Cloud Dataflow Sr SE @Google
Next Steps in Stateful Streaming with Apache Flink

Come learn how Apache Flink is making stateful stream processing even more expressive and flexible to support applications in streaming that were previously not considered streamable. Over the last years, data stream processing has redefined how many of us build data pipelines. Apache Flink is...

Stephan Ewen Committer @ApacheFlink, CTO @dataArtisans
Drivetribe: A Social Network on Streams

Drivetribe is the world's biggest motoring destination, as envisioned by Jeremy Clarkson, Richard Hammond, and James May. Built on top of the Event Sourcing/CQRS pattern, the Drivetribe platform uses Apache Kafka as its source of truth and Apache Flink as its processing backbone. This talk aims...

Aris Koliopoulos CTO @Drivetribe
Hamish Dickson Backend engineer @Drivetribe
Streaming SQL Foundations: Why I ❤ Streams+Tables

What does it mean to execute robust streaming queries in SQL? What is the relationship of streaming queries to classic relational queries? Are streams and tables the same thing conceptually, or different? And how does all of this relate to the programmatic frameworks like we’re all familiar...

Tyler Akidau Engineer @Google & Founder/Committer on Apache Beam
Streaming Reactive Systems & Data Pipes w. squbs

Reactive libraries are nothing new to the JVM. Reactive Streams as an SPI has even made its way into Java 9. However, their uses within microservice components are still for relatively narrow purposes like service orchestration. But we think differently. Our whole presence and universe can be...

Akara Sucharitakul Principal MTS, Architect @PayPal
Anil Gursel Software Engineer @PayPal
The Internet of Things Might Have Less Internet Than We Thought?

While machine learning is traditionally associated with heavy duty power-hungry processors, it is beginning to look like the future of machine learning is on the edge. The ability to run trained networks “at the edge” nearer the data without access to the cloud — or in some...

Alasdair Allan Scientist/Maker/Hacker

Interviews

Stephan Ewen Committer @ApacheFlink, CTO @dataArtisans

Next Steps in Stateful Streaming with Apache Flink

How you you describe the persona and level of the target audience?

The typical persona in the audience would be a developer or architect that wants to learn about the power of stream processing (and Apache Flink specifically) and how stream processing and Flink affect the way we process fast data and build data-driven applications today.

Read Full Interview
Want to keep in touch with more QCon London 2021 announcements?
SUBSCRIBE TO GET UPDATES