You are viewing content from a past/completed QCon

Track: Architecting for the Cloud / Streaming Architectures

Location: Fleming, 3rd flr.

Day of week: Wednesday

Cloud native architectures is a reality. Hear the war stories. learn the benefits, and dodge some of the pitfalls of running on the cloud.

Track Host: Sam Newman

Microservice, Cloud, CI/CD Expert

Sam Newman is an independent consultant specializing in helping people ship software fast. Sam has worked extensively with the cloud, continuous delivery, and microservices and is especially preoccupied with understanding how to more easily deploy working software into production. For the last few years, he has been exploring the capabilities of microservice architectures. He has worked with a variety of companies in multiple domains around the world, often with one foot in the developer world and another in the IT operations space. Previously, he spent over a decade at ThoughtWorks before leaving to work with a startup. Sam speaks frequently at conferences. He is the author of Building Microservices (O’Reilly). If you would like to get in touch, please email him.

10:35am - 11:25am

Crossing the River by Feeling the Stones

Deng Xiaoping once described managing the economy as crossing the river by feeling the stones—in other words have a direction but be adaptive. But in a world of constant change, how do you determine the right thing to do? Which pebble to tread on? How do you understand where you’re going and where you need to go? How do you know if your strategy is right? Is there even such a thing?

Simon Wardley examines the issue of situational awareness and explains how it applies to technology. Using examples from government and the commercial world, he explores how you can map your environment, identify opportunities to exploit, and learn to play the game.

Simon Wardley, Top UK Tech Influencer & Researcher & @lefep (Leading Edge Forum)

11:50am - 12:40pm

A Guided Journey of Cloud Native Featuring Monzo

The Cloud Native Trail Map provides a path for enterprises to deploy cloud native applications, and the steps they’ll encounter along their journey. However, the needs of each enterprise are rarely the same and these journeys are rarely linear.


In this talk we’ll look at how the needs of applications change as they grow and become more complex, and the stages in which organisations adopt specific cloud native technologies.


We’ll then examine the journey that Monzo, a UK based digital bank, have taken over the last four years, the stages they went through as they grew, the challenges they faced at each point, and the technologies and techniques they used to build a cloud native bank.

Cheryl Hung, Director of Ecosystem @CloudNativeFdn
Matt Heath, Distributed Systems Engineer @monzo

1:40pm - 2:30pm

RSocket: Solving Real-World Architectural Challenges

It may seem surprising that a networking protocol can have such wide-ranging implications for applications are architected – but RSocket, with its unique flexibility and set of guarantees, is being used by some of the largest cloud-based companies to achieve order-of-magnitude reductions in infrastructure costs and dramatic improvements in performance and reliability.     


Developed in collaboration with Facebook, Pivotal, Netifi, Alibaba and others, RSocket is an open-source reactive networking protocol that is designed to handle the challenges of communication between complex networks of services. Based on the Reactive Streams specification, RSocket is able to handle typical request-response traffic as well as streaming data in both directions – even in the face of unreliable connections. RSocket is transport-agnostic, so it can be used with a variety of standard transports (like TCP, HTTP/2 and WebSocket) both within the data center and over the internet, extending to mobile devices and browsers.     


In this session, and Ondrej Lehecka of Facebook, Robert Roeser of Netifi and Andy Shi of Alibaba will explain the use cases for RSocket within their companies, as well as how it can be used by enterprises to simplify the way they build and operate cloud-native applications.

Robert Roeser, Co-Founder & CEO @netifi_inc
Andy Shi, Developer Advocate @AlibabaGroup
Ondrej Lehecka, Software Engineer @Facebook

2:55pm - 3:45pm

Streaming Log Analytics with Kafka

Humio is a log analytics system that is optimised to run in on-prem instances. From a software provider’s point of view, fixing issues in an on-prem solution is inherently problematic, and we have strived to make the solution simple.

To achieve this goal, a Humio installation consists only of a single process per node running Humio itself, being dependent on Kafka running nearby. We then use Kafka for two things: buffering ingest and as a sequencer of events among the nodes of a Humio cluster.

We love Kafka. It has made implementing a distributed system significantly easier than if we had to do the distributed queue from scratch. Using Kafka as a building block has allowed us to focusing our attention on building a fast and pleasant search experience.

In this technical talk, Kresten will discuss how and why we use Kafka internally and demo how we utilise it as a straightforward event-sourcing model for distributed deployments. Kresten will then present customer cases on utilising Kafka to manage and buffer massive volumes of data ingest.

Kresten Krab Thorup, CTO @MeetHumio (Humio)

4:10pm - 5:00pm

Cloud Native Data Pipelines With Apache Kafka

As microservices, data services and serverless APIs proliferate in a cloud-native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution – the way to manage data in a cloud native environment is to build cloud native data pipelines.


In this presentation, we’ll discuss how data engineering requirements changed in a cloud-native world, and how the solutions change with them. We’ll share architectural patterns that are commonly used to build cloud native data infrastructure, and how they help you build flexible, scalable and reliable pipelines to give your business visibility on all your data.

Gwen Shapira, Principal Data Architect @Confluent, PMC Member @Kafka, & Committer Apache Sqoop

Last Year's Tracks