You are viewing content from a past/completed QCon

Track: Architecting for the Cloud / Streaming Architectures

Location: Fleming, 3rd flr.

Day of week: Wednesday

Cloud native architectures is a reality. Hear the war stories. learn the benefits, and dodge some of the pitfalls of running on the cloud.

Track Host: Sam Newman

Microservice, Cloud, CI/CD Expert

Sam Newman is an independent consultant specializing in helping people ship software fast. Sam has worked extensively with the cloud, continuous delivery, and microservices and is especially preoccupied with understanding how to more easily deploy working software into production. For the last few years, he has been exploring the capabilities of microservice architectures. He has worked with a variety of companies in multiple domains around the world, often with one foot in the developer world and another in the IT operations space. Previously, he spent over a decade at ThoughtWorks before leaving to work with a startup. Sam speaks frequently at conferences. He is the author of Building Microservices (O’Reilly). If you would like to get in touch, please email him.

10:35am - 11:25am

Crossing the River by Feeling the Stones

Deng Xiaoping once described managing the economy as crossing the river by feeling the stones—in other words have a direction but be adaptive. But in a world of constant change, how do you determine the right thing to do? Which pebble to tread on? How do you understand where you’re going and where you need to go? How do you know if your strategy is right? Is there even such a thing?



Simon Wardley examines the issue of situational awareness and explains how it applies to technology. Using examples from government and the commercial world, he explores how you can map your environment, identify opportunities to exploit, and learn to play the game.

Simon Wardley, Top UK Tech Influencer & Researcher & @lefep (Leading Edge Forum)

11:50am - 12:40pm

A Guided Journey of Cloud Native Featuring Monzo

The Cloud Native Trail Map provides a path for enterprises to deploy cloud native applications, and the steps they’ll encounter along their journey. However, the needs of each enterprise are rarely the same and these journeys are rarely linear.

 

In this talk we’ll look at how the needs of applications change as they grow and become more complex, and the stages in which organisations adopt specific cloud native technologies.

 

We’ll then examine the journey that Monzo, a UK based digital bank, have taken over the last four years, the stages they went through as they grew, the challenges they faced at each point, and the technologies and techniques they used to build a cloud native bank.

Cheryl Hung, Director of Ecosystem @CloudNativeFdn
Matt Heath, Distributed Systems Engineer @monzo

1:40pm - 2:30pm

RSocket: Solving Real-World Architectural Challenges

It may seem surprising that a networking protocol can have such wide-ranging implications for applications are architected – but RSocket, with its unique flexibility and set of guarantees, is being used by some of the largest cloud-based companies to achieve order-of-magnitude reductions in infrastructure costs and dramatic improvements in performance and reliability.     

 

Developed in collaboration with Facebook, Pivotal, Netifi, Alibaba and others, RSocket is an open-source reactive networking protocol that is designed to handle the challenges of communication between complex networks of services. Based on the Reactive Streams specification, RSocket is able to handle typical request-response traffic as well as streaming data in both directions – even in the face of unreliable connections. RSocket is transport-agnostic, so it can be used with a variety of standard transports (like TCP, HTTP/2 and WebSocket) both within the data center and over the internet, extending to mobile devices and browsers.     

 

In this session, and Ondrej Lehecka of Facebook, Robert Roeser of Netifi and Andy Shi of Alibaba will explain the use cases for RSocket within their companies, as well as how it can be used by enterprises to simplify the way they build and operate cloud-native applications.

Robert Roeser, Co-Founder & CEO @netifi_inc
Andy Shi, Developer Advocate @AlibabaGroup
Ondrej Lehecka, Software Engineer @Facebook

2:55pm - 3:45pm

Streaming Log Analytics with Kafka

Humio is a log analytics system that is optimised to run in on-prem instances. From a software provider’s point of view, fixing issues in an on-prem solution is inherently problematic, and we have strived to make the solution simple.

To achieve this goal, a Humio installation consists only of a single process per node running Humio itself, being dependent on Kafka running nearby. We then use Kafka for two things: buffering ingest and as a sequencer of events among the nodes of a Humio cluster.

We love Kafka. It has made implementing a distributed system significantly easier than if we had to do the distributed queue from scratch. Using Kafka as a building block has allowed us to focusing our attention on building a fast and pleasant search experience.

In this technical talk, Kresten will discuss how and why we use Kafka internally and demo how we utilise it as a straightforward event-sourcing model for distributed deployments. Kresten will then present customer cases on utilising Kafka to manage and buffer massive volumes of data ingest.

Kresten Krab Thorup, CTO @MeetHumio (Humio)

4:10pm - 5:00pm

Cloud Native Data Pipelines With Apache Kafka

As microservices, data services and serverless APIs proliferate in a cloud-native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution – the way to manage data in a cloud native environment is to build cloud native data pipelines.

 

In this presentation, we’ll discuss how data engineering requirements changed in a cloud-native world, and how the solutions change with them. We’ll share architectural patterns that are commonly used to build cloud native data infrastructure, and how they help you build flexible, scalable and reliable pipelines to give your business visibility on all your data.

Gwen Shapira, Principal Data Architect @Confluent, PMC Member @Kafka, & Committer Apache Sqoop

Tracks

  • Architectures You've Always Wondered About

    Hard-earned lessons from the names you know on scalability, reliability, security, and performance.

  • Machine Learning: The Latest Innovations

    AI and machine learning is more approachable than ever. Discover how ML, deep learning, and other modern approaches are being used in practice.

  • Kubernetes and Cloud Architectures

    Learn about cloud native architectural approaches from the leading industry experts who have operated Kubernetes and FaaS at scale, and explore the associated modern DevOps practices.

  • Evolving Java

    JVM futures, JIT directions and improvements to the runtimes stack is the theme of this year’s JVM track.

  • Next Generation Microservices: Building Distributed Systems the Right Way

    Microservice-based applications are everywhere, but well-built distributed systems are not so common. Early adopters of microservices share their insights on how to design systems the right way.

  • Chaos and Resilience: Architecting for Success

    Making systems resilient involves people and tech. Learn about strategies being used, from cognitive systems engineering to chaos engineering.

  • The Future of the API: REST, gRPC, GraphQL and More

    The humble web-based API is evolving. This track provides the what, how, and why of future APIs.

  • Streaming Data Architectures

    Today's systems move huge volumes of data. Hear how the innovators in this space are designing systems and leveraging modern data stream processing platforms.

  • Modern Compilation Targets

    Learn about the innovation happening in the compilation target space. WebAssembly is only the tip of the iceberg.

  • Leaving the Ivory Tower: Modern CS Research in the Real World

    Thoughts pushing software forward, including consensus, CRDT's, formal methods & probabilistic programming.

  • Bare Knuckle Performance

    Crushing latency and getting the most out of your hardware.

  • Leading Distributed Teams

    Remote and distributed working are increasing in popularity, but many organisations underestimate the leadership challenges. Learn from those who are doing this effectively.

  • Full Cycle Developers: Lead the People, Manage the Process & Systems

    "Full cycle developers" is not just another catch phrase; it's about engineers taking ownership and delivering value, and doing so with the support of their entire organisation. Learn more from the pioneers.

  • JavaScript: Pushing the Client Beyond the Browser

    JavaScript is not just the language of the web. Join this track to learn how the innovators are pushing the boundaries of this classic language and ecosystem.

  • When Things Go Wrong: GDPR, Ethics, & Politics

    Privacy, confidentiality, safety and security: learning from the frontlines, from both good and bad experiences

  • Growing Unicorns in the EU: Building, Leading and Scaling Financial Tech Start Ups

    Learn how EU FinTech innovators have designed, built, and led both their technologies and organisations.

  • Building High Performing Teams

    There are many discussions outlining the secret sauce of high-performing teams. Learn how to balance the essential ingredients of high performing teams such as trust and delegation, as well as recognising the pitfalls and problems that will ruin any recipe.

  • Scaling Security, from Device to Cloud

    Implementing effective security is vitally important, regardless of where you are deploying software applications