Track: Modern Distributed Architectures

Location:

Day of week:

Building robust distributed systems is hard -- it requires a solid theoretical base grounded in hard-earned practical experience. What architectural patterns should you be aware of when designing for your distributed needs? What are some anti-patterns that have been revealed through war stories from the field? What do recently-released cloud services (e.g. AWS Lambda, GCP dataflow & dataproc, AWS Kinesis) now make possible in cloud-based architectures?

Track Host:
Danny Yuan
Real-time Streaming Lead @Uber
Danny Yuan is a software engineer in Uber. He’s currently working on streaming systems for Uber’s marketplace platform. Prior to joining Uber, he worked on building Netflix’s cloud platform. His work includes predictive autoscaling, distributed tracing service, real-time data pipeline that scaled to process hundreds of billions of events every day, and Netflix’s low-latency crypto services.
11:50am - 12:40pm

by Igor Maravic
Software Engineer @Spotify

Spotify’s event delivery system is one of the foundational pieces of Spotify’s data infrastructure. It has a key requirement to reliably deliver complete data with a predictable latency and make it available to Spotify developers via well-defined interface. Delivered data is than used to produce Discover Weekly, Fresh Finds, Spotify Party and many other Spotify features. Currently 1M events is delivered via Spotify's event delivery system every second. To...

1:40pm - 2:30pm

by Gary Lam
Senior Software Engineer @Twitter

by Saurabh Pathak
Leads Notifications Team @Twitter

Twitter Notifications platform enables hundreds of millions of users to stay informed about what’s going on in their Twitter world. Our platform processes large volumes of data (aka Twitter firehose) and delivers relevant notifications in real time to all kinds of users ranging from Katy Perry with ~95M followers to brand new users trying out our product for the very first time. In order to do so efficiently we have adopted a hybrid push/pull based architecture that we will cover in this...

2:55pm - 3:45pm

Open Space
4:10pm - 5:00pm

by Alvaro Videla
Distributed Systems Engineer

Distributed Systems are a complex topic. There's abundant research about it but sometimes it is hard for a beginner to know where to start. I would like to outline the main concepts of distributed systems, so the interested person can have a clear path on how to start their own research as well. In this talk I will review the different models: asynchronous vs. synchronous distributed systems; message passing vs shared memory communication; failure detectors and...

Tracks