Presentation: Lambda Architectures: a Snapshot, a Stream, & a Bunch of Deltas

Track: Architectures You've Always Wondered About

Location: Fleming, 3rd flr.

Duration: 1:40pm - 2:30pm

Day of week: Tuesday

Level: Intermediate - Advanced

Share this on:

Abstract

We all got so excited about breaking apart our monoliths and liberating our microservices. At HBC Tech, our work on luxury e-commerce experiences across gilt.comsaks.comlordandtaylor.comthebay.com and saksoff5th.com shows us that unconstrained, organic growth of microservice architectures can lead to a system with high numbers of inter-service dependencies (some of them hidden!), and deep call stacks. We asked ourselves the question: “how can we architect, build and run our services resiliently and at scale so that they can respond to requests without any immediate downstream dependencies?” Our approach is to leverage event-sourced architectures that allow core services to reliably share their information with other services asynchronously. At the heart of each solution is the snapshot, the stream, and a bunch of deltas. 
In this talk I’ll give examples of these architectures in practice in our product, pricing, inventory and search services, the technology choices that have stuck: AWS Kinesis, AWS S3, AWS Lambda, Elasticache, and  Calatrava. I’ll discuss how we’re making our way towards adopting Kafka as our backbone streaming implementation. And, I’ll show how we’ve begun to apply the techniques not just internally but also with external third-party vendors to keep our runtime dependencies low. 

Speaker: Adrian Trenaman

SVP Engineering @HBC, Gilt & Committer Apache Karaf

As SVP Engineering, HBC Digital, Ade leads the engineering and infrastructure teams for Gilt in New York and Dublin. He is an experienced, outspoken software engineer, communicator and leader with over 20 years of experience working with teams throughout Europe, US and Asia in diverse industries such as financial services, telecoms, retail, and manufacturing. In the past, he has held the positions of CTO of Gilt Japan, Tech Lead at Gilt Groupe Ireland, Distinguished Consultant at FuseSource, Progress Software and IONA Technologies, and Lecturer at the National University of Ireland in Maynooth. He became a committer for the Apache Software Foundation in 2010, has acted as an expert reviewer to the European Commission. Adrian holds a Ph.D, Computer Science from the National University of Ireland, Maynooth, a Diploma in Business Development from the Irish Management Institute, and a BA (Mod. Hons) Computer Science from Trinity College, Dublin.

Find Adrian Trenaman at

Similar Talks

Tracks

Monday, 5 March

Tuesday, 6 March

Wednesday, 7 March