Session + Live Q&A
Scribe: The 15-Year Evolution of Meta’s Data Transport Service
Meta's hardware infrastructure comprises millions of machines, all of which generate data. The overall traffic generated reaches several petabytes every hour, while its processing typically takes place somewhere other than where it was originally generated. The task of collecting, aggregating, and delivering this traffic volume (with low latency and high throughput) requires a systematic approach. This talk will go through the architectural evolution of Scribe, a data transport service that encapsulates all the complexity behind moving data from point A to point B in streaming fashion.
Speaker
Manos Karpathiotakis
Software Engineer @Meta
Manos is a software engineer at Meta, where he has worked on Scribe - Meta's data transport service - for the past four years.He obtained a PhD from EPFL, focusing on efficient ways to query heterogeneous data through the use of techniques such as runtime code generation and GPGPU data...
Read moreFind Manos Karpathiotakis at:
Speaker
Vlassios Rizopoulos
Production Engineer @Meta
Vlassios is a production engineer at Meta, where he is working on Scribe - Meta's data transport service.He has a passion in managing large data focused infrastructures and for more than 15 years, he has been focusing on both for analytical and transactional systems.Prior to Meta he help a...
Read moreDate
Monday Apr 4 / 04:10PM BST (50 minutes)
Location
Fleming, 3rd flr.
Track
Architectures You've Always Wondered About
Topics
ScalingFacebookVideo
Video is not available
Slides
Slides are not available
Add to Calendar
Add to calendarShare
From the same track
Large Scale Architectures Panel
Monday Apr 4 / 05:25PM BST
Join Eder Ignatowicz of Red Hat as he explores architectural issues with a panel of experts from some of the world's largest architectures.
Sarah Wells
Former Tech Director for Engineering Enablement @FT (Financial Times)
Vitor Pellegrino
Director of Engineering @SeatGeek
Anderson Parra
Senior Software Engineer @SeatGeek
Bart de Water
Manager @Shopify Payments Team
Unconference: Architectures You've Always Wondered About
Monday Apr 4 / 11:50AM BST
Details coming soon
How SeatGeek Successfully Handle High Demand Ticket On-Sales
Monday Apr 4 / 01:40PM BST
High-demand online ticket on-sales are a core part of SeatGeek’s business and pose a challenge to delivering a seamless user experience. SeatGeek's ability to handle large amounts of online traffic made the company the preferred ticketing solution for significant teams at the English...
Anderson Parra
Senior Software Engineer @SeatGeek
Vitor Pellegrino
Director of Engineering @SeatGeek
Shopify’s Architecture to Handle the World’s Biggest Flash Sales
Monday Apr 4 / 02:55PM BST
How do you enable millions of entrepreneurs to run their businesses on your platform? And how do you deal with product launches that suddenly bring millions of requests per minute from one moment to the next?This talk will walk through how Shopify works under the hood using the customer journey...
Bart de Water
Manager @Shopify Payments Team
How Starling Built Their Own Card Processor
Monday Apr 4 / 10:35AM BST
Rob Donovan and Ioana Creanga talk about what happens behind the scenes when you pay with your card, and how Starling built their own card processor, integrating more traditional hardware with cloud-deployed micro-services.
Rob Donovan
Tech Lead @StarlingBank
Ioana Creanga
Engineer Lead for the Payments Processing Group @StarlingBank