Presentation: ECS & Docker: Secure Async Execution @Coursera
Location:
- Fleming, 3rd flr.
Duration
Day of week:
- Tuesday
Abstract
While most business logic can run in response to web requests, some computations require more than 200ms to complete. Although developers have a cornucopia of web frameworks to choose from, relatively little investment has been made in general purpose systems for delayed execution.
Coursera’s general purpose nearline execution framework—Iguazú—has seen broad utility across many aspects of our global learning platform. Built upon containers and optimized for developer productivity, we use this system to handle researcher data exports, broadcast announcements, and peer reviewer matching. A secured instance of Iguazú is used to safely evaluate programming assignment submissions for a variety of courses and programming languages.
Together, we will trace Coursera’s journey from PHP to the JVM to Docker. This talk will cover aspects of Coursera’s architecture that enables us to rapidly build sophisticated features for our learning platform. Additionally, we will discuss our experience running containers in production; what works, what doesn’t, and why. Finally, we will briefly touch upon container threat models, and how to architect a defense-in-depth strategy to mitigate both known and unknown vulnerabilities.
Similar Talks
Tracks
Covering innovative topics
Monday, 7 March
-
Back to Java
What to expect in Java 9 and Spring 5
-
Stream Processing @ Scale
Big data, fast-moving data. Practical implementation lessons on Real-time Data
-
DevOps & CI/CD
Lessons/stories on optimizing the deployment pipeline
-
Head-to-Tail Functional Languages
Free-range Monads, Tackling immutability, tales from production, and more...
-
Architecting for Failure
Your system will fail. Take control before it takes you with it
-
21st Century Culture from Geeks on the Ground
New ways to organise technology companies and workplace culture
Tuesday, 8 March
-
Architectures You've Always Wondered about
In-depth technical case studies from giants like: Microsoft, Netflix, Google, Twitter, and more...
-
Close to the Metal
Get efficiency back into your code, concepts like: cache efficient algorithm and lock free data structures
-
Containers (in production)
Real-world lessons on scalability and reliability in production container deployments
-
Modern CS in the real world
Real-world Industry adoption of modern CS ideas
-
Security, Incident Response & Fraud Detection
Master-level classes on building security into your system and responding to incidents when things go wrong.
-
Optimizing You
Keeping life in balance is always a challenge. Learning lifehacks
Wednesday, 9 March
-
Disrupting Finance
Technology advances in finance (blockchain, P2P, Machine Learning, API's)
-
Modern Native Languages
Modern native languages: Safe efficiency with Go, Rust, Swift
-
Full Stack Javascript
Level up Javascript with topics like Angular, React/ReactNative, Node, Mongo/Couch/Other, Falcor, GraphQL, etc
-
Data Science & Machine Learning Methods
A developer's data science and machine learning toolkit
-
Microservices for Mega-Architectures
Practical lessons on Microservices success.
-
Modern Agile Development
Revisiting Agile today and tackling challenges we are seeing in the wild