Presentation: ECS & Docker: Secure Async Execution @Coursera
Location:
- Fleming, 3rd flr.
 
Duration
Day of week:
- Tuesday
 
Abstract
While most business logic can run in response to web requests, some computations require more than 200ms to complete. Although developers have a cornucopia of web frameworks to choose from, relatively little investment has been made in general purpose systems for delayed execution.
Coursera’s general purpose nearline execution framework—Iguazú—has seen broad utility across many aspects of our global learning platform. Built upon containers and optimized for developer productivity, we use this system to handle researcher data exports, broadcast announcements, and peer reviewer matching. A secured instance of Iguazú is used to safely evaluate programming assignment submissions for a variety of courses and programming languages.
Together, we will trace Coursera’s journey from PHP to the JVM to Docker. This talk will cover aspects of Coursera’s architecture that enables us to rapidly build sophisticated features for our learning platform. Additionally, we will discuss our experience running containers in production; what works, what doesn’t, and why. Finally, we will briefly touch upon container threat models, and how to architect a defense-in-depth strategy to mitigate both known and unknown vulnerabilities.
Similar Talks
Tracks
Covering innovative topics
Monday, 7 March
-   
          Back to Java    
  
What to expect in Java 9 and Spring 5
 -   
          Stream Processing @ Scale    
  
Big data, fast-moving data. Practical implementation lessons on Real-time Data
 -   
          DevOps & CI/CD    
  
Lessons/stories on optimizing the deployment pipeline
 -   
          Head-to-Tail Functional Languages    
  
Free-range Monads, Tackling immutability, tales from production, and more...
 -   
          Architecting for Failure     
  
Your system will fail. Take control before it takes you with it
 -   
           21st Century Culture from Geeks on the Ground    
  
New ways to organise technology companies and workplace culture
 
Tuesday, 8 March
-   
          Architectures You've Always Wondered about    
  
In-depth technical case studies from giants like: Microsoft, Netflix, Google, Twitter, and more...
 -   
          Close to the Metal    
  
Get efficiency back into your code, concepts like: cache efficient algorithm and lock free data structures
 -   
          Containers (in production)    
  
Real-world lessons on scalability and reliability in production container deployments
 -   
          Modern CS in the real world    
  
Real-world Industry adoption of modern CS ideas
 -   
          Security, Incident Response & Fraud Detection    
  
Master-level classes on building security into your system and responding to incidents when things go wrong.
 -   
          Optimizing You    
  
Keeping life in balance is always a challenge. Learning lifehacks
 
Wednesday, 9 March
-   
          Disrupting Finance    
  
Technology advances in finance (blockchain, P2P, Machine Learning, API's)
 -   
          Modern Native Languages    
  
Modern native languages: Safe efficiency with Go, Rust, Swift
 -   
          Full Stack Javascript    
  
Level up Javascript with topics like Angular, React/ReactNative, Node, Mongo/Couch/Other, Falcor, GraphQL, etc
 -   
          Data Science & Machine Learning Methods    
  
A developer's data science and machine learning toolkit
 -   
          Microservices for Mega-Architectures    
  
Practical lessons on Microservices success.
 -   
          Modern Agile Development    
  
Revisiting Agile today and tackling challenges we are seeing in the wild
 




