Strategy & Principles to Scale and Evolve MLOps @DoorDash

MLOps has become a major enabler to successfully operationalize ML applications and for ML practitioners to realize the power of ML to bring impact to business.  The journey to implementing MLOps will be unique to each company. One common thread to successfully adopt MLOps is the need for a strategy and a set of principles. 

At DoorDash, we’ve been applying MLOps for a couple of years to support a diverse set of ML use cases, such ETA predictions, the Dasher assignments, personalized recommendation of restaurants and menu items and more, and to perform large scale predictions at low latency.

This session will share our approach to MLOps, the strategy and principles that have helped us to scale and evolve our platform to support hundreds of models and billions of predictions per day, and deep dive on the technical aspects of scaling our feature store and prediction service.

What's the focus of your work these days?

I am currently leading the ML platform team at DoorDash. Our platform journey started a few years back and we are currently working on the second floor of our ML platform to support the various large and complex ML use cases that require distributed model training, model prediction flexibility and more

The use cases I mentioned are about recommendations, NLP, computer vision, and large language models.

What's something interesting that you've learned from the previous QCon?

At the previous QCon SF in 2022, one interesting thing I learned while attending the lightning talk given by Courtney Kissler, CTO @ Zuliy at the Women & Allies in Tech Breakfast was about using the criteria when making impactful decisions.


Speaker

Hien Luu

Sr. Engineering Manager @DoorDash & Author of Beginning Apache Spark 3, Speaker and Conference Committee Chair

Hien Luu is a Sr. Engineering Manager at DoorDash, leading the Machine Learning Platform team. He is particularly passionate about building scalable AI/ML infrastructure to power real-world applications. He is the author of the Beginning Apache Spark 3 book. He has given presentations at various conferences such as MLOps World, QCon (SF,NY, London), GHC 2022, Data+AI Summit, XAI 21 Summit, YOW Data!, appy().

Read more
Find Hien Luu at:

Date

Wednesday Mar 29 / 10:35AM BST ( 50 minutes )

Location

Mountbatten (6th Fl.)

Topics

Machine Learning operations scalability

Share

From the same track

Session AI

Responsible AI: From Principle to Practice!

Wednesday Mar 29 / 01:40PM BST

Enabling responsible development of artificial intelligent technologies is one of the major challenges we face as the field moves from research to practice. Researchers and practitioners from different disciplines have highlighted the ethical and legal challenges posed by the use of machine learn

Speaker image - Mehrnoosh Sameki
Mehrnoosh Sameki

Principal PM Manager @Microsoft

Session Digital Twins

Cognitive Digital Twins: A New Era of Intelligent Automation

Wednesday Mar 29 / 11:50AM BST

Traditionally, Digital Twins have been helping businesses make data-driven decisions, increase efficiency, and improve the overall performance of their physical assets.

Speaker image - Yannis Georgas
Yannis Georgas

Intelligent Industry Lead @Capgemini

Session python

Simplifying Real-Time ML Pipelines with Quix Streams: An Open Source Python Library for ML Engineers

Wednesday Mar 29 / 04:10PM BST

As data volume and velocity continue to increase, the need for real-time machine learning (ML) is becoming more pressing. However, building real-time ML pipelines can be complex and time-consuming, requiring expertise in both ML and streaming application development.

Speaker image - Tomáš Neubauer
Tomáš Neubauer

CTO & Co-Founder @Quix

Session Graphs

Graph Learning at the Scale of Modern Data Warehouses

Wednesday Mar 29 / 02:55PM BST

Data warehouses have become a staple for enterprises, providing a wealth of information that can be harnessed to improve decision-making through the use of machine learning (ML).

Speaker image - Subramanya Dulloor
Subramanya Dulloor

Founding Engineer @Kumo.ai