Teaching Engineers, Trusting AI: How Education Enabled Autonomous Code Review

Abstract

At Duolingo, we realized that successful AI adoption would require deliberate learning — not just access to tools. Over the past year, we scaled AI usage across 300+ engineers through intentional dogfooding programs, live training, office hours, and AI observability dashboards. The goal wasn’t simply increasing usage; it was building literacy, trust, and shared norms around how AI should be used in production engineering workflows.

That foundation enabled us to take on harder challenges — including introducing AI into code review itself. Our AI-powered PR Risk Score and auto-approval system now safely approves 10% of pull requests and cuts developer wait times in half. But the real work wasn’t model tuning — it was cultural. We had to design guardrails engineers respected, measure impact without incentivizing reckless automation, and ensure that automation strengthened rather than eroded review quality.

Autonomous review wasn’t the endpoint; it was proof that with the right educational groundwork, teams can safely expand AI into high-trust, high-stakes systems. This talk explores how building AI literacy unlocks the ability to redesign core engineering workflows — and what that means for organizations navigating the next phase of AI adoption.


Date

Wednesday Mar 18 / 02:45PM GMT ( 50 minutes )

Location

Churchill (Ground Fl.)

Share

From the same track

Session AI

AI is an Amplifier: Scale High Performance, Not Dysfunction

Wednesday Mar 18 / 10:35AM GMT

AI adoption in software development is nearly universal, yet the outcomes for teams are highly variable. Why do some organizations see massive productivity gains while others see their delivery stability crash? DORA’s latest research provides a key insight: AI acts as an amplifier.

Speaker image - Nathen Harvey

Nathen Harvey

Lead of DORA and Product Manager @Google Cloud

Session

Leading Through the Fog: Transparent Communication Strategies for AI Integration

Wednesday Mar 18 / 11:45AM GMT

Details coming soon

Speaker image - Clara Higuera

Clara Higuera

Responsible AI Program Lead @BBVA - Driving Innovation & Social Impact in AI, PhD Thesis Advisor, Member of OdiseIA, Previously Data Scientist @BBC

Session AI

The Reinvention of the Dev Team

Wednesday Mar 18 / 01:35PM GMT

I don’t need to tell you that AI has changed software development forever. You know this. Whether you’re positive, negative or indifferent to this change, you can’t deny that the past 2 years have radically changed the role of the software developer.

Speaker image - Hannah Foxwell

Hannah Foxwell

Independent Consultant at the Intersection of Platform Engineering, Security, and AI, Founder of AI For the Rest of Us

Session

4 AI Native Developer Patterns

Wednesday Mar 18 / 03:55PM GMT

Development is experiencing a new phase of automation, similar to what we saw with DevOps. Numerous new tools are emerging, and it can be challenging to keep up with them.

Speaker image - Patrick Debois

Patrick Debois

AI Product Engineer @Tessl, Co-Author of the "DevOps Handbook", Content Curator at AI Native Developer Community