Running AI at the Edge: Running Real Workloads Directly in the Browser

QCon London 2026

Session

Running AI at the Edge: Running Real Workloads Directly in the Browser

Wednesday Mar 18 / 03:55PM GMT, Mountbatten (6th Fl.) at The QEII Centre, London

Abstract

Running AI today often means choosing between Anthropic or OpenAI, and accepting the cost and privacy concerns that come with shipping data to third-parties. What if there was another way? Tools like Transformers.js and WebLLM have progressed and it’s now possible to do useful inference locally - keeping sensitive data off the network entirely, cutting token costs, and building things that work without a server in the loop.

If you've ever called an LLM via API and wondered whether you actually needed to, this talk is for you.

James Hall, creator of jsPDF, shares the lessons from building browser-native AI - the demos that worked, the early Chrome APIs that didn’t.

In this talk you'll learn:

  • When local inference beats a cloud API call, and how to benchmark the difference on your actual workloads
  • How to prevent PII from ever leaving a machine
  • The pitfalls that will catch you out and how to design around them
  • How to leverage WebGPU as an in-browser data scientist
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2026 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 18 March

10:35 Mountbatten (6th Fl.) Session AI Tools That Enable the Next 1B Developers Ivan Zarea Director of Platform Engineering @Netlify 11:45 Mountbatten (6th Fl.) Session GUI Agents Computer Use Agents: The Frontier of Vision-Based Automation Stefan Dirnstorfer CTO @Thetaris GmbH, Architect of ThetaML & Thetaris’ Testing Application, 42 Years into Software 13:35 Windsor (5th Fl.) Session Panel: Who Builds the Frontend Now? (And What Breaks When They Do) Luca Mezzalira, James Hall, Danielle An, Ivan Zarea 14:45 Windsor (5th Fl.) Session GenAI Architecting AI Driven Game Creation: From Research to Production Scale Systems Danielle An Principal Engineer / GenAI Architect @Meta, Ph.D. with 15 years of professional experience in film, MR and gaming 15:55 Mountbatten (6th Fl.) Session Running AI at the Edge: Running Real Workloads Directly in the Browser James Hall Founder and Director @Parallax, Author of jsPDF