Refreshing Stale Code Intelligence

Abstract

Coding models are helping software developers move even faster than ever before, but weirdly, they’re not keeping up with our fast progress. The models that power code generation are often based on months to years old snapshots of open source code. And they’ve never seen your in-house codebase, let alone the code you wrote yesterday. The result is a world where you, the software developer, are left with a constant need to bring your coding agents up to speed. And the common tools and workflows teams use to bring these models up to speed are all pretty imperfect, leaving developers constantly playing catch up, when they should be focusing on the new features to be developed. This talk will introduce you to the emerging workflows to use open source tools to bring your coding agents up to speed, using efficient, frequent fine-tuning of coding models. We walk through how you can extend from the generalist coding intelligence capabilities and build internal tools that are regularly being proven to solve problems for your team.


Speaker

Jeff Smith

CEO & Co-Founder @ 2nd Set AI, AI Engineer, Researcher, Author, Ex-Meta/FAIR

Jeff Smith is an AI engineer, researcher, and entrepreneur. As the Co-Founder and CEO of 2nd Set AI, he’s working on the future of reasoning in generative AI. Previously, he was at Facebook/Meta, leading some of their most important AI initiatives including PyTorch, various fundamental methods breakthroughs in FAIR, and the productization of EMG-based neural wristbands. Prior to that, he had a long career across a range of AI and biotech startups, across the US, Asia, and Europe. He’s the author of technical books such as Machine Learning Systems from Manning, and he regularly talks about his work at conferences. His research focuses on efficient model learning methods and has resulted in the development of methods such as SHARe-KANs.

Read more

Date

Tuesday Mar 17 / 01:35PM GMT ( 50 minutes )

Location

Churchill (Ground Fl.)

Share

From the same track

Session AI/LLM

Reliable Retrieval for Production AI Systems

Tuesday Mar 17 / 10:35AM GMT

Search is central to many AI systems. Everyone is building RAG and agents right now, but few are building reliable retrieval systems.

Speaker image - Lan Chu

Lan Chu

AI Tech Lead and Senior Data Scientist

Session AI

Beyond Context Windows: Building Cognitive Memory for AI Agents

Tuesday Mar 17 / 11:45AM GMT

AI agents are rapidly changing how users interact with software, yet most agentic systems today operate with little to no intelligent memory, relying instead on brittle context-window heuristics or short-term state.

Speaker image - Karthik Ramgopal

Karthik Ramgopal

Distinguished Engineer & Tech Lead of the Product Engineering Team @LinkedIn, 15+ Years of Experience in Full-Stack Software Development

Session AI

Rewriting All of Spotify's Code Base, All the Time

Tuesday Mar 17 / 02:45PM GMT

We don't need LLMs to write new code. We need them to clean up the mess we already made.In mature organizations, we have to maintain and migrate the existing codebase. Engineers are constantly balancing new feature development with endless software upkeep.

Speaker image - Jo  Kelly-Fenton

Jo Kelly-Fenton

Engineer @Spotify

Speaker image - Aleksandar Mitic

Aleksandar Mitic

Software Engineer @Spotify

Session applied ai

Building an AI Gateway Without Frameworks: One Platform, Many Agents

Tuesday Mar 17 / 03:55PM GMT

Early AI integrations often start small: wrap an inference API, add a prompt, ship a feature. At Zoox, that approach grew into Cortex, a production AI gateway supporting multiple model providers, multiple modalities, and agentic workflows with dozens of tools, serving over 100 internal clients.

Speaker image - Amit Navindgi

Amit Navindgi

Staff Software Engineer @Zoox

Session

Sync Agents in Production: Failure Modes and Fixes

Tuesday Mar 17 / 05:05PM GMT

As models improve, we are starting to build long-running, asynchronous agents such as deep research agents and browser agents that can execute multi-step workflows autonomously. These systems unlock new use cases, but they fail in ways that short-lived agents do not.

Speaker image - Meryem Arik

Meryem Arik

Co-founder and CEO @Doubleword (previously TitanML)