Speaker
Abstract
As large language models (LLMs) emerge from the realm of proof-of-concept (POC) and into mainstream production, the demand for effective architectural strategies intensifies. This session delves into the intricacies of designing and implementing intelligent systems powered by these powerful tools, drawing upon practical insights gained from real-world deployments.
We'll embark on a journey to unravel the complexities of LLMs, delving into the diverse array of patterns and techniques that can be employed to harness their capabilities. From fine-tuning and zero-shot learning to context-aware modeling and prompt engineering, we'll explore a spectrum of approaches to suit various problem domains.
Along the way, we'll uncover the potential pitfalls that can arise when integrating LLMs into existing architectures. We'll discuss latency considerations, tokenization challenges, and the need for comprehensive guardrails to ensure the safe and reliable operation of these systems.
To effectively manage and scale LLM-driven architectures, we'll explore the role of new technologies and tools, such as LLMOps platforms, multi-modal models, and Llama-indexing techniques. We'll also address the need for continuous learning and upskilling within teams to adapt to the evolving landscape of intelligent systems.
Join us as we explore the transformative potential of large language models and gain practical guidance on architecting intelligent systems for the future. This session is designed for directors of data/ML, data and ML architects, data scientists, ML engineers, data engineers, product managers, and UX designers seeking to navigate the ever-expanding realm of LLMs.
Interview
The last year has been a journey into building and enabling products with Large Language Models. This involves everything from proof of concepts, to bringing systems into production in the enterprise landscape with different variants of LLM usage, upskilling teams and learning about what it takes to monitor and observe LLMs.
There is a lot that has happened in the past 16-18 months in the field of AI. 2023 was the year of POCs across organizations around the world, 2024 will be the year of bringing the successful POCs into production. This has an impact on the architecture and design of the systems, and my motivation is to share my learnings with the community and learn from the conversations, as this area of bringing LLMs into production is fairly nascent.
This session is designed for directors of data/ML, data and ML architects, data scientists, ML engineers, data engineers, product managers, and UX designers seeking to navigate the ever-expanding realm of LLMs.
A sneak peek into different architecture patterns one could implement to enable LLMs in their products.
There is so much to engineering systems, which include people, processes, and technologies, and you are going to constantly experience change, and it's very important to accept that.
Topics
QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architecture for the Age of AI Hosted by Fabiane Nardon Data Expert, Java Champion & Data Platform Director @totvsFrom the same track
Tuesday 9 April
10:35 Churchill (Ground Fl.) Session When AIOps Meets MLOps: What Does It Take To Deploy ML Models at Scale Ghida Ibrahim Chief Architect, Head of Data @Sector Alarm Group, Ex-Facebook/Meta In this talk, we introduce the concept of AIOps referring to using AI and data-driven tooling to provision, manage and scale distributed IT infra. We particularly focus on how AIOps can be leveraged to help train and deploy machine learning models and pipelines at scale. 11:45 Fleming (3rd Fl.) Session AI/ML Mind Your Language Models: An Approach to Architecting Intelligent Systems Nischal HP Vice President of Data Science @Scoutbee, Decade of Experience Building Enterprise AI As large language models (LLMs) emerge from the realm of proof-of-concept (POC) and into mainstream production, the demand for effective architectural strategies intensifies. 13:35 Rutherford (4th Fl.) Event Connecting the Dots: Applying Generative AI (Limited Space - Registration Required) Details coming soon. 14:45 Windsor (5th Fl.) Session Flawed ML Security: Mitigating Security Vulnerabilities in Data & Machine Learning Infrastructure with MLSecOps Adrian Gonzalez-Martin Senior MLOps Engineer, Previously Leader of the MLServer Project @Seldon The operation and maintenance of large scale production machine learning systems has uncovered new challenges which require fundamentally different approaches to that of traditional software. 15:55 Fleming (3rd Fl.) Session Large Language Models for Code: Exploring the Landscape, Opportunities, and Challenges Loubna Ben Allal Machine Learning Engineer @Hugging Face In the rapidly evolving landscape of software development, Large Language Models (LLMs) for code have emerged as a groundbreaking tool for code completion, synthesis and analysis. 17:05 Whittle (3rd Fl.) Session AI/ML Lessons Learned From Building LinkedIn’s AI Data Platform Felix GV Principal Staff Engineer @LinkedIn Taking AI from lab to business is notoriously difficult. It is not just about picking which model flavor of the day to use. More important is making every step of the process reliable and productive.