The explosion of interest in Large Language Models (LLMs) and other Foundation Models (FMs) over the past two years has meant that more organizations want to know what it takes to run solutions using these models in production. In this talk, Andy will share his learnings on how to organise your people and technology to take full advantage of these capabilities and run production grade solutions at scale. He will discuss common architectures, emerging team structures and how evaluation and monitoring practices need to be upgraded for the GenAI era. This talk is useful for anyone involved in the deployment and operations of systems where the latest wave of machine learning models play a role.
Andrew McMahon
Andrew (Andy) McMahon is a Principal Engineer within the AI COE at Barclays where he works on building the latest generation of machine learning and AI products to support colleagues and customers across the world. Andy is a well-known thought-leader in the practical implementation of MLOps, Generative AI and ML engineering, with experience developing these capabilities in several organisations. He has lectured at leading universities on these topics and is a sought after public speaker. He is also the author of a popular technical book, Machine Learning Engineering with Python (Packt).