Ishaan Sehgal
Microsoft
LEARN, CONNECT, BUILD
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
LEARN, CONNECT, BUILD
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
28 February, 2024 | 5:00 PM - 6:30 PM (UTC) Coordinated Universal Time
Topic: Microservices & APIs
Language: English
Join us to learn how to run open-source Large Language Models (LLMs) with HTTP-based inference endpoints inside your AKS cluster using the Kubernetes AI Toolchain Operator (KAITO). We’ll walk through the setup and deployment of containerized LLMs on GPU node pools and see how KAITO can help reduce operational burden of provisioning GPU nodes and tuning model deployment parameters to fit GPU profiles.
Speakers
This event is part of the Learn Live: Intelligent Apps on AKS Series.
Click here to visit the Series Page where you could see all the upcoming and on-demand events.
For questions please contact us at reactor@microsoft.com