Skip to main content

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

Go back

Scaling & Securing AI Workloads with GenAI Gateway Capabilities: Azure API Management

5 December, 2024 | 5:00 PM - 6:00 PM (UTC) Coordinated Universal Time

  • Format:
  • alt##LivestreamLivestream

Topic: Core AI

Language: English

As AI adoption accelerates, managing and scaling AI workloads securely has never been more critical. In this session, you’ll discover how the GenAI gateway capabilities in Azure API Management are purpose-built to manage machine learning models via APIs. Experience a unified control plane designed for seamless integration and governance.

Explore how to address the challenges of scalability, security, and resource allocation while leveraging large language models (LLMs) for your development needs. Engage in dynamic discussions on how to enforce token limits, enhance performance with semantic caching, and ensure enterprise-grade security and compliance across your environments. This session empowers your teams to innovate confidently and with minimal overhead.

What You’ll Learn:

  • Efficiently Scaling AI Workloads: Uncover how to leverage the GenAI gateway capabilities in Azure API Management to effectively manage AI workloads, facilitating growth and adaptability.

  • Implementing Token Management and Traffic Shaping: Learn the intricacies of enforcing token management, traffic shaping, and semantic caching for AI models, optimizing resource utilization.

  • Enhancing Security and Governance: Explore robust strategies to enhance security and governance across AI APIs, ensuring your organization adheres to compliance standards while fostering innovation.

Related Events

The events below may be of interest to you as well. Be sure to visit our Reactor homepage to see all available events.

For questions please contact us at reactor@microsoft.com