In the era of human-robot interaction, creating truly engaging and intelligent robotic experiences requires real-time, low-latency communication, adaptive behavior, and seamless multimodal integration across text, speech, and vision. Azure The GPT-4o real-time API in Azure OpenAI Service unlocks new possibilities for robotics developers, enabling robots to process natural language and speech, interpret images and context, and generate dynamic responses with minimal latency.

In this talk, we’ll explore how real-time capabilities can power interactive backends for robotic and immersive applications, highlighting both its strengths and limitations. We’ll discuss the challenges encountered along the way, the feasibility of using this technology today, and whether it meets the demands of real-world applications or still needs additional capabilities.

Through live demos and practical examples, you’ll see how AI-powered robots can revolutionize entertainment, education, customer service, and beyond. Whether you’re a roboticist, AI engineer, or innovator looking to push the boundaries of human-machine interaction, this session will provide actionable insights to take your projects to the next level.

Join us to discover how Azure OpenAI is shaping the future of real-time, interactive robotic experiences!

Follow along:

• Create agentic AI solutions by using Azure AI Foundry
• Find the best model for your generative AI solution with Azure AI Foundry