LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

Go back

RAGChat: Evaluating RAG answer quality

10 February, 2025 | 11:30 PM - 12:30 AM (UTC) Coordinated Universal Time

  • Format:
  • alt##LivestreamLivestream

Topic: Intelligent Applications

Language: English

In this series, we dive deep into our most popular, fully-featured, and open-source RAG solution: https://aka.ms/ragchat

How can you be sure that the RAG chat app answers are accurate, clear, and well formatted? Evaluation!
In this session, we'll show you how to generate synthetic data and run bulk evaluations on your RAG app, using the azure-ai-evaluation SDK. Learn about GPT metrics like groundedness and fluency, and custom metrics like citation matching. Plus, discover how you can run evaluations on CI/CD, to easily verify that new changes don't introduce quality regressions.

📌 Get more RAG resources!
  • RAG

Speakers

  • Pamela Fox

    • Principal Cloud Advocate in Python

    Microsoft

Related Events

The events below may be of interest to you as well. Be sure to visit our Reactor homepage to see all available events.

For questions please contact us at reactor@microsoft.com