Skip to main content
megaphone icon

AI Dev Days Hackathon

Build production‑ready AI during our global hack using Microsoft’s latest AI, agent, and dev tools to solve real‑world problems and compete for prizes.

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

Go back

RAGChat: Evaluating RAG answer quality

10 February, 2025 | 11:30 PM - 12:30 AM (UTC) Coordinated Universal Time

  • Format:
  • alt##LivestreamLivestream

Topic: AI Applications

Language: English

In this series, we dive deep into our most popular, fully-featured, and open-source RAG solution: https://aka.ms/ragchat

How can you be sure that the RAG chat app answers are accurate, clear, and well formatted? Evaluation!
In this session, we'll show you how to generate synthetic data and run bulk evaluations on your RAG app, using the azure-ai-evaluation SDK. Learn about GPT metrics like groundedness and fluency, and custom metrics like citation matching. Plus, discover how you can run evaluations on CI/CD, to easily verify that new changes don't introduce quality regressions.


📌 Get more RAG resources!

  • RAG

Speakers

Related Events

The events below may be of interest to you as well. Be sure to visit our Reactor homepage to see all available events.