Anish Shah
Weights & Biases
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
Go back
Building a LLM Judge with Weights & Biases
29 October, 2024 | 5:00 PM - 6:00 PM (UTC) Coordinated Universal Time
- Format:
Livestream
Topic: Intelligent Applications
Language: English
Evaluating LLM outputs accurately is critical to being able to iterate quickly on a LLM system. Human annotations can be slow and expensive and using LLMs instead promises to solve this. However, aligning a LLM Judge with human judgements is often hard with many implementation details to consider. In this workshop we will explore:
- Evaluating specialized LLMs using Weave
- Productionizing the latest LLM-as-a-judge research
- Improving on your existing judge
- Building annotation UIs
Speakers
Related Events
The events below may be of interest to you as well. Be sure to visit our Reactor homepage to see all available events.
-
Building Multi AI Agent Systems
Building Multi AI Agent Systems
Format:
Livestream
Topic: Intelligent Applications
Language: English
-
Fine-Tuning the GPT model series for Agent Applications w/ W&B + Azure OpenAI Service
Fine-Tuning the GPT model series for Agent Applications w/ W&B + Azure OpenAI Service
Format:
Livestream
Topic: Intelligent Applications
Language: English
This event is part of the Weights & Biases Series.
Click here to visit the Series Page where you could see all the upcoming and on-demand events.