At Evidently AI, we are building tools to evaluate, test and monitor LLM and ML-powered systems.

8. Tutorial: Adversarial testing for LLM applications
13:24
8. Tutorial: Adversarial testing for LLM applications
7. Tutorial: Building and evaluating an AI agent
17:35
7. Tutorial: Building and evaluating an AI agent
6.2. Tutorial: Building and evaluating a RAG system
16:13
6.2. Tutorial: Building and evaluating a RAG system
6.1 How to evaluate a RAG system: methods and metrics
7:08
6.1 How to evaluate a RAG system: methods and metrics
5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.
26:01
5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.
4. Tutorial: Evaluating LLMs on classification tasks
19:01
4. Tutorial: Evaluating LLMs on classification tasks
3. Tutorial: How to create an LLM judge and align with human labels
24:24
3. Tutorial: How to create an LLM judge and align with human labels
2.3. Tutorial on LLM evaluation methods: Reference-free evals.
14:07
2.3. Tutorial on LLM evaluation methods: Reference-free evals.
2.2. Tutorial on LLM evaluation methods: Reference-based evals.
10:26
2.2. Tutorial on LLM evaluation methods: Reference-based evals.
2.1. Tutorial on LLM evaluation methods. Overview and Basic API.
10:13
2.1. Tutorial on LLM evaluation methods. Overview and Basic API.
1. Introduction to LLM evaluations in 10 key ideas
11:43
1. Introduction to LLM evaluations in 10 key ideas
LLM evaluation for builders - Course announcement
1:43
LLM evaluation for builders - Course announcement
How to run LLM evals with no code | PRACTICE
12:27
How to run LLM evals with no code | PRACTICE
How to continuously improve LLM products?
2:34
How to continuously improve LLM products?
A business case for LLM evaluations
4:06
A business case for LLM evaluations
AI agent and RAG evaluation
6:05
AI agent and RAG evaluation
LLM observability in production: tracing and online evals
5:09
LLM observability in production: tracing and online evals
LLM safety and red-teaming
5:11
LLM safety and red-teaming
LLM-as-a-judge: evaluating LLMs with LLMs
5:41
LLM-as-a-judge: evaluating LLMs with LLMs
LLM evaluation methods and metrics
5:10
LLM evaluation methods and metrics
LLM evaluation datasets: test cases and synthetic data
6:06
LLM evaluation datasets: test cases and synthetic data
How to evaluate an LLM application
6:00
How to evaluate an LLM application
LLM evaluation benchmarks
3:07
LLM evaluation benchmarks
What is an LLM-powered product?
3:08
What is an LLM-powered product?
Welcome to the LLM evaluation course
1:32
Welcome to the LLM evaluation course
Open-source LLM Evaluation with Evidently - Intro
2:30
Open-source LLM Evaluation with Evidently - Intro
LLM Evaluation Tutorial with Evidently
35:45
LLM Evaluation Tutorial with Evidently
6.5. Connecting the dots: full-stack ML observability.
5:21
6.5. Connecting the dots: full-stack ML observability.
6.4. ML monitoring with Evidently and Grafana. [OPTIONAL CODE PRACTICE]
25:03
6.4. ML monitoring with Evidently and Grafana. [OPTIONAL CODE PRACTICE]
6.3. ML model monitoring dashboard with Evidently. Online architecture. [CODE PRACTICE]
21:30
6.3. ML model monitoring dashboard with Evidently. Online architecture. [CODE PRACTICE]