AI Evaluation and Reliability

Measure model and agent behavior, expose failure modes, instrument the runtime, and build release and incident controls around evidence.

1. phases/02-ml-fundamentals/09-model-evaluation — 90 min
2. phases/11-llm-engineering/10-evaluation — 45 min
3. phases/14-agent-engineering/30-eval-driven-agent-development — 60 min
4. phases/14-agent-engineering/26-failure-modes-agentic — 60 min
5. phases/14-agent-engineering/23-otel-genai-conventions — 60 min
6. phases/17-infrastructure-and-production/08-inference-metrics-goodput — 60 min
7. phases/17-infrastructure-and-production/13-llm-observability — 60 min
8. phases/17-infrastructure-and-production/21-ab-testing-llm-features — 60 min
9. phases/17-infrastructure-and-production/22-load-testing-llm-apis — 75 min
10. phases/17-infrastructure-and-production/20-shadow-canary-progressive — 60 min
11. phases/17-infrastructure-and-production/24-chaos-engineering-llm — 60 min
12. phases/17-infrastructure-and-production/23-sre-for-ai — 60 min