36 free lessons on evaluating, measuring, and improving AI-powered products. Full slide decks with written explanations. Weekly quizzes and a certification exam.
What you'll learn
Design observable AI systems with proper logging and trace architecture
Run structured failure analysis on production data
Translate AI quality metrics to user behavior and business results
Build evaluation workflows from offline tests through production monitoring
Make ship/iterate/pause/rollback decisions based on evaluation data