Instrumenting & Evaluating LLMs

154 minutesAdvancedBuilderHamel HusainAI for Business

Hamel Husain. Hamel Husain, Eugene Yan, Brian Bischof, Harrison Chase, and Shreya Shankar working through tracing, log analysis, LLM-as-judge, and the workflow around looking at real production data. Sit with it the same way you would a long podcast — it is the single best deep treatment of the article's "look at your traces" thesis on YouTube.

AI Expert note

Two and a half hours with tiny view numbers, kept deliberately: there is no comparable long-form treatment of trace-driven evaluation, so sit with it like a long podcast.

What you should get from this

Connect tracing, evaluation, feedback and production review into an operating loop for LLM systems.

Watch or know first

Production LLM experience — it assumes you have real traces and logs worth analysing.

Last reviewed: May 18, 2026

Watch next

Continue through the same learning path with the next curated companion videos.