Instrumenting & Evaluating LLMs
Hamel Husain. Hamel Husain, Eugene Yan, Brian Bischof, Harrison Chase, and Shreya Shankar working through tracing, log analysis, LLM-as-judge, and the workflow around looking at real production data. Sit with it the same way you would a long podcast — it is the single best deep treatment of the article's "look at your traces" thesis on YouTube.
What you should get from this
Connect tracing, evaluation, feedback and production review into an operating loop for LLM systems.
Watch next
Continue through the same learning path with the next curated companion videos.
104 minutesBuilding Agents with Model Context Protocol - Full Workshop with Mahesh Murag of Anthropic
Understand how MCP fits into agentic systems beyond a local demo server.
Watch next
29 minutesPrompting for Agents | Code w/ Claude
Decide which behavior belongs in the system prompt, tool description or tool precondition.
Watch next
19 minutesBuilding Production-Ready RAG Applications: Jerry Liu
Identify the production RAG controls missing from naive document-chat demos.
Watch nextRelated videos
4 minutesIntroducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings
32 minutesHow to Build Human-Centered AI Workflows in Localization with Shashi Bhushan
59 minutesFrom Hype to Habit: How Tech Companies Are Scaling AI Beyond the Experimental
41 minutesPrivate AI vs. Cloud: How Enterprise Leaders Can Make Smarter Build-or-Buy Decisions
Take it further
Hand-picked external courses that go deeper on this topic.
Coursera · DeepLearning.AIAI for Everyone
Six years after it launched, still the cleanest starting point for anyone who needs to understand AI without learning to code. No math, no jargon, no hype — you'll finish able to have an informed conversation about AI projects.
Coursera · The Wharton SchoolAI Strategy and Governance
Wharton's rigorous framing for executives making build-vs-buy decisions. Cuts through vendor pitches by focusing on the economics of AI deployment, algorithmic bias in hiring and operations, and the governance practices that survive an audit. Best taken before, not after, your next major AI procurement decision.