55 minutesHow to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)
Design an eval ladder that catches regressions before prompt or model changes reach users.
Anthropic. A live build session by Anthropic's Applied AI team on an insurance-claims prompt — they start with a vague instruction and iterate to something a developer would actually ship, showing the kind of revisions the article describes for the system and developer layers. Watch this before re-reading the article's checklist on examples, output structure, and refusal handling.
Watch it for the iteration, not the final prompt — the insurance-claims build shows the system- and developer-layer revisions the article's checklist encodes.
Watch a vague insurance-claims prompt become a structured, testable prompt with clearer examples, output rules and refusal behavior.
Basic prompting fluency; the article's layer model gives you the right lens.
Last reviewed: May 18, 2026
Continue through the same learning path with the next curated companion videos.
55 minutesDesign an eval ladder that catches regressions before prompt or model changes reach users.
9 minutesYou can navigate traces, projects and datasets in LangSmith and read off token cost, latency, error rate and per-span detail.
75 minutesBuild a first MCP server and understand how tools, schemas, prompts, resources and transports fit together.
Hand-picked external courses that go deeper on this topic.
Isa Fulford · Andrew Ng
Ninety minutes to a year's worth of intuition. If you've started writing code that calls an LLM — or you're about to — this is the most efficient course online for closing the gap between "playing with ChatGPT" and "shipping a feature that calls an LLM."
Microsoft Learn
Prompt engineering, but for the tool most office workers will actually touch first. Microsoft's own four-part prompting framework (goal, context, source, expectation) is a genuinely useful mental model, and unlike the generic ChatGPT prompting courses already in our catalog, this one is grounded entirely in Microsoft 365 Copilot's specific quirks and grounding behavior.