RAG Agents in Prod: 10 Lessons We Learned — Douwe Kiela, creator of RAG

17 minutesAdvancedStrategicAI EngineerAI for Business

AI Engineer. Douwe Kiela led the original RAG paper at FAIR and now ships RAG into regulated enterprises. The talk is mostly about what stops working at scale — chunking strategies that don't survive 100k documents, "accuracy is table stakes, inaccuracy is the real problem," and why attribution and observability matter more than the embedding model. Good calibration before re-reading the article's eval and monitoring sections.

AI Expert note

Strong production cautionary material. Use it to pressure-test architecture decisions, especially permissions, attribution, observability and user trust, before debating embedding-model minutiae.

What you should get from this

Understand what breaks when RAG moves into regulated, high-stakes enterprise use.

Watch or know first

Know the basic RAG pipeline and why attribution matters.

Last reviewed: May 18, 2026

Watch next

Continue through the same learning path with the next curated companion videos.