Lesson 3.312mAdvanced5.4k students

Evaluating retrieval

Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.

This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.

In this lesson you will

  • Build a query set with known correct passages
  • Measure recall and precision at k
  • Separate retrieval failures from generation failures

Resources