Lesson 1.28mIntermediate25k students
Temperature and sampling
Sampling parameters decide how the next token is picked. Low temperature for extraction and classification, higher for anything that should feel varied.
This lesson sits in LLM Fundamentals, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will
- Trade determinism against variety with temperature
- Know what top-p changes and when to touch it
- Pick settings per task rather than globally
Resources
Your notes for this lesson will appear here.