Top-p / Top-k Sampling
Generative AI & LLMsChapter 4: Choosing the LLMTerm 67 of 253
Limits which candidate next tokens can be chosen, controlling diversity.
At Sunrise School
Gopal asksIs there another dial for creativity?
Bit answersTop-p limits me to the most likely words. For newsletters I use a higher top-p for variety; for fee answers I keep it low.
In the real worldPick only from the top 40 likely words.
Watch the short
Short coming soonSeason 5 · Day 14Follow @haigopala
Short coming soonSeason 5 · Day 14Follow @haigopala.telugu
Short coming soonSeason 5 · Day 14Follow @haigopala.hindi
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी