hAIgopala › AI terms › Rapid Fire (3 terms per short) › Day 14

Top-p / Top-k Sampling

Generative AI & LLMsChapter 4: Choosing the LLMTerm 67 of 253

Limits which candidate next tokens can be chosen, controlling diversity.

At Sunrise School

Gopal asks

Is there another dial for creativity?

Bit answers

Top-p limits me to the most likely words. For newsletters I use a higher top-p for variety; for fee answers I keep it low.

In the real world

Pick only from the top 40 likely words.

Watch the short

Short coming soonSeason 5 · Day 14Follow @haigopala

Taught together with

Max Tokens · Multi-Head Attention

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी