Next-Token Prediction
Generative AI & LLMsChapter 4: Choosing the LLMTerm 65 of 253
LLMs generate text one token at a time by predicting the most likely next token.
At Sunrise School
Gopal asksHow does Bit actually write a sentence?
Bit answersOne token at a time. “Admissions close on” → most likely next token “15” → then “March”. Every word is a prediction.
In the real worldSuper-powered autocomplete.
Watch the short
Short coming soonSeason 2 · Day 14Follow @haigopala
Short coming soonSeason 2 · Day 14Follow @haigopala.telugu
Short coming soonSeason 2 · Day 14Follow @haigopala.hindi
Quick check
Quick check. Does Bit plan the whole sentence first? Yes or no?
No! It predicts one token, then the next.
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी