hAIgopala › AI terms › How Bit Really Learns › Day 14

Next-Token Prediction

Generative AI & LLMsChapter 4: Choosing the LLMTerm 65 of 253

LLMs generate text one token at a time by predicting the most likely next token.

At Sunrise School

Gopal asks

How does Bit actually write a sentence?

Bit answers

One token at a time. “Admissions close on” → most likely next token “15” → then “March”. Every word is a prediction.

In the real world

Super-powered autocomplete.

Watch the short

Short coming soonSeason 2 · Day 14Follow @haigopala

Quick check

Quick check. Does Bit plan the whole sentence first? Yes or no?

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी