hAIgopala › AI terms › Build Bit in 30 Days › Day 10

Token

Generative AI & LLMsChapter 4: Choosing the LLMTerm 61 of 253

A chunk of text the model processes (~4 characters or ~0.75 words in English). Cost and limits are measured in tokens.

At Sunrise School

Gopal asks

The API bill talks about tokens. What are they?

Bit answers

Tokens are chunks of text, about 4 characters each. A parent's question plus my reply is around 300 tokens.

In the real world

'unbelievable' → 'un' 'believ' 'able'.

Watch the short

Short coming soonSeason 1 · Day 10Follow @haigopala

Quick check

Quick check. Does a longer reply cost more? Yes or no?

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी