Token
Generative AI & LLMsChapter 4: Choosing the LLMTerm 61 of 253
A chunk of text the model processes (~4 characters or ~0.75 words in English). Cost and limits are measured in tokens.
At Sunrise School
Gopal asksThe API bill talks about tokens. What are they?
Bit answersTokens are chunks of text, about 4 characters each. A parent's question plus my reply is around 300 tokens.
In the real world'unbelievable' → 'un' 'believ' 'able'.
Watch the short
Short coming soonSeason 1 · Day 10Follow @haigopala
Short coming soonSeason 1 · Day 10Follow @haigopala.telugu
Short coming soonSeason 1 · Day 10Follow @haigopala.hindi
Quick check
Quick check. Does a longer reply cost more? Yes or no?
Yes! More tokens out means a bigger bill.
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी