hAIgopala › AI terms › Build Bit in 30 Days › Day 13

Transformer

Generative AI & LLMsChapter 4: Choosing the LLMTerm 68 of 253

The neural network architecture behind modern LLMs (2017 paper 'Attention Is All You Need').

At Sunrise School

Gopal asks

What's the design inside the LLM?

Bit answers

A Transformer. It reads the whole message at once, uses attention to connect the words, then predicts my reply token by token.

In the real world

Engine inside every modern LLM.

Watch the short

Short coming soonSeason 1 · Day 13Follow @haigopala

Quick check

Quick check. Does a Transformer read one word at a time and forget the rest? Yes or no?

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी