hAIgopala › AI terms › Rapid Fire (3 terms per short) › Day 15

Encoder vs Decoder

Generative AI & LLMsChapter 4: Choosing the LLMTerm 71 of 253

Encoder understands input (BERT); decoder generates output (GPT/Claude). Some models use both (T5).

At Sunrise School

Gopal asks

Which type of model writes replies?

Bit answers

Decoders like Claude and GPT generate text. Encoders like BERT understand text, which is great for classifying enquiries quickly.

In the real world

Reader vs writer.

Watch the short

Short coming soonSeason 5 · Day 15Follow @haigopala

Quick check

Quick check. Is a raw pre-trained model already polite and helpful? Yes or no?

Taught together with

Mixture of Experts (MoE) · Post-training / Alignment

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी