Encoder vs Decoder
Generative AI & LLMsChapter 4: Choosing the LLMTerm 71 of 253
Encoder understands input (BERT); decoder generates output (GPT/Claude). Some models use both (T5).
At Sunrise School
Gopal asksWhich type of model writes replies?
Bit answersDecoders like Claude and GPT generate text. Encoders like BERT understand text, which is great for classifying enquiries quickly.
In the real worldReader vs writer.
Watch the short
Short coming soonSeason 5 · Day 15Follow @haigopala
Short coming soonSeason 5 · Day 15Follow @haigopala.telugu
Short coming soonSeason 5 · Day 15Follow @haigopala.hindi
Quick check
Quick check. Is a raw pre-trained model already polite and helpful? Yes or no?
No! Post-training teaches it to help.
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी