hAIgopala › AI terms › Rapid Fire (3 terms per short) › Day 5

Self-supervised Learning

Learning TypesChapter 1: Learning from EnquiriesTerm 24 of 253

Model creates its own labels from the data itself. This is how LLMs are pre-trained.

At Sunrise School

Gopal asks

How did the language brain learn English with no labels at all?

Bit answers

Self-supervised learning: hide a word and predict it. “School reopens on ___” → “Monday”. Repeated billions of times.

In the real world

Hide the next word and predict it.

Watch the short

Short coming soonSeason 5 · Day 5Follow @haigopala

Quick check

Quick check. Is self-supervised learning how LLMs are pre-trained? Yes or no?

Taught together with

Time Series Forecasting · Recommendation System

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी