hAIgopala › AI terms › Rapid Fire (3 terms per short) › Day 24

Catastrophic Forgetting

Model CustomisationChapter 7: Speaking in the School's VoiceTerm 120 of 253

When fine-tuning makes the model forget what it previously knew.

At Sunrise School

Gopal asks

After fine-tuning, Bit forgot basic maths!

Bit answers

Catastrophic forgetting. Mix general examples into training, or use LoRA, so I keep my old skills.

In the real world

Learning French makes you forget Spanish.

Watch the short

Short coming soonSeason 5 · Day 24Follow @haigopala

Taught together with

LoRA / QLoRA · Reward Model

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी