Catastrophic Forgetting
Model CustomisationChapter 7: Speaking in the School's VoiceTerm 120 of 253
When fine-tuning makes the model forget what it previously knew.
At Sunrise School
Gopal asksAfter fine-tuning, Bit forgot basic maths!
Bit answersCatastrophic forgetting. Mix general examples into training, or use LoRA, so I keep my old skills.
In the real worldLearning French makes you forget Spanish.
Watch the short
Short coming soonSeason 5 · Day 24Follow @haigopala
Short coming soonSeason 5 · Day 24Follow @haigopala.telugu
Short coming soonSeason 5 · Day 24Follow @haigopala.hindi
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी