LoRA / QLoRA
Model CustomisationChapter 7: Speaking in the School's VoiceTerm 119 of 253
Popular PEFT method adding small trainable adapters; QLoRA also quantises the model to save memory.
At Sunrise School
Gopal asksWhich method is popular?
Bit answersLoRA adds small adapter layers. We keep one adapter for parents and another for students.
In the real worldClip-on lens rather than a new camera.
Watch the short
Short coming soonSeason 5 · Day 24Follow @haigopala
Short coming soonSeason 5 · Day 24Follow @haigopala.telugu
Short coming soonSeason 5 · Day 24Follow @haigopala.hindi
Quick check
Quick check. Can fine-tuning make a model worse at old skills? Yes or no?
Yes! Mix in general examples to prevent it.
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी