PEFT (Parameter-Efficient Fine-Tuning)
Model CustomisationChapter 7: Speaking in the School's VoiceTerm 118 of 253
Fine-tuning only a small part of the model to save cost and memory.
At Sunrise School
Gopal asksFull fine-tuning sounds expensive.
Bit answersParameter-efficient fine-tuning updates only a tiny part of the model. One GPU, a few hours.
In the real worldAdjust a few knobs, not the whole machine.
Watch the short
Short coming soonSeason 5 · Day 23Follow @haigopala
Short coming soonSeason 5 · Day 23Follow @haigopala.telugu
Short coming soonSeason 5 · Day 23Follow @haigopala.hindi
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी