BLEU / ROUGE
Evaluation & MetricsChapter 10: Report Card for BitTerm 177 of 253
Metrics comparing generated text with reference text (translation / summarisation).
At Sunrise School
Gopal asksHow do we score translations and summaries?
Bit answersBLEU and ROUGE compare word overlap with a reference written by staff. Quick, but they miss meaning, so we add a judge too.
In the real worldWord-overlap scores.
Watch the short
Short coming soonSeason 5 · Day 36Follow @haigopala
Short coming soonSeason 5 · Day 36Follow @haigopala.telugu
Short coming soonSeason 5 · Day 36Follow @haigopala.hindi
Quick check
Quick check. Do public benchmarks prove which model is best for our school? Yes or no?
No! Our own evals on school questions decide.
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी