Evals
Evaluation & MetricsChapter 10: Report Card for BitTerm 159 of 253
Custom test suites to measure whether YOUR AI application works for YOUR use case.
At Sunrise School
Gopal asksAnd then?
Bit answersRun evals: automatically test me on all 200 after every change to the prompt or documents. No surprise regressions.
In the real world100 real tickets with expected answers.
Watch the short
Short coming soonSeason 1 · Day 26Follow @haigopala
Short coming soonSeason 1 · Day 26Follow @haigopala.telugu
Short coming soonSeason 1 · Day 26Follow @haigopala.hindi
Quick check
Quick check. Should evals run again after every change? Yes or no?
Yes! Any change can break something you didn't touch.
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी