hAIgopala › AI terms › Rapid Fire (3 terms per short) › Day 36

A/B Testing

Evaluation & MetricsChapter 10: Report Card for BitTerm 179 of 253

Comparing two versions with real users to see which performs better.

At Sunrise School

Gopal asks

Is the new prompt actually better with real parents?

Bit answers

A/B test: half the parents get prompt A, half get B. B earns 12% more thumbs-up, so B becomes the default.

In the real world

Prompt v1 vs v2 on 50% of users each.

Watch the short

Short coming soonSeason 5 · Day 36Follow @haigopala

Taught together with

BLEU / ROUGE · Benchmark

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी