hAIgopala › AI terms › How Bit Really Learns › Day 29

LLM-as-a-Judge

Evaluation & MetricsChapter 10: Report Card for BitTerm 173 of 253

Using an LLM to grade another LLM's outputs against criteria.

At Sunrise School

Gopal asks

Who grades 200 written replies every night?

Bit answers

LLM-as-a-judge: another model scores each reply for accuracy, tone and completeness, from 1 to 5.

In the real world

Claude scores chatbot answers 1–5 for accuracy.

Watch the short

Short coming soonSeason 2 · Day 29Follow @haigopala

Quick check

Quick check. Should humans still spot-check the judge? Yes or no?

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी