hAIgopala › AI terms › SAP + AI › Day 3

GPU

Infrastructure & HardwareChapter 13: The Engine RoomTerm 221 of 253

Graphics processor that performs many calculations in parallel; essential for training and inference.

At Sunrise School

Gopal asks

What runs the models behind the API?

Bit answers

GPUs: thousands of small cores doing the maths in parallel. That's why answers take seconds, not hours.

In the real world

NVIDIA H100, H200, B200.

Watch the short

Short coming soonSeason 4 · Day 3Follow @haigopala

Quick check

Quick check. Are GPUs used only for games? Yes or no?

Practise it

Try this term and all 253 others in the free Model Training Arena.

Open the Arena →

Follow Bit daily: YouTube English · తెలుగు · हिंदी  |  Instagram English · తెలుగు · हिंदी