Batch vs Real-time Inference
MLOps, LLMOps & DeploymentChapter 12: Going LiveTerm 214 of 253
Batch = process many records on a schedule; real-time = instant per request.
At Sunrise School
Gopal asksShould fee reminders be instant?
Bit answersReal-time for chats. Batch for reminders: every night at 8 PM, one job writes all 400 reminder messages.
In the real worldNightly scoring vs live chatbot.
Watch the short
Short coming soonSeason 5 · Day 43Follow @haigopala
Short coming soonSeason 5 · Day 43Follow @haigopala.telugu
Short coming soonSeason 5 · Day 43Follow @haigopala.hindi
Taught together with
Practise it
Try this term and all 253 others in the free Model Training Arena.
Open the Arena →Follow Bit daily: YouTube English · తెలుగు · हिंदी | Instagram English · తెలుగు · हिंदी