ML in Practice — Lightweight MLOps
Back to Serving and Deployment

Quiz: Latency Budgets and Optimization

Latency is a contract. Setting one explicitly and optimizing for it produces a system you can actually run.

7 minutesInteractive tutorial
🎯 Free Guest Mode: You are learning for free. Sign in to save your completion progress and quiz answers.
Question 1 of 9Answer saved0 answered

Why must machine learning latency budgets be evaluated against p99 latency rather than average (mean) latency?

← Back to Scaling — Autoscaling, Latency Budgets, Caching