Budgets: Control LLM Spend in MLflow

Video by MLflow via YouTube
Budgets: Control LLM Spend in MLflow

MLflow Ambassador Shrinath Suresh continues the MLflow A–Z series with B for Budget Policy.

See how to set an AI Gateway budget in the MLflow UI. You pick a threshold, a daily, weekly, or monthly window, and an action: raise an alert or reject subsequent requests. That helps you avoid overnight bill spikes when API-based experiments or an agent loop run away.

Learn more: https://mlflow.org/docs/latest/genai/governance/ai-gateway/budget-alerts-limits/

#MLflow #GenAI #LLMOps

Source