Manage budgets
Use the Budgets screen to set organization defaults and limits for users and groups. AI Gateway v2 enforces the same budgets the console manages.
Budget enforcement denies model requests from callers without an applicable budget. Configure an organization default before you connect the gateway to the budgets service. See Budgets and pricing for enforcement and API details.
Set the organization default
On the Defaults tab, set the limit and period applied to users without an explicit budget.
Group budgets
The Group Budgets tab lists each group's Period, Budget, Used, and Utilization. Select Create Group Budget, then choose a group, daily, monthly, or yearly period, and limit. Budget periods align with the calendar.
Use Priority, called precedence in the API, to order applicable group
budgets. The gateway charges a user's explicit budget, or the organization
default, first. It then charges the first group budget with remaining capacity,
in ascending priority order.
User budgets
The User Budgets tab lists each user's Budget source, Period, and Limit. Default identifies the organization default, and Custom identifies an explicit user budget. Select Edit Budgets to update multiple users.
Changes take effect on the next request and preserve current-period usage. Raise an exhausted user's limit to restore access before the period resets.
Next steps
- Budgets and pricing for how enforcement behaves and how to do the same things over the API.
- Users and groups for the records budgets are addressed to.