For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Cost controls
Attribute, observe, enforce, and optimize LLM spend through agentgateway.
Virtual keys
Issue API keys with per-key token budgets and cost tracking (also known as virtual keys).
Invoice-grade attribution
Carry a validated caller identity into AWS and Google Cloud billing records, so LLM spend is …
Model costs
Price LLM requests with a model cost catalog and expose realized USD costs in logs, traces, and …
LLM cost tracking
Track and monitor LLM costs per request using token usage metrics.
Budget and spend limits
Combine global USD or token spending limits with budgets for teams, users, and API keys by using the …
Cost dashboard
Explore LLM spend, model prices, budgets, and virtual keys in the Cost Management section of the …