LLM consumption
Consume services from LLM providers.
About
Overview of supported LLM providers and their capabilities.
Model aliasing
Map custom model names to specific LLM provider models.
Providers
Learn how to configure agentgateway for a particular LLM provider.
API keys
Manage API keys for LLM provider authentication.
Cost controls
Attribute, observe, enforce, and optimize LLM spend through agentgateway.
Load balancing
Distribute requests across multiple LLM providers automatically (Power of Two Choices, P2C).
Model failover
Priority-based failover across LLM providers (automatic fallback when models fail or are …
Content-based routing
Route requests to different LLM backends based on request body content, such as the requested model …
Streaming
Stream responses from the LLM to the end user through Solo Enterprise for agentgateway.
Function calling
Learn how function calling works through agentgateway.
Guardrails
Protect LLM interactions with prompt guards that evaluate and filter requests and responses for …
Prompt enrichment
Prepend, append, or replace system prompts for LLM requests.
Prompt templates
Use static and dynamic prompt templates to customize LLM requests.
Request transformations
Dynamically compute and set LLM request fields using CEL expressions.
Rate limiting for LLMs
Rate limit requests through Solo Enterprise for agentgateway.
CEL-based RBAC
Use CEL expressions to control access to LLM models and providers.
Metrics and logs
View LLM metrics, track per-user usage, and review logs.