For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Providers
Learn how to configure agentgateway for a particular LLM provider.
Amazon Bedrock
Configuration and setup for Amazon Bedrock provider.
Anthropic
Configuration and setup for Anthropic Claude provider.
Azure
Configuration and setup for Azure OpenAI provider.
Gemini
Configuration and setup for Google Gemini provider.
OpenAI
Configuration and setup for OpenAI LLM provider.
OpenAI Realtime
OpenAI-compatible providers
Configuration and setup for arbitrary OpenAI-compatible LLM providers.
Vertex AI
Configuration and setup for Google Cloud Vertex AI provider.
GitHub Copilot
Configure GitHub Copilot with credentials from a Kubernetes Secret.
Multiple endpoints
Configure multiple endpoints for a single LLM provider.
TypeSafe
Configure TypeSafe Jev as an LLM provider for agentgateway.
Custom providers
Configure self-hosted and non-managed LLM providers with explicit API formats, paths, and backend …
Ollama
Configure agentgateway to route LLM traffic to Ollama for local model inference.
Mock LLM with httpbun
Use httpbun as a mock LLM backend for testing.
vLLM
Configure agentgateway to route traffic to vLLM for self-hosted model inference.
Backend tunnel proxy
Use the tunnel policy to route backend connections through an HTTP proxy for JWKS fetching and other …
Audio models
Configure self-hosted audio models such as Voxtral with passthrough routing for transcription …