play_circle
Get started
Install agentgateway
LLM (OpenAI)
MCP servers
Non-agentic HTTP
lightbulb
About
Overview
Architecture
login
Gateway setup
Set up an agentgateway
Listeners
Listener overview
HTTP
HTTPS
mTLS (FrontendTLS)
TCP
Additional TLS settings
Customize the gateway
Customization options
Customize the gateway
Example configs
settings
Install
Helm
ArgoCD
Licensing
Install in air-gapped environments
Solo UI
Set up the UI
Explore the UI
Expose the UI via HTTPS
Sample app
Advanced settings
psychology
LLM consumption
About
Model aliasing
Providers
Amazon Bedrock
Anthropic
Azure OpenAI
Gemini
OpenAI
OpenAI-compatible providers
Vertex AI
Multiple endpoints
Ollama
Mock LLM with httpbun
vLLM
API keys
Virtual keys
Load balancing
Model failover
Content-based routing
Streaming
Function calling
Guardrails
About guardrails
Regex filters
OpenAI moderation
AWS Bedrock Guardrails
Google Model Armor
Custom webhooks
Guardrail webhook guide
Webhook API reference
Multi-layered guardrails
Prompt enrichment
Prompt templates
Request transformations
Budget and spend limits
Rate limiting for LLMs
LLM cost tracking
CEL-based RBAC
Metrics and logs
dashboard
MCP connectivity
About
Static MCP
Dynamic MCP
Virtual MCP
Connect via HTTPS
MCP auth
About MCP auth
Set up Keycloak
Set up MCP auth
Token exchange
About token exchange
On behalf of (OBO) tokens
Impersonation
Delegation
External IdP with Entra ID
Elicitations
About elicitations
Set up the elicitation infrastructure
Original elicitations
JWT auth for services
Control access to tools
Rate limiting for MCP
Stateful MCP
component_exchange
Inference routing
groups
Agent connectivity
About
Connect to an agent
arrow_split
Traffic management
Buffering
Direct responses
Dynamic Forward Proxy (DFP)
External processing (ExtProc)
gRPC routing
Header control
Request headers
Response headers
Early request header modification
Matching
Header
Host
HTTP method
Path
Query parameter
Redirects
HTTPS redirect
Host redirect
Path redirects
Rewrites
Host rewrites
Path rewrites
Transformations
Transformation templating language
Log CEL variables in access logs
Encode and decode headers
Filter request body fields
Inject LLM model headers
Forward request URL as header
Inject response body
Inject response headers
Rewrite path and method
Promote query parameters to headers
Remove request headers
Rewrite path segments
Update response status
Distributed tracing headers
Validate and default field values
Traffic splitting
handshake
Resiliency
HTTP connection settings
Keepalive
Retries
About
Request retries
Per-try timeout
Timeouts
About
Request timeouts
Idle timeouts
Per-try timeout
encrypted
Security
Access logging
BackendTLS
CORS
CSRF
External auth
API key auth
Basic auth
OAuth
About OAuth
Access token validation
Authorization code
Keycloak as an IdP
MS Entra ID as an IdP
BYO ext auth service
JWT
About JWT auth
JWT auth for MCP services
Set up JWT auth
Token exchange
Local rate limiting
Global rate limiting
settings
Operations
Debug your setup
Upgrade
Uninstall
query_stats
Observability
OTel stack
Control plane metrics
Tracing
import_contacts
Reference
API
Solo Enterprise for agentgateway APIs
Kubernetes Gateway API
Agentgateway API
CEL expressions
Helm
Solo Enterprise for agentgateway CRDs
Solo Enterprise for agentgateway
Changelog
Release notes
Changelog
Software Bill of Materials (SBOM)
Version support
open_in_new
Migrate from Ingress
handshake
Get help and support
About Solo Support
Submit a request
menu
search
Search
Solo Enterprise for agentgateway - 2.2.x
Solo Enterprise for agentgateway
2.3.x (latest)
2.2.x
2.1.x
GitHub
Twitter / X
Enable dark mode
Enable light mode
to navigate
to select
to close
cancel
Home
Observability
On this page
Table of Contents
Observability
Monitor agentgateway with metrics, logging, and tracing.
article
OTel stack
article
Control plane metrics
article
Tracing