Skip to content
If you are interested in trying out Gloo Gateway with the Kubernetes Gateway API, check out Solo Enterprise for kgateway. This version adds enterprise functionality on top of the kgateway open source project.

Guides

Page as Markdown
Learn more ways to use AI Gateway
Cloud LLM providers
Set up cloud LLM providers with AI Gateway.
Authenticate to the LLM
Let AI Gateway send requests to an LLM provider.
Streaming
Stream responses from the LLM to the end user through AI Gateway.
Failover
Function calling
Send function calls to an LLM through Gloo AI Gateway.
Tutorials