Skip to content
If you are interested in trying out Gloo Gateway with the Kubernetes Gateway API, check out Solo Enterprise for kgateway. This version adds enterprise functionality on top of the kgateway open source project.

For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

Guides

Page as Markdown
Learn more ways to use AI Gateway
Cloud LLM providers
Set up cloud LLM providers with AI Gateway.
Authenticate to the LLM
Let AI Gateway send requests to an LLM provider.
Streaming
Stream responses from the LLM to the end user through AI Gateway.
Failover
Prioritize the failover of requests across different models from an LLM provider.
Function calling
Send function calls to an LLM through Gloo AI Gateway.
TutorialsIntegrations
Was this page helpful?