This documentation uses Gloo Gateway proxies with the Kubernetes Gateway API. To use the Edge API instead, click here. Note that some features, such as AI gateways, are not supported with the Edge API.
Learn more ways to use AI Gateway
Cloud LLM providers
Set up cloud LLM providers with AI Gateway.
Authenticate to the LLM
Let AI Gateway send requests to an LLM provider.
Streaming
Stream responses from the LLM to the end user through AI Gateway.
Failover
Function calling
Send function calls to an LLM through Gloo AI Gateway.