Tutorials

Set up Gloo AI Gateway

Use a custom GatewayParameters resource to set up Gloo AI Gateway.

Authenticate with API keys

Learn how to use an API key to allow the AI Gateway to authenticate with an LLM provider.

Control access

Use a JWT token to ensure that only authenticated and authorized users can access the LLM APIs.

Observability

Gather and observe key metrics related to LLM provider usage.

Rate limit requests

Limit the number of requests that can be sent to the LLM provider.

Manage and enrich prompts

Effectively manage system and user prompts to improve LLM outputs.

Set up prompt guards

Secure access to the LLM and the data that is returned with Web Application Filter and Data Loss …

Retrieval augmented generation (RAG)

Provide relevant context for LLM provider by retrieving data from one or more datasets.

Semantic caching

Provide relevant context for an LLM provider by retrieving data from one or more datasets.

Cleanup

Remove the Gloo AI Gateway resources that you created as part of the tutorials.