Set up Gloo AI Gateway

Before you begin link

Follow the Get started guide to install Gloo Gateway.

Set up Gloo AI Gateway link

1. Create a GatewayParameters resource.

     kubectl apply -f- <<EOF
   apiVersion: gateway.gloo.solo.io/v1alpha1
   kind: GatewayParameters
   metadata:
     name: gloo-gateway-override
     namespace: gloo-system
   spec:
     kube:
       aiExtension:
         enabled: true
   EOF
     

2. Set up Gloo AI Gateway by creating a Gateway resource with the custom GatewayParameters.

     kubectl apply -f- <<EOF
   kind: Gateway
   apiVersion: gateway.networking.k8s.io/v1
   metadata:
     name: ai-gateway
     namespace: gloo-system
     annotations:
       gateway.gloo.solo.io/gateway-parameters-name: gloo-gateway-override
   spec:
     gatewayClassName: gloo-gateway
     listeners:
     - protocol: HTTP
       port: 8080
       name: http
       allowedRoutes:
         namespaces:
           from: All
   EOF
     

3. Verify that the AI gateway is created.

     kubectl get gateway ai-gateway -n gloo-system
     

   Example output:

     NAME         CLASS          ADDRESS      PROGRAMMED   AGE
   ai-gateway   gloo-gateway   172.18.0.2   True         69m
     

Next link

Explore how to connect the gateway to an LLM provider and successfully authenticate so that you can use AI services.

link