Navigation :

Installing Gloo Edge Enterprise

Review how to install Gloo Edge Enterprise.

Before you begin

Make sure that you prepared your Kubernetes cluster according to the instructions for platform configuration.
Pay attention to provider-specific information in the setup guide. For example, OpenShift requires stricter multi-tenant support, so the setup guide includes an example Helm chart values.yaml file that you must supply while installing Gloo Edge Enterprise.
Get your Gloo Edge Enterprise license key. If you don’t have one already, you may request a trial license key here.
You must provide the license key during the installation process. When you install Gloo Edge, a Kubernetes secret is created to store the license key. Note that each trial license key is typically valid for 30 days. When the license key expires, you can request a new license key by contacting your Account Representative or filling out this form. For more information, see Updating Enterprise Licenses.
Install or upgrade glooctl with the following instructions.

Install the Gloo Edge command line tool (CLI)

The glooctl command line provides useful functions to install, configure, and debug Gloo Edge, though it is not required to use Gloo Edge.

To install glooctl using the Homebrew package manager, run the following.
```
brew install glooctl
```
To install on most platforms you can use the install script. Python is required for installation to execute properly.
```
curl -sL https://run.solo.io/gloo/install | sh
export PATH=$HOME/.gloo/bin:$PATH
```

To install on windows you can use this install script. Openssl is required for installation to execute properly.

(New-Object System.Net.WebClient).DownloadString("https://run.solo.io/gloo/windows/install") | iex
$env:Path += ";$env:userprofile/.gloo/bin/"

You can download glooctl directly via the GitHub releases page. You will need to rename the executable to glooctl and add it to your system’s PATH after downloading.

You can verify the glooctl CLI is installed and running correctly by executing the command:

glooctl version

The command returns your client version and a missing server version (we have not installed Gloo Edge yet!):

Client: {"version":"1.2.3"}
Server: version undefined, could not find any version of gloo running

Update glooctl CLI version

You should always try to use the same minor glooctl version as the version of Gloo Edge installed in your cluster. For example, if you’re using Gloo Edge {{< readfile file="static/content/version_gee_latest.md” markdown="true">}}, you should use a {{< readfile file="static/content/version_gee_latest.md” markdown="true">}} release of glooctl.

Fortunately, glooctl is able to update itself to different versions. To change the version of glooctl you currently have installed, you can run:

glooctl upgrade --release v{{< readfile file="static/content/version_gee_latest.md" markdown="true">}}

Note: The glooctl upgrade command can also be used to roll back your glooctl version to previous releases. This can be convenient if you are using an older version of Gloo Edge and want to use the same verison of glooctl to ensure compatability.

Installing Gloo Edge Enterprise on Kubernetes

Review the following steps to install Gloo Edge Enterprise with glooctl or with Helm.

Installing on Kubernetes with `glooctl`

Once your Kubernetes cluster is up and running, run the following command to deploy the Gloo Edge to the gloo-system namespace:

glooctl install gateway enterprise --license-key YOUR_LICENSE_KEY

For OpenShift clusters, make sure to include the --values values.yaml option to point to the Helm chart custom values file that you created.

Special Instructions to Install Gloo Edge Enterprise on Kind

If you followed the cluster setup instructions for Kind here, then you should have exposed custom ports 31500 (for http) and 32500 (https) from your cluster's Docker container to its host machine. The purpose of this is to make it easier to access your service endpoints from your host workstation. Use the following custom installation for Gloo Edge to publish those same ports from the proxy as well.

cat <<EOF | glooctl install gateway enterprise --license-key YOUR_LICENSE_KEY --values -
gloo:
  gatewayProxies:
    gatewayProxy:
      service:
        type: NodePort
        httpPort: 31500
        httpsPort: 32500
        httpNodePort: 31500
        httpsNodePort: 32500
EOF

Creating namespace gloo-system... Done.
Starting Gloo Edge Enterprise installation...

Gloo Edge Enterprise was successfully installed!

Note also that the url to invoke services published via Gloo Edge will be slightly different with Kind-hosted clusters. Much of the Gloo Edge documentation instructs you to use $(glooctl proxy url) as the header for your service url. This will not work with kind. For example, instead of using curl commands like this:

curl $(glooctl proxy url)/all-pets

You will instead route your request to the custom port that you configured above for your docker container to publish. For example:

curl http://localhost:31500/all-pets

Once you’ve installed Gloo Edge, please be sure to verify your installation.

You can run the command with the flag --dry-run to output the Kubernetes manifests (as yaml) that glooctl will apply to the cluster instead of installing them.

Installing on Kubernetes with Helm

This is the recommended method for installing Gloo Edge Enterprise to your production environment as it offers rich customization to the Gloo Edge control plane and the proxies Gloo Edge manages.

As a first step, you have to add the Gloo Edge repository to the list of known chart repositories:

helm repo add glooe https://storage.googleapis.com/gloo-ee-helm

Finally, install Gloo Edge using the following command:

helm install gloo glooe/gloo-ee --namespace gloo-system \
  --create-namespace --set-string license_key=YOUR_LICENSE_KEY

For OpenShift clusters, make sure to include the --values values.yaml option to point to the Helm chart custom values file that you created.

Using Helm 2 is not supported in Gloo Edge v1.8.0 or later.

Once you’ve installed Gloo Edge, please be sure to verify your installation.

Airgap installation

You can install Gloo Edge Enterprise in an air-gapped environment, such as an on-premises datacenter, clusters that run on an intranet or private network only, or other disconnected environments.

Before you begin, make sure that you have the following setup:

A connected device that can pull the required images from the internet.
An air-gapped or disconnected device that you want to install Gloo Edge Enterprise in.
A private image registry such as Sonatype Nexus Repository or JFrog Artifactory that both the connected and disconnected devices can connect to.

To install Gloo Edge Enterprise in an air-gapped environment:

Set the Gloo Edge Enterprise version that you want to use as an environment variable, such as the latest version in the following example.
```
export GLOO_EE_VERSION=1.9.4
```

On the connected device, download the Gloo Edge Enterprise images.

wget https://storage.googleapis.com/gloo-ee-helm/charts/gloo-ee-${GLOO_EE_VERSION}.tgz
tar zxvf gloo-ee-${GLOO_EE_VERSION}.tgz
find gloo-ee -name "values.yaml" | while read file; do
  cat $file | yq eval -j | jq -r '.. | .image? | select(. != null) | [.registry?, .repository?, .tag?] | @csv'
done | grep -v ",," | sort -u

The example output includes the list of images.

"docker.io","redis","6.2.4"
"quay.io/solo-io","gloo-fed","1.9.4"
"quay.io/solo-io","gloo-fed-apiserver","1.9.4"
"quay.io/solo-io","gloo-fed-apiserver-envoy","1.9.4"
"quay.io/solo-io","gloo-fed-rbac-validating-webhook","1.9.4"
"quay.io/solo-io","gloo-federation-console","1.9.4"
,"",
,"access-logger","1.9.4"
,"busybox","1.31.1"
,"certgen","1.9.4"
,"discovery","1.9.4"
,"extauth-ee","1.9.4"
,"gateway","1.9.4"
,"gloo","1.9.4"
,"gloo-ee","1.9.4"
,"gloo-ee-envoy-wrapper","1.9.4"
,"gloo-envoy-wrapper","1.9.4"
,"grafana/grafana","8.2.1"
,"grafana/grafana-image-renderer","latest"
,"ingress","1.9.4"
,"jimmidyson/configmap-reload","v0.5.0"
,"observability-ee","1.9.4"
,"prom/pushgateway","v1.3.1"
,"quay.io/coreos/kube-state-metrics","v1.9.7"
,"quay.io/kiwigrid/k8s-sidecar","1.12.3"
,"quay.io/prometheus/alertmanager","v0.21.0"
,"quay.io/prometheus/node-exporter","v1.0.1"
,"quay.io/prometheus/prometheus","v2.24.0"
,"rate-limit-ee","1.9.4"
,"sds","1.9.4"

Push the images from the connected device to a private registry that the disconnected device can pull from. For instructions and any credentials you must set up to complete this step, consult your registry provider, such as Nexus Repository Manager or JFrog Artifactory.
Optional: You might want to set up your private registry so that you can also pull the Helm charts. For instructions, consult your registry provider, such as Nexus Repository Manager or JFrog Artifactory.
When you install Gloo Edge Enterprise with a custom Helm chart values file, make sure to use the specific images that you downloaded and stored in your private registry in the previous steps.

Customizing your installation with Helm

You can customize the Gloo Edge installation by providing your own Helm chart values file.

For example, you can create a file named value-overrides.yaml with the following content.

global:
  glooRbac:
    # do not create kubernetes rbac resources
    create: false
settings:
  # configure gloo to write generated custom resources to a custom namespace
  writeNamespace: my-custom-namespace

Then, refer to the file during installation to override default values in the Gloo Edge Helm chart.

helm install gloo glooe/gloo-ee --namespace gloo-system \
  -f value-overrides.yaml --create-namespace --set-string license_key=YOUR_LICENSE_KEY

Using Helm 2 is not supported in Gloo Edge v1.8.0 or later.

List of Gloo Edge Helm chart values

The following table describes the most important enterprise-only values that you can override in your custom values file.

For more information, see the following resources:

Gloo Edge Open Source overrides (also available in Enterprise).
Advanced customization guide.
Enterprise Helm chart reference document.

Gloo Edge Open Source Helm values in Enterprise must be prefixed with gloo, unless they are the Gloo Edge settings, such as settings.<rest of helm value>.

option	type	description
grafana.defaultInstallationEnabled	bool	deploy grafana in your gloo system namespace. default is `true`
prometheus.enabled	bool	deploy prometheus in your gloo system namespace. default is `true`
rateLimit.enabled	bool	deploy rate-limiting in your gloo system namespace. default is `true`
global.extensions.extAuth.enabled	bool	deploy ext-auth in your gloo system namespace. default is `true`
global.extensions.extAuth.envoySidecar	bool	deploy ext-auth in the gateway-proxy pod, as a sidecar to envoy. communicates over unix domain socket instead of TCP. default is `false`
observability.enabled	bool	deploy observability in your gloo system namespace. default is `true`
observability.customGrafana.enabled	bool	indicate you’ll be using your own instance of grafana rather than the one shipped with Gloo Edge. default is `false`
observability.customGrafana.username	string	set this and the `password` field to authenticate to the custom grafana instance using basic auth
observability.customGrafana.password	string	set this and the `username` field to authenticate to the custom grafana instance using basic auth
observability.customGrafana.apiKey	string	authenticate to the custom grafana instance using this api key
observability.customGrafana.url	string	the URL for the custom grafana instance

Verify your Installation

Check that the Gloo Edge pods and services have been created. Depending on your install option, you may see some differences from the following example. And if you choose to install Gloo Edge into a different namespace than the default gloo-system, then you will need to query your chosen namespace instead.

kubectl --namespace gloo-system get all

NAME                                                       READY   STATUS    RESTARTS   AGE
pod/api-server-56fcb78878-d9mxt                            2/2     Running   0          5m21s
pod/discovery-759bd6cf85-sphjb                             1/1     Running   0          5m22s
pod/extauth-679d587db8-l9k56                               1/1     Running   0          5m21s
pod/gateway-568bfd477c-487zw                               1/1     Running   0          5m22s
pod/gateway-proxy-c84cbd647-n9kz2                          1/1     Running   0          5m22s
pod/gloo-6979c5bd8-2dfrj                                   1/1     Running   0          5m22s
pod/glooe-grafana-86445b465b-mnn8t                         1/1     Running   0          5m22s
pod/glooe-prometheus-kube-state-metrics-8587f58df6-954pw   1/1     Running   0          5m22s
pod/glooe-prometheus-server-6bd6f4667d-zqffp               2/2     Running   0          5m21s
pod/observability-6db6c659dd-v4bkp                         1/1     Running   0          5m21s
pod/rate-limit-6b847b95c8-kwcbd                            1/1     Running   1          5m21s
pod/redis-7f6954b84d-ff4ck                                 1/1     Running   0          5m21s

NAME                                          TYPE           CLUSTER-IP       EXTERNAL-IP   PORT(S)                      AGE
service/extauth                               ClusterIP      10.109.93.97     <none>        8080/TCP                     5m22s
service/gateway-proxy                         LoadBalancer   10.106.26.131    <pending>     80:31627/TCP,443:30931/TCP   5m22s
service/gloo                                  ClusterIP      10.103.56.88     <none>        9977/TCP                     5m22s
service/glooe-grafana                         ClusterIP      10.103.252.250   <none>        80/TCP                       5m22s
service/glooe-prometheus-kube-state-metrics   ClusterIP      None             <none>        80/TCP                       5m22s
service/glooe-prometheus-server               ClusterIP      10.100.244.136   <none>        80/TCP                       5m22s
service/rate-limit                            ClusterIP      10.100.54.112    <none>        18081/TCP                    5m22s
service/redis                                 ClusterIP      10.97.72.199     <none>        6379/TCP                     5m22s

NAME                                                  READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/api-server                            1/1     1            1           5m21s
deployment.apps/discovery                             1/1     1            1           5m22s
deployment.apps/extauth                               1/1     1            1           5m21s
deployment.apps/gateway                               1/1     1            1           5m22s
deployment.apps/gateway-proxy                         1/1     1            1           5m22s
deployment.apps/gloo                                  1/1     1            1           5m22s
deployment.apps/glooe-grafana                         1/1     1            1           5m22s
deployment.apps/glooe-prometheus-kube-state-metrics   1/1     1            1           5m22s
deployment.apps/glooe-prometheus-server               1/1     1            1           5m22s
deployment.apps/observability                         1/1     1            1           5m21s
deployment.apps/rate-limit                            1/1     1            1           5m21s
deployment.apps/redis                                 1/1     1            1           5m21s

NAME                                                             DESIRED   CURRENT   READY   AGE
replicaset.apps/api-server-56fcb78878                            1         1         1       5m21s
replicaset.apps/discovery-759bd6cf85                             1         1         1       5m22s
replicaset.apps/extauth-679d587db8                               1         1         1       5m21s
replicaset.apps/gateway-568bfd477c                               1         1         1       5m22s
replicaset.apps/gateway-proxy-c84cbd647                          1         1         1       5m22s
replicaset.apps/gloo-6979c5bd8                                   1         1         1       5m22s
replicaset.apps/glooe-grafana-86445b465b                         1         1         1       5m22s
replicaset.apps/glooe-prometheus-kube-state-metrics-8587f58df6   1         1         1       5m22s
replicaset.apps/glooe-prometheus-server-6bd6f4667d               1         1         1       5m21s
replicaset.apps/observability-6db6c659dd                         1         1         1       5m21s
replicaset.apps/rate-limit-6b847b95c8                            1         1         1       5m21s
replicaset.apps/redis-7f6954b84d                                 1         1         1       5m21s

kubectl --namespace gloo-fed get all

NAME                                    READY   STATUS    RESTARTS   AGE
pod/gloo-fed-695d6dd44c-v2l64           1/1     Running   0          57m
pod/gloo-fed-console-774f958867-j7bwc   3/3     Running   0          57m

NAME                       TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)                       AGE
service/gloo-fed-console   ClusterIP   10.96.107.54   <none>        10101/TCP,8090/TCP,8081/TCP   72m

NAME                               READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/gloo-fed           1/1     1            1           72m
deployment.apps/gloo-fed-console   1/1     1            1           72m

NAME                                          DESIRED   CURRENT   READY   AGE
replicaset.apps/gloo-fed-695d6dd44c           1         1         1       72m
replicaset.apps/gloo-fed-console-774f958867   1         1         1       72m

Looking for opened ports?

You will NOT have any open ports listening on a default install. For Envoy to open the ports and actually listen, you need to have a Route defined in one of the VirtualServices that will be associated with that particular Gateway/Listener. Please see the Hello World tutorial to get started.

NOT opening the listener ports when there are no listeners (routes) is by design with the intention of not over-exposing your cluster by accident (for security). If you feel this behavior is not justified, please let us know.

Uninstall

To uninstall Gloo Edge, you can use the glooctl CLI. If you installed Gloo Edge to a different namespace, include the -n option.

glooctl uninstall -n my-namespace

Make sure that your cluster has no other instances of Gloo Edge running, such as by running kubectl get pods --all-namespaces. If you remove the CRDs while Gloo Edge is still installed, you will experience errors.

glooctl uninstall --all

Next Steps

After you’ve installed Gloo Edge, please check out our User Guides.