Helm
Upgrade your sidecar control and data plane components in your Gloo Mesh (OSS APIs) cluster.
Considerations
Before you upgrade your service mesh components, review the following limitations and recommendations.
Revision and canary upgrade limitations
The upgrade guides in this documentation show you how to perform in-place upgrades for your Istio components, which is the recommended upgrade strategy.
Version and license requirements
Verify that the minor version of the Solo distribution of Istio that you want to upgrade to is tested and supported for your Gloo Mesh version. To find the available patch versions, you can get the minor version repo URL from the Istio images built by Solo.io support article, and check the patch version builds in that repo.
Check the Istio release notes for the upgrade version to prepare for any breaking changes.
Be sure to review the following known Istio version restrictions.
- Patch versions 1.26.0 and 1.26.1 of the Solo distribution of Istio lack support for FIPS-tagged images and ztunnel outlier detection. When upgrading or installing 1.26, be sure to use patch version
1.26.1-patch0and later only. - In the Solo distribution of Istio 1.25 and later, you can access enterprise-level features by passing your Solo license in the
license.valueorlicense.secretReffield of the Solo distribution of the istiod Helm chart. The Solo istiod Helm chart is strongly recommended due to the included safeguards, default settings, and upgrade handling to ensure a reliable and secure Istio deployment. Though it is not recommended, you can pass your license key in the open source istiod Helm chart by using the--set pilot.env.SOLO_LICENSE_KEYfield. - In Gloo Mesh (OSS APIs) version 2.7 and later, multicluster setups require the Solo distribution of Istio version 1.24.3 or later (
1.24.3-solo), including the Solo distribution ofistioctl. - Due to a lack of support for the Istio CNI and iptables for the Istio proxy, you cannot run Istio (and therefore Gloo Mesh (OSS APIs)) on AWS Fargate. For more information, see the Amazon EKS issue.
- Patch versions 1.26.0 and 1.26.1 of the Solo distribution of Istio lack support for FIPS-tagged images and ztunnel outlier detection. When upgrading or installing 1.26, be sure to use patch version
Single cluster
Upgrade Istio in your single cluster setup.
Upgrade istioctl
Save the Solo distribution of Istio patch version and tag.
export ISTIO_VERSION=1.27.0 # Change the tags as needed export ISTIO_IMAGE=${ISTIO_VERSION}-soloSave the repo key for the minor version of the Solo distribution of Istio that you want to install. This is the 12-character hash at the end of the repo URL
us-docker.pkg.dev/gloo-mesh/istio-<repo-key>, which you can find in the Istio images built by Solo.io support article.# 12-character hash at the end of the minor version repo URL export REPO_KEY=<repo_key> export REPO=us-docker.pkg.dev/gloo-mesh/istio-${REPO_KEY} export HELM_REPO=us-docker.pkg.dev/gloo-mesh/istio-helm-${REPO_KEY}Upgrade your
istioctlCLI client to the new version.curl -L https://istio.io/downloadIstio | ISTIO_VERSION=${ISTIO_VERSION} sh - cd istio-${ISTIO_VERSION} export PATH=$PWD/bin:$PATH
Upgrade CRDs and istiod
Upgrade the Istio CRDs to the new version.
helm get values istio-base -n istio-system -o yaml > istio-base.yaml helm upgrade istio-base oci://${HELM_REPO}/base \ --namespace istio-system \ --version ${ISTIO_IMAGE} \ -f istio-base.yamlIf you see an error such asError: UPGRADE FAILED: Rendered manifests contain a resource that already exists, see the community Istio docs.Get the current values for the istiod Helm release in your cluster. Your release might have a different name.
helm get values istiod -n istio-system -o yaml > istiod.yaml open istiod.yamlMake edits to the istiod Helm values, and save the file. If you update the Istio minor version, such as in the
global.tagfield, be sure to also update the value of thehubfield to the repo for the correct version of the Solo distribution of Istio.Upgrade your Helm release with the updated values.
helm upgrade istiod oci://${HELM_REPO}/istiod \ -n istio-system \ --version ${ISTIO_IMAGE} \ -f istiod.yamlVerify that the istiod pods are successfully restarted. Note that it might take a few seconds for the pods to become available.
kubectl get pods -n istio-system | grep istiodExample output:
istiod-main-bb86b959f-msrg7 1/1 Running 0 2m45s istiod-main-bb86b959f-w29cm 1/1 Running 0 3m
Optional: Upgrade the CNI
If you installed the Istio CNI, such as in OpenShift setups, follow the steps to upgrade this component.
If your changes include upgrading the Istio version of the components, be sure to upgrade the istiod control plane before you upgrade the CNI component. Otherwise, these components might have an outdated image.
Get the current values for its Helm release in your cluster.
- Kubernetes:
helm get values istio-cni -n istio-system -o yaml > cni.yaml open cni.yaml - OpenShift:
helm get values istio-cni -n kube-system -o yaml > cni.yaml open cni.yaml
- Kubernetes:
Make edits to the Helm values, and save the files. If you update the Istio minor version, such as in
tagfields, be sure to also update the value of thehubfield to the repo for the correct version of the Solo distribution of Istio.Upgrade your Helm releases with the updated values.
- Kubernetes:
helm upgrade istio-cni oci://${HELM_REPO}/cni -n istio-system --version ${ISTIO_IMAGE} -f cni.yaml - OpenShift:
helm upgrade istio-cni oci://${HELM_REPO}/cni -n kube-system --version ${ISTIO_IMAGE} -f cni.yaml
- Kubernetes:
Verify that the Istio CNI pods are successfully restarted. Note that it might take a few seconds for the pods to become available.
- Kubernetes:
kubectl get pods -n istio-system - OpenShift:
kubectl get pods -n kube-system
Example output:
istiod-main-85c4dfd97f-mncj5 1/1 Running 0 42s istio-cni-node-pr5rl 1/1 Running 0 42s istio-cni-node-pvmx2 1/1 Running 0 42s istio-cni-node-lcrcd 1/1 Running 0 42s- Kubernetes:
Multicluster
Upgrade the multicluster sidecar mesh in your multicluster setup.
Upgrade istioctl
Save the Solo distribution of Istio patch version and tag.
# Change the tags as needed export ISTIO_IMAGE=1.27.0-soloSave the repo key for the minor version of the Solo distribution of Istio. This is the 12-character hash at the end of the repo URL
us-docker.pkg.dev/gloo-mesh/istio-<repo-key>, which you can find in the Istio images built by Solo.io support article.# 12-character hash at the end of the repo URL export REPO_KEY=<repo_key> export REPO=us-docker.pkg.dev/gloo-mesh/istio-${REPO_KEY} export HELM_REPO=us-docker.pkg.dev/gloo-mesh/istio-helm-${REPO_KEY}Upgrade your
istioctlCLI client to the new version.Get the OS and architecture that you use on your machine.
OS=$(uname | tr '[:upper:]' '[:lower:]' | sed -E 's/darwin/osx/') ARCH=$(uname -m | sed -E 's/aarch/arm/; s/x86_64/amd64/; s/armv7l/armv7/') echo $OS echo $ARCHDownload the Solo distribution of Istio binary and install
istioctl.mkdir -p ~/.istioctl/bin curl -sSL https://storage.googleapis.com/istio-binaries-$REPO_KEY/$ISTIO_IMAGE/istioctl-$ISTIO_IMAGE-$OS-$ARCH.tar.gz | tar xzf - -C ~/.istioctl/bin chmod +x ~/.istioctl/bin/istioctl export PATH=${HOME}/.istioctl/bin:${PATH}Verify that the
istioctlclient is upgraded.istioctl version --remote=falseExample output:
client version: 1.27.0-solo
Upgrade CRDs and istiod
Save the name and kubeconfig context of a workload cluster in the following environment variables. Each time you repeat the steps in this guide, you change these variables to the next workload cluster’s name and context.
export CLUSTER_NAME=<cluster-name> export CLUSTER_CONTEXT=<cluster-context>Upgrade the custom resources of the Kubernetes Gateway API to the latest supported version, 1.3.0.
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api/releases/download/v1.3.0/standard-install.yamlUpgrade the Istio CRDs to the new version.
helm get values --kube-context ${CLUSTER_CONTEXT} istio-base -n istio-system -o yaml > istio-base.yaml helm upgrade istio-base oci://${HELM_REPO}/base \ --namespace istio-system \ --kube-context ${CLUSTER_CONTEXT} \ --version ${ISTIO_IMAGE} \ -f istio-base.yamlIf you see an error such asError: UPGRADE FAILED: Rendered manifests contain a resource that already exists, see the community Istio docs.Get the current values for the istiod Helm release in your cluster.
helm get values istiod --kube-context ${CLUSTER_CONTEXT} -n istio-system -o yaml > istiod.yaml open istiod.yamlMake edits to the istiod Helm values, and save the file. If you update the Istio minor version, such as in the
global.tagfield, be sure to also update the value of thehubfield to the repo for the correct version of the Solo distribution of Istio.Upgrade your Helm release with the updated values.
helm upgrade istiod oci://${HELM_REPO}/istiod \ -n istio-system \ --version ${ISTIO_IMAGE} \ --kube-context ${CLUSTER_CONTEXT} \ -f istiod.yamlVerify that the istiod pods are successfully restarted. Note that it might take a few seconds for the pods to become available.
kubectl get pods -n istio-system --context ${CLUSTER_CONTEXT} | grep istiodExample output:
istiod-main-b84c55cff-tllfr 1/1 Running 0 58s
Upgrade the CNI and ztunnel
If your changes include upgrading the Istio version of the components, be sure to upgrade the istiod control plane before you upgrade the CNI and ztunnel components. Otherwise, these components might have an outdated image.
For the component that you want to update, get the current values for its Helm release in your cluster.
- Kubernetes:
helm get values istio-cni --kube-context ${CLUSTER_CONTEXT} -n istio-system -o yaml > cni.yaml open cni.yaml helm get values ztunnel --kube-context ${CLUSTER_CONTEXT} -n istio-system -o yaml > ztunnel.yaml open ztunnel.yaml - OpenShift:
helm get values istio-cni --kube-context ${CLUSTER_CONTEXT} -n kube-system -o yaml > cni.yaml open cni.yaml helm get values ztunnel --kube-context ${CLUSTER_CONTEXT} -n kube-system -o yaml > ztunnel.yaml open ztunnel.yaml
- Kubernetes:
Make edits to the Helm values of the components that you want to upgrade, and save the files. If you update the Istio minor version, such as in
tagfields, be sure to also update the value of thehubfield to the repo for the correct version of the Solo distribution of Istio.Upgrade your Helm releases with the updated values.
- Kubernetes:
helm upgrade istio-cni oci://${HELM_REPO}/cni --kube-context ${CLUSTER_CONTEXT} -n istio-system --version ${ISTIO_IMAGE} -f cni.yaml helm upgrade ztunnel oci://${HELM_REPO}/ztunnel --kube-context ${CLUSTER_CONTEXT} -n istio-system --version ${ISTIO_IMAGE} -f ztunnel.yaml - OpenShift:
helm upgrade istio-cni oci://${HELM_REPO}/cni --kube-context ${CLUSTER_CONTEXT} -n kube-system --version ${ISTIO_IMAGE} -f cni.yaml helm upgrade ztunnel oci://${HELM_REPO}/ztunnel --kube-context ${CLUSTER_CONTEXT} -n kube-system --version ${ISTIO_IMAGE} -f ztunnel.yaml
- Kubernetes:
Verify that the ztunnel and Istio CNI pods are successfully restarted. Note that it might take a few seconds for the pods to become available.
- Kubernetes:
kubectl get pods --context ${CLUSTER_CONTEXT} -n istio-system - OpenShift:
kubectl get pods --context ${CLUSTER_CONTEXT} -n kube-system
Example output:
istiod-main-85c4dfd97f-mncj5 1/1 Running 0 42s istio-cni-node-pr5rl 1/1 Running 0 42s istio-cni-node-pvmx2 1/1 Running 0 42s istio-cni-node-lcrcd 1/1 Running 0 42s ztunnel-tvtzn 1/1 Running 0 40s ztunnel-vtpjm 1/1 Running 0 40s ztunnel-hllxg 1/1 Running 0 40s- Kubernetes:
Repeat for each cluster
Repeat Upgrade CRDs and istiod and Upgrade the CNI and ztunnel for each cluster in your setup. Note that no multicluster components, such as the east-west gateway or global service entries, require upgrades when you update the version of your other control and data plane components.