Open the expression browser

  1. Port-forward the Prometheus pod in your cluster.

      meshctl proxy prometheus --kubecontext $MGMT_CONTEXT

    Port-forward the prometheus-server deployment on 9091.

      kubectl -n gloo-mesh port-forward deploy/prometheus-server 9091 --context $MGMT_CONTEXT

  2. Access the Prometheus expression browser.

Service mesh workloads queries

MetricPromQL query
Request rate for a given servicerate(istio_requests_total{destination_app="<service_ID>"}[5m])
Request rate between source and destination workloadrate(istio_requests_total{source_workload="<source_workload>", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workloadrate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workloadrate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframesum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)
Number of total requests for a source workloadsum(istio_requests_total{source_workload="<souce_workload>"}) by (workload_id,destination_workload_id, response_code)

Ingress gateway queries

MetricPromQL query
Request rate for the ingress gatewayrate(istio_requests_total{source_workload="istio-ingressgateway-1-20"}[5m])
Request rate between the ingress gateway and a destination workloadrate(istio_requests_total{source_workload="istio-ingressgateway-1-20", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workloadrate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workloadrate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframesum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)