Sample PromQL queries

Open the expression browser

  1. Port-forward the Prometheus pod in your cluster.

    meshctl proxy prometheus
    

    Port-forward the prometheus-server deployment on 9091.

    kubectl -n gloo-mesh port-forward deploy/prometheus-server 9091
    

  2. Access the Prometheus expression browser.

Service mesh workloads queries

Metric PromQL query
Request rate for a given service rate(istio_requests_total{destination_app="<service_ID>"}[5m])
Request rate between source and destination workload rate(istio_requests_total{source_workload="<source_workload>", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workload rate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workload rate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframe sum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)
Number of total requests for a source workload sum(istio_requests_total{source_workload="<souce_workload>"}) by (workload_id,destination_workload_id, response_code)

Ingress gateway queries

Metric PromQL query
Request rate for the ingress gateway rate(istio_requests_total{source_workload="istio-ingressgateway-1-20"}[5m])
Request rate between the ingress gateway and a destination workload rate(istio_requests_total{source_workload="istio-ingressgateway-1-20", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workload rate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workload rate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframe sum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)

Cilium-specific queries

Metric PromQL query
Successful network packet rate for a given service rate(hubble_flows_processed_total{destination_workload_id="<workload_ID>"}[5m])
Successful network packet rate between source and destination workload rate(hubble_flows_processed_total{source="<source_workload_ID>", destination_workload_id="<destination_workload_id>"}[5m])
Rate of dropped network packets to a destination workload rate(hubble_drop_total{destination_workload_id="<workload_ID>"}[5m])
Number of new processed network packets within a certain timeframe sum(increase(hubble_flows_processed_total{}[5m])) by (workload_id, destination_workload_id)