Open the expression browser

  1. Port-forward the Prometheus pod in your cluster.

  2. Access the Prometheus expression browser.

Service mesh workloads queries

MetricPromQL query
Request rate for a given servicerate(istio_requests_total{destination_app="<service_ID>"}[5m])
Request rate between source and destination workloadrate(istio_requests_total{source_workload="<source_workload>", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workloadrate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workloadrate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframesum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)
Number of total requests for a source workloadsum(istio_requests_total{source_workload="<souce_workload>"}) by (workload_id,destination_workload_id, response_code)

Ingress gateway queries

MetricPromQL query
Request rate for the ingress gatewayrate(istio_requests_total{source_workload="istio-ingressgateway-1-20"}[5m])
Request rate between the ingress gateway and a destination workloadrate(istio_requests_total{source_workload="istio-ingressgateway-1-20", destination_workload="<workload_ID>"}[5m])
Successful request rate to a destination workloadrate(istio_requests_total{response_code=~"[2-3].*", destination_workload="<workload_ID>"}[5m])
Rate of failing requests to a destination workloadrate(istio_requests_total{response_code=~"[4-5].*", destination_workload="<workload_ID>"}[5m])
Number of new requests within a certain timeframesum(increase(istio_requests_total{}[5m])) by (workload_id, destination_workload_id)

Cilium-specific queries

MetricPromQL query
Successful network packet rate for a given servicerate(hubble_flows_processed_total{destination_workload_id="<workload_ID>"}[5m])
Successful network packet rate between source and destination workloadrate(hubble_flows_processed_total{source="<source_workload_ID>", destination_workload_id="<destination_workload_id>"}[5m])
Rate of dropped network packets to a destination workloadrate(hubble_drop_total{destination_workload_id="<workload_ID>"}[5m])
Number of new processed network packets within a certain timeframesum(increase(hubble_flows_processed_total{}[5m])) by (workload_id, destination_workload_id)