istio.io/archive/v1.1/help/ops/telemetry/missing-metrics/index.html

58 lines
29 KiB
HTML
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<!doctype html><html lang=en itemscope itemtype=https://schema.org/WebPage><head><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1,shrink-to-fit=no"><meta name=theme-color content=#466BB0><meta name=title content="Missing Metrics"><meta name=description content="Diagnose problems where metrics are not being collected."><meta name=keywords content=microservices,services,mesh><meta property=og:title content="Missing Metrics"><meta property=og:type content=website><meta property=og:description content="Diagnose problems where metrics are not being collected."><meta property=og:url content=/v1.1/help/ops/telemetry/missing-metrics/><meta property=og:image content=/v1.1/img/istio-whitelogo-bluebackground-framed.svg><meta property=og:image:alt content="Istio Logo"><meta property=og:image:width content=112><meta property=og:image:height content=150><meta property=og:site_name content=Istio><meta name=twitter:card content=summary><meta name=twitter:site content=@IstioMesh><title>Istioldie 1.1 / Missing Metrics</title><script async src="https://www.googletagmanager.com/gtag/js?id=UA-98480406-2"></script><script>window.dataLayer=window.dataLayer||[];function gtag(){dataLayer.push(arguments);}
gtag('js',new Date());gtag('config','UA-98480406-2');</script><link rel=alternate type=application/rss+xml title="Istio Blog" href=/v1.1/feed.xml><link rel="shortcut icon" href=/v1.1/favicons/favicon.ico><link rel=apple-touch-icon href=/v1.1/favicons/apple-touch-icon-180x180.png sizes=180x180><link rel=icon type=image/png href=/v1.1/favicons/favicon-16x16.png sizes=16x16><link rel=icon type=image/png href=/v1.1/favicons/favicon-32x32.png sizes=32x32><link rel=icon type=image/png href=/v1.1/favicons/android-36x36.png sizes=36x36><link rel=icon type=image/png href=/v1.1/favicons/android-48x48.png sizes=48x48><link rel=icon type=image/png href=/v1.1/favicons/android-72x72.png sizes=72x72><link rel=icon type=image/png href=/v1.1/favicons/android-96x96.png sizes=96xW96><link rel=icon type=image/png href=/v1.1/favicons/android-144x144.png sizes=144x144><link rel=icon type=image/png href=/v1.1/favicons/android-192x192.png sizes=192x192><link rel=manifest href=/v1.1/manifest.json><meta name=apple-mobile-web-app-title content=Istio><meta name=application-name content=Istio><link rel=stylesheet href="https://fonts.googleapis.com/css?family=Work+Sans:400|Chivo:400|Work+Sans:500,300,600,300italic,400italic,500italic,600italic|Chivo:500,300,600,300italic,400italic,500italic,600italic"><link rel=stylesheet href=/v1.1/css/all.css></head><body class="language-unknown archive-site"><script src=/v1.1/js/themes_init.min.js></script><script>const branchName="release-1.1";const docTitle="Missing Metrics";const iconFile="\/v1.1/img/icons.svg";const buttonCopy='Copy to clipboard';const buttonPrint='Print';const buttonDownload='Download';</script><script src="https://www.google.com/cse/brand?form=search-form" defer></script><script src=/v1.1/js/all.min.js data-manual defer></script><header><nav><a id=brand href=/v1.1/><span class=logo><svg viewBox="0 0 300 300"><circle cx="150" cy="150" r="146" stroke-width="2" /><path d="M65 240H225L125 270z"/><path d="M65 230l60-10V110z"/><path d="M135 220l90 10L135 30z"/></svg></span><span class=name>Istioldie 1.1</span></a><div id=hamburger><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#hamburger"/></svg></div><div id=header-links><a title="Learn how to deploy, use, and operate Istio." href=/v1.1/docs/>Docs</a>
<a title="Posts about using Istio." href=/v1.1/blog/2019/announcing-1.1.9/>Blog</a>
<span title="A bunch of resources to help you deploy, configure and use Istio.">Help</span>
<a title="Get a bit more in-depth info about the Istio project." href=/v1.1/about/>About</a><div class=menu><button id=gearDropdownButton class=menu-trigger title="Options and settings" aria-label="Options and Settings" aria-controls=gearDropdownContent><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#gear"/></svg></button><div id=gearDropdownContent class=menu-content aria-labelledby=gearDropdownButton role=menu><a tabindex=-1 role=menuitem lang=en id=switch-lang-en class=active>English</a>
<a tabindex=-1 role=menuitem lang=zh id=switch-lang-zh>中文</a><div role=separator></div><a tabindex=-1 role=menuitem class=active id=light-theme-item>Light Theme</a>
<a tabindex=-1 role=menuitem id=dark-theme-item>Dark Theme</a><div role=separator></div><a tabindex=-1 role=menuitem id=syntax-coloring-item>Color Examples</a><div role=separator></div><h6>Other versions of this site</h6><a tabindex=-1 role=menuitem onclick="navigateToUrlOrRoot('https://istio.io/help\/ops\/telemetry\/missing-metrics\/');return false;">Current Release</a>
<a tabindex=-1 role=menuitem onclick="navigateToUrlOrRoot('https://preliminary.istio.io/help\/ops\/telemetry\/missing-metrics\/');return false;">Next Release</a>
<a tabindex=-1 role=menuitem href=https://archive.istio.io>Older Releases</a></div></div><button id=search-show title="Search this site" aria-label=Search><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#magnifier"/></svg></button></div><form id=search-form name=cse role=search><input type=hidden name=cx value=013699703217164175118:iwwf17ikgf4>
<input type=hidden name=ie value=utf-8>
<input type=hidden name=hl value=en>
<input type=hidden id=search-page-url value=/v1.1/search.html>
<input id=search-textbox class=form-control name=q type=search aria-label="Search this site">
<button id=search-close title="Cancel search" type=reset aria-label="Cancel search"><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#cancel-x"/></svg></button></form></nav></header><main class=primary><div id=sidebar-container class="sidebar-container sidebar-offcanvas"><nav id=sidebar aria-label="Section Navigation"><div class=directory><div class=card><div id=header0 class=header title="A bunch of resources to help you deploy, configure and use Istio."><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#help"/></svg>Need Help?</div><div class="body default" aria-labelledby=header0><ul role=tree aria-expanded=true aria-labelledby=header0><li role=treeitem aria-label="Operations Guide"><button class=show aria-hidden=true></button><a title="Hints, tips, tricks about running an Istio mesh." href=/v1.1/help/ops/>Operations Guide</a><ul role=group aria-expanded=true><li role=none><a role=treeitem title="Describes how to use component-level logging to get insights into a running component's behavior." href=/v1.1/help/ops/component-logging/>Component Logging</a></li><li role=none><a role=treeitem title="Describes how to use ControlZ to get insight into individual running components." href=/v1.1/help/ops/controlz/>Component Introspection</a></li><li role=none><a role=treeitem title="How to do low-level debugging of Istio components." href=/v1.1/help/ops/component-debugging/>Component Debugging</a></li><li role=treeitem aria-label="Traffic Management"><button aria-hidden=true></button><a title="Helps you manage the networking aspects of a running mesh." href=/v1.1/help/ops/traffic-management/>Traffic Management</a><ul role=group aria-expanded=false class=leaf-section><li role=none><a role=treeitem title="An introduction to Istio networking operational aspects." href=/v1.1/help/ops/traffic-management/introduction/>Introduction to Network Operations</a></li><li role=none><a role=treeitem title="Provides specific deployment and configuration guidelines." href=/v1.1/help/ops/traffic-management/deploy-guidelines/>Deployment and Configuration Guidelines</a></li><li role=none><a role=treeitem title="Describes common networking issues and how to recognize and avoid them." href=/v1.1/help/ops/traffic-management/troubleshooting/>Troubleshooting Networking Issues</a></li><li role=none><a role=treeitem title="Describes tools and techniques to diagnose Envoy configuration issues related to traffic management." href=/v1.1/help/ops/traffic-management/proxy-cmd/>Debugging Envoy and Pilot</a></li><li role=none><a role=treeitem title="Information on how to enable and understand Locality Load Balancing." href=/v1.1/help/ops/traffic-management/locality-load-balancing/>Locality Load Balancing</a></li></ul></li><li role=treeitem aria-label=Security><button aria-hidden=true></button><a title="Helps you manage the security aspects of a running mesh." href=/v1.1/help/ops/security/>Security</a><ul role=group aria-expanded=false class=leaf-section><li role=none><a role=treeitem title="Demonstrates how to debug authorization." href=/v1.1/help/ops/security/debugging-authorization/>Debugging Authorization</a></li><li role=none><a role=treeitem title="What to do if Citadel is not behaving properly." href=/v1.1/help/ops/security/repairing-citadel/>Repairing Citadel</a></li><li role=none><a role=treeitem title="What to do if you suspect problems with Istio keys and certificates." href=/v1.1/help/ops/security/keys-and-certs/>Keys and Certificates</a></li><li role=none><a role=treeitem title="What to do if mutual TLS authentication isn't working." href=/v1.1/help/ops/security/mutual-tls/>Mutual TLS</a></li><li role=none><a role=treeitem title="Authorization is enabled, but requests make it through anyway." href=/v1.1/help/ops/security/authorization-permissive/>Authorization Too Permissive</a></li><li role=none><a role=treeitem title="Authorization is enabled and no requests make it through to the service." href=/v1.1/help/ops/security/authorization-restrictive/>Authorization Too Restrictive</a></li><li role=none><a role=treeitem title="What to do if end-user authentication doesn't work." href=/v1.1/help/ops/security/end-user-auth/>End User Authentication</a></li><li role=none><a role=treeitem title="Learn how to extend the lifetime of the Istio self-signed root certificate." href=/v1.1/help/ops/security/root-transition/>Extending Self-Signed Certificate Lifetime</a></li></ul></li><li role=treeitem aria-label=Telemetry><button class=show aria-hidden=true></button><a title="Helps you manage telemetry collection and visualization in a running mesh." href=/v1.1/help/ops/telemetry/>Telemetry</a><ul role=group aria-expanded=true class=leaf-section><li role=none><span role=treeitem class=current title="Diagnose problems where metrics are not being collected.">Missing Metrics</span></li><li role=none><a role=treeitem title="Dealing with Grafana issues." href=/v1.1/help/ops/telemetry/grafana/>Grafana</a></li><li role=none><a role=treeitem title="Fine-grained control of Envoy statistics." href=/v1.1/help/ops/telemetry/envoy-stats/>Envoy Statistics</a></li></ul></li><li role=treeitem aria-label="Installation and Setup"><button aria-hidden=true></button><a title="Helps you diagnose and repair Istio installations." href=/v1.1/help/ops/setup/>Installation and Setup</a><ul role=group aria-expanded=false class=leaf-section><li role=none><a role=treeitem title="Provides a general overview of Istio's use of Kubernetes webhooks and the related issues that can arise." href=/v1.1/help/ops/setup/webhook/>Dynamic Admission Webhooks Overview</a></li><li role=none><a role=treeitem title="Describes Istio's use of Kubernetes webhooks for server-side configuration validation." href=/v1.1/help/ops/setup/validation/>Configuration Validation Webhook</a></li><li role=none><a role=treeitem title="Describes Istio's use of Kubernetes webhooks for automatic sidecar injection." href=/v1.1/help/ops/setup/injection/>Sidecar Injection Webhook</a></li><li role=none><a role=treeitem title="Describes how to check which capabilities are allowed for your pods." href=/v1.1/help/ops/setup/required-pod-capabilities/>Required Pod Capabilities</a></li><li role=none><a role=treeitem title="Shows how to do health checking for Istio services." href=/v1.1/help/ops/setup/app-health-check/>Health Checking of Istio Services</a></li></ul></li><li role=none><a role=treeitem title="Advice on tackling common problems with Istio." href=/v1.1/help/ops/misc/>Miscellaneous</a></li></ul></li><li role=treeitem aria-label=FAQ><button aria-hidden=true></button><a title="Frequently Asked Questions about Istio." href=/v1.1/help/faq/>FAQ</a><ul role=group aria-expanded=false class=leaf-section><li role=none><a role=treeitem title="General Q &amp; A." href=/v1.1/help/faq/general/>General</a></li><li role=none><a role=treeitem title="Setup Q &amp; A." href=/v1.1/help/faq/setup/>Setup</a></li><li role=none><a role=treeitem title="Security Q &amp; A." href=/v1.1/help/faq/security/>Security</a></li><li role=none><a role=treeitem title="Mixer Q &amp; A." href=/v1.1/help/faq/mixer/>Mixer</a></li><li role=none><a role=treeitem title="Metrics and Logs Q &amp; A." href=/v1.1/help/faq/metrics-and-logs/>Metrics and Logs</a></li><li role=none><a role=treeitem title="Distributed Tracing Q &amp; A." href=/v1.1/help/faq/distributed-tracing/>Distributed Tracing</a></li><li role=none><a role=treeitem title="Traffic Management Q &amp; A." href=/v1.1/help/faq/traffic-management/>Traffic Management</a></li></ul></li><li role=none><a role=treeitem title="A glossary of common Istio terms." href=/v1.1/help/glossary/>Glossary</a></li></ul></div></div></div></nav></div><div class=article-container><button tabindex=-1 id=sidebar-toggler title="Toggle the navigation bar"><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#pull"/></svg></button><nav aria-label=Breadcrumb><ol><li><a href=/v1.1/ title="Connect, secure, control, and observe services.">Istio</a></li><li><a href=/v1.1/help/ title="A bunch of resources to help you deploy, configure and use Istio.">Help</a></li><li><a href=/v1.1/help/ops/ title="Hints, tips, tricks about running an Istio mesh.">Operations Guide</a></li><li><a href=/v1.1/help/ops/telemetry/ title="Helps you manage telemetry collection and visualization in a running mesh.">Telemetry</a></li><li>Missing Metrics</li></ol></nav><article aria-labelledby=title><div class=title-area><div><h1 id=title>Missing Metrics</h1><p class=byline><span title="831 words"><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#clock"/></svg><span>&nbsp;</span>4 minute read</span></p></div></div><nav class=toc-inlined aria-label="Table of Contents"><div><hr><ol><li role=none aria-label="Verify Mixer is receiving Report calls"><a href=#verify-mixer-is-receiving-report-calls>Verify Mixer is receiving Report calls</a><li role=none aria-label="Verify the Mixer rules exist"><a href=#verify-the-mixer-rules-exist>Verify the Mixer rules exist</a><li role=none aria-label="Verify the Prometheus handler configuration exists"><a href=#verify-the-prometheus-handler-configuration-exists>Verify the Prometheus handler configuration exists</a><li role=none aria-label="Verify Mixer metric instances configuration exists"><a href=#verify-mixer-metric-instances-configuration-exists>Verify Mixer metric instances configuration exists</a><li role=none aria-label="Verify there are no known configuration errors"><a href=#verify-there-are-no-known-configuration-errors>Verify there are no known configuration errors</a><li role=none aria-label="Verify Mixer is sending metric instances to the Prometheus adapter"><a href=#verify-mixer-is-sending-metric-instances-to-the-prometheus-adapter>Verify Mixer is sending metric instances to the Prometheus adapter</a><li role=none aria-label="Verify Prometheus configuration"><a href=#verify-prometheus-configuration>Verify Prometheus configuration</a></ol><hr></div></nav><p>The procedures below help you diagnose problems where metrics
you are expecting to see reported and not being collected.</p><p>The expected flow for metrics is:</p><ol><li><p>Envoy reports attributes from requests asynchronously to Mixer in a batch.</p></li><li><p>Mixer translates the attributes into instances based on the operator-provided configuration.</p></li><li><p>Mixer hands the instances to Mixer adapters for processing and backend storage.</p></li><li><p>The backend storage systems record the metrics data.</p></li></ol><p>The Mixer default installations include a Prometheus adapter and the configuration to generate a <a href=/v1.1/docs/reference/config/policy-and-telemetry/metrics/>default set of metric values</a> and send them to the Prometheus adapter. The Prometheus adapter configuration enables a Prometheus instance to scrape Mixer for metrics.</p><p>If the Istio Dashboard or the Prometheus queries dont show the expected metrics, any step of the flow above may present an issue. The following sections provide instructions to troubleshoot each step.</p><h2 id=verify-mixer-is-receiving-report-calls>Verify Mixer is receiving Report calls</h2><p>Mixer generates metrics to monitor its own behavior. The first step is to check these metrics:</p><ol><li><p>Establish a connection to the Mixer self-monitoring endpoint for the <code>istio-telemetry</code> deployment. In Kubernetes environments, execute the following command:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl -n istio-system port-forward &lt;istio-telemetry pod&gt; 15014 &amp;
</code></pre></li><li><p>Verify successful report calls. On the Mixer self-monitoring endpoint, search for <code>grpc_io_server_completed_rpcs</code>. You should see something like:</p><pre><code class=language-plain data-expandlinks=true>grpc_io_server_completed_rpcs{grpc_server_method=&#34;istio.mixer.v1.Mixer/Report&#34;,grpc_server_status=&#34;OK&#34;} 2532
</code></pre><p>If you do not see any data for <code>grpc_io_server_completed_rpcs</code> with a <code>grpc_server_method=&quot;istio.mixer.v1.Mixer/Report&quot;</code>, then Envoy is not calling Mixer to report telemetry.</p></li><li><p>In this case, ensure you integrated the services properly into the mesh. You can achieve this task with either <a href=/v1.1/docs/setup/kubernetes/additional-setup/sidecar-injection/>automatic or manual sidecar injection</a>.</p></li></ol><h2 id=verify-the-mixer-rules-exist>Verify the Mixer rules exist</h2><p>In Kubernetes environments, issue the following command:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl get rules --all-namespaces
NAMESPACE NAME AGE
istio-system kubeattrgenrulerule 4h
istio-system promhttp 4h
istio-system promtcp 4h
istio-system promtcpconnectionclosed 4h
istio-system promtcpconnectionopen 4h
istio-system tcpkubeattrgenrulerule 4h
</code></pre><p>If the output shows no rules named <code>promhttp</code> or <code>promtcp</code>, then the Mixer configuration for sending metric instances to the Prometheus adapter is missing. You must supply the configuration for rules connecting the Mixer metric instances to a Prometheus handler.</p><p>For reference, please consult the <a href=https://raw.githubusercontent.com/istio/istio/release-1.1/install/kubernetes/helm/istio/charts/mixer/templates/config.yaml>default rules for Prometheus</a>.</p><h2 id=verify-the-prometheus-handler-configuration-exists>Verify the Prometheus handler configuration exists</h2><ol><li><p>In Kubernetes environments, issue the following command:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl get prometheuses.config.istio.io --all-namespaces
NAMESPACE NAME AGE
istio-system handler 13d
</code></pre><p>Depending on whether or not your install of Istio was a fresh install or upgrade, you may also need to issue the following command:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl get handlers.config.istio.io --all-namespaces
NAMESPACE NAME AGE
istio-system kubernetesenv 4h
istio-system prometheus 4h
</code></pre></li><li><p>If the output shows no configured Prometheus handlers, you must reconfigure Mixer with the appropriate handler configuration.</p><p>For reference, please consult the <a href=https://raw.githubusercontent.com/istio/istio/release-1.1/install/kubernetes/helm/istio/charts/mixer/templates/config.yaml>default handler configuration for Prometheus</a>.</p></li></ol><h2 id=verify-mixer-metric-instances-configuration-exists>Verify Mixer metric instances configuration exists</h2><ol><li><p>In Kubernetes environments, issue the following command:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl get metrics.config.istio.io --all-namespaces
$ kubectl get instances -o custom-columns=NAME:.metadata.name,TEMPLATE:.spec.compiledTemplate
</code></pre></li><li><p>If the output shows no configured metric instances, you must reconfigure Mixer with the appropriate instance configuration.</p><p>For reference, please consult the <a href=https://raw.githubusercontent.com/istio/istio/release-1.1/install/kubernetes/helm/istio/charts/mixer/templates/config.yaml>default instances configuration for metrics</a>.</p></li></ol><h2 id=verify-there-are-no-known-configuration-errors>Verify there are no known configuration errors</h2><ol><li><p>To establish a connection to the Istio-telemetry self-monitoring endpoint, setup a port-forward to the Istio-telemetry self-monitoring port as described in
<a href=#verify-mixer-is-receiving-report-calls>Verify Mixer is receiving Report calls</a>.</p></li><li><p>For each of the following metrics, verify that the most up-to-date value is 0:</p><ul><li><p><code>mixer_config_adapter_info_config_errors_total</code></p></li><li><p><code>mixer_config_template_config_errors_total</code></p></li><li><p><code>mixer_config_instance_config_errors_total</code></p></li><li><p><code>mixer_config_rule_config_errors_total</code></p></li><li><p><code>mixer_config_rule_config_match_error_total</code></p></li><li><p><code>mixer_config_unsatisfied_action_handler_total</code></p></li><li><p><code>mixer_config_handler_validation_error_total</code></p></li><li><p><code>mixer_handler_handler_build_failures_total</code></p></li></ul></li></ol><p>On the page showing Mixer self-monitoring port, search for each of the metrics listed above. You should not find any values for those metrics if everything is
configured correctly.</p><p>If any of those metrics have a value, confirm that the metric value with the largest configuration ID is 0. This will verify that Mixer has generated no errors
in processing the most recent configuration as supplied.</p><h2 id=verify-mixer-is-sending-metric-instances-to-the-prometheus-adapter>Verify Mixer is sending metric instances to the Prometheus adapter</h2><ol><li><p>Establish a connection to the <code>istio-telemetry</code> self-monitoring endpoint. Setup a port-forward to the <code>istio-telemetry</code> self-monitoring port as described in
<a href=#verify-mixer-is-receiving-report-calls>Verify Mixer is receiving Report calls</a>.</p></li><li><p>On the Mixer self-monitoring port, search for <code>mixer_runtime_dispatches_total</code>. The output should be similar to:</p><pre><code class=language-plain data-expandlinks=true>mixer_runtime_dispatches_total{adapter=&#34;prometheus&#34;,error=&#34;false&#34;,handler=&#34;prometheus.istio-system&#34;,meshFunction=&#34;metric&#34;} 2532
</code></pre></li><li><p>Confirm that <code>mixer_runtime_dispatches_total</code> is present with the values:</p><pre><code class=language-plain data-expandlinks=true>adapter=&#34;prometheus&#34;
error=&#34;false&#34;
</code></pre><p>If you cant find recorded dispatches to the Prometheus adapter, there is likely a configuration issue. Please follow the steps above
to ensure everything is configured properly.</p><p>If the dispatches to the Prometheus adapter report errors, check the Mixer logs to determine the source of the error. The most likely cause is a configuration issue for the handler listed in <code>mixer_runtime_dispatches_total</code>.</p></li><li><p>Check the Mixer logs in a Kubernetes environment with:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl -n istio-system logs &lt;istio-telemetry pod&gt; -c mixer
</code></pre></li></ol><h2 id=verify-prometheus-configuration>Verify Prometheus configuration</h2><ol><li><p>Connect to the Prometheus UI</p></li><li><p>Verify you can successfully scrape Mixer through the UI.</p></li><li><p>In Kubernetes environments, setup port-forwarding with:</p><pre><code class=language-bash data-expandlinks=true>$ kubectl -n istio-system port-forward $(kubectl -n istio-system get pod -l app=prometheus -o jsonpath=&#39;{.items[0].metadata.name}&#39;) 9090:9090 &amp;
</code></pre></li><li><p>Visit <code>http://localhost:9090/targets</code></p></li><li><p>Confirm the target <code>istio-mesh</code> has a status of UP.</p></li><li><p>Visit <code>http://localhost:9090/config</code></p></li><li><p>Confirm an entry exists similar to:</p><pre><code class=language-plain data-expandlinks=true>- job_name: &#39;istio-mesh&#39;
# Override the global default and scrape targets from this job every 5 seconds.
scrape_interval: 5s
# metrics_path defaults to &#39;/metrics&#39;
# scheme defaults to &#39;http&#39;.
static_configs:
- targets: [&#39;istio-mixer.istio-system:42422&#39;]&lt;/td&gt;
</code></pre></li></ol></article><nav class=pagenav><div class=left></div><div class=right><a title="Dealing with Grafana issues." href=/v1.1/help/ops/telemetry/grafana/>Grafana<svg class="icon"><use xlink:href="/v1.1/img/icons.svg#right-arrow"/></svg></a></div></nav><div id=endnotes-container aria-hidden=true><h2>Links</h2><ol id=endnotes></ol></div></div><div class=toc-container><nav class=toc aria-label="Table of Contents"><div id=toc><ol><li role=none aria-label="Verify Mixer is receiving Report calls"><a href=#verify-mixer-is-receiving-report-calls>Verify Mixer is receiving Report calls</a><li role=none aria-label="Verify the Mixer rules exist"><a href=#verify-the-mixer-rules-exist>Verify the Mixer rules exist</a><li role=none aria-label="Verify the Prometheus handler configuration exists"><a href=#verify-the-prometheus-handler-configuration-exists>Verify the Prometheus handler configuration exists</a><li role=none aria-label="Verify Mixer metric instances configuration exists"><a href=#verify-mixer-metric-instances-configuration-exists>Verify Mixer metric instances configuration exists</a><li role=none aria-label="Verify there are no known configuration errors"><a href=#verify-there-are-no-known-configuration-errors>Verify there are no known configuration errors</a><li role=none aria-label="Verify Mixer is sending metric instances to the Prometheus adapter"><a href=#verify-mixer-is-sending-metric-instances-to-the-prometheus-adapter>Verify Mixer is sending metric instances to the Prometheus adapter</a><li role=none aria-label="Verify Prometheus configuration"><a href=#verify-prometheus-configuration>Verify Prometheus configuration</a></ol></div></nav></div></main><footer><div class=user-links><a class=channel title="Go download Istio 1.1.9 now" href=https://github.com/istio/istio/releases/tag/1.1.9 aria-label="Download Istio"><span>download</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#download"/></svg>
</a><a class=channel title="Join the Istio discussion board to participate in discussions and get help troubleshooting problems" href=https://discuss.istio.io aria-label="Istio discussion board"><span>discuss</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#discourse"/></svg></a>
<a class=channel title="Stack Overflow is where you can ask questions and find curated answers on deploying, configuring, and using Istio" href=https://stackoverflow.com/questions/tagged/istio aria-label="Stack Overflow"><span>stack overflow</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#stackoverflow"/></svg></a>
<a class=channel title="Follow us on Twitter to get the latest news" href=https://twitter.com/IstioMesh aria-label=Twitter><span>twitter</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#twitter"/></svg></a><div class=tag>for everyone</div></div><div class=info><p class=copyright>Istio Archive
1.1.9<br>&copy; 2019 Istio Authors, <a href=https://policies.google.com/privacy>Privacy Policy</a><br>Archived on June 18, 2019</p></div><div class=dev-links><a class=channel title="GitHub is where development takes place on Istio code" href=https://github.com/istio/community aria-label=GitHub><span>github</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#github"/></svg></a>
<a class=channel title="Interactively discuss issues with the Istio community on Slack" href=https://istio.slack.com aria-label=slack><span>slack</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#slack"/></svg></a>
<a class=channel title="Access our team drive if you'd like to take a look at the Istio technical design documents" href=https://groups.google.com/forum/#!forum/istio-team-drive-access aria-label="team drive"><span>drive</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#drive"/></svg></a>
<a class=channel title="If you'd like to contribute to the Istio project, consider participating in our working groups" href=https://github.com/istio/community/blob/master/WORKING-GROUPS.md aria-label="working groups"><span>working groups</span><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#working-groups"/></svg></a><div class=tag>for developers</div></div></footer><div id=scroll-to-top-container aria-hidden=true><button id=scroll-to-top title="Back to top"><svg class="icon"><use xlink:href="/v1.1/img/icons.svg#top"/></svg></button></div></body></html>