Using Mutual TLS on the Client Side with Prometheus

How to use TLS, client authentication, and CA certificates in Prometheus

Choose DIY vs smallstep-managed integration

Create a private key and request a certificate for your Prometheus client

Before you can teach your client to speak TLS, you will need a certificate issued by a trusted certificate authority (CA). If your organization already runs its own CA and you have a private key and certificate for your Prometheus client, along with your CA's root certificate, you can skip to the next step.

If your organization does not yet run its own internal CA, you can read more about creating and running a CA using the open source smallstep software here.

$ step ca certificate "myuser" client.crt client.key

Your certificate and private key will be saved in client.crt and client.key respectively.

Request a copy of your CA root certificate, which will be used to make sure each application can trust certificates presented by other applications.

$ step ca root ca.crt

Your certificate will be saved in ca.crt.

Open a connection from Prometheus using mutual TLS

Now, we need only to configure our Prometheus client to make authenticated requests using our certificate and private key. The CA root certificate will be used to verify that the client can trust the certificate presented by the server.

Add the following job configuration block to your prometheus.yml to authenticate as a client to your targets:

#... scrape_configs: - job_name: 'node' scheme: https tls_config: # Prometheus will check that the node_exporter presents a certificate # signed by this ca. ca_file: 'ca.crt' # The cert and key are presented to node_exporter to authenticate # Prometheus as a client. cert_file: 'client.crt' key_file: 'client.key' static_configs: - targets: [''] #...

Reload Prometheus, and confirm that the Prometheus dashboard shows your target endpoints as "UP"—and using the https:// scheme.

Improve this content

Automate certificate renewal

By default, step-ca issues certificates with a 24 hour expiration. Short-lived certificates have many benefits but also require that you renew your certificates each day before they expire. How you renew certificates is often dependent on how you deploy your application. See the step-ca certificate lifecycle management docs for more information.

Let us know you're interested!

Smallstep is building Certificate Manager, a hosted certificate authority offering with integrations that make it easy to manage mututal TLS in technologies like Prometheus.

Certificate Manager is currently in early access (by request only). Please request an invitation and let us know you'd be interested in an integration with Prometheus.

Join Early Access

All documentation content from the Hello mTLS project is licensed under Creative Commons Attribution 4.0 International (CC BY 4.0).

Creative Commons License

Connect to a Server from Prometheus


Unsubscribe anytime. See our privacy policy.