Re: [prometheus-users] Re: NTP metrics not available while using node exporter

Look at the node timex collector. There was a recent discussion about it on the google group. On Wed, Oct 21, 2020 at 8:22 AM Pooja Chauhan wrote: > Thank you for explaining me this :) > So which NTP parameter I should have alert on for out of sync time issue > in my servers ? And what will be

[prometheus-users] Re: NTP metrics not available while using node exporter

Thank you for explaining me this :) So which NTP parameter I should have alert on for out of sync time issue in my servers ? And what will be the query ? On Wednesday, October 21, 2020 at 12:32:51 AM UTC+5:30 b.ca...@pobox.com wrote: > This is no longer a prometheus question, but I'll answer

Re: [prometheus-users] blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

Hi, On 10/20/20 11:25 AM, deln...@gmail.com wrote: > I understand there's an ongoing discussion > on this > issue. How do you prevent false(or true) alerts when one of the > applications is providing multiple certs and one of these has e

Re: [prometheus-users] Publish incoming scraped metrics to another database

On 20 Oct 08:31, Al wrote: > That's great, I didn't realize you could use remote write while still > writing metrics locally. On another note, what kind of performance impact > does the remote-write feature have when enabled? Is it something > considerable or is it relatively minor, even with

[prometheus-users] Metrics from mysqld_exporter

Hi I'm monitoring a mysql service on Kubernetes with mysqld_exporter and have some questions... 1. Which metric is exposed for the flag info_schema.query_response_time? 2. Which metric is exposed for the flag perf_schema.eventsstatements? I saw the documentation of the exporter, it sends a lot

[prometheus-users] Re: NTP metrics not available while using node exporter

This is no longer a prometheus question, but I'll answer it briefly: ntpq -p lists the servers that you are sync'd from (-p = peers). Any server which syncs *from* a stratum 4 server will itself be stratum 5, by definition. The stratum is the number of steps away you are from a true time sour

Re: [prometheus-users] Scaling Prometheus

Hi Aliaksandr, Thank you! Those numbers look interesting; we will give it a shot as well. Thanks, Karthik On Sat, Oct 17, 2020 at 1:42 PM Aliaksandr Valialkin wrote: > Hi Karthik, > > There is another option - to substitute Prometheus with VictoriaMetrics > stack

Re: [prometheus-users] Re: blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

On Tue, Oct 20, 2020, at 08:52, Nemanja Delic wrote: > In this case the cert has expired on Oct 13 22:12:47 2020 GMT. Since it's not > last one in chain it's not breaking things. I can set the filter accordingly > ( with smth like > -7), just thought there might be some other solution. PKIX pat

Re: [prometheus-users] Re: blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

Brian, Using pretty much standard Blackbox job config: - job_name: blackbox honor_timestamps: true params: module: - http_2xx scrape_interval: 1m scrape_timeout: 1m metrics_path: /probe scheme: http file_sd_configs: - files: - /etc/prometheus/file_sd_config.d/blackbox_

Re: [prometheus-users] Publish incoming scraped metrics to another database

That's great, I didn't realize you could use remote write while still writing metrics locally. On another note, what kind of performance impact does the remote-write feature have when enabled? Is it something considerable or is it relatively minor, even with large instances scraping from many

[prometheus-users] How can I sort the legend by series name in Prometheus?

I have a Grafana dashboard panel configured to render the results of a Prometheus query. There are a large number of series returned by the query, with the legend displayed to the right. If the user is looking for a specific series, they have to potentially scroll through all of them, and it's easy

[prometheus-users] Inconsistent result of binary operation

Every execution of following query returns different results. go_memstats_alloc_bytes{instance="demo.robustperception.io:9090"} - go_memstats_gc_sys_bytes{instance="demo.robustperception.io:9090"} Could you tell me why? Try it here: http://demo.robustperception.io:9090/new/graph?g0.expr=go_mem

Re: [prometheus-users] Publish incoming scraped metrics to another database

Remote Write does this. The data from the WAL is directly streamed to the remote endpoint in addition to writing to the local TSDB. https://prometheus.io/docs/prometheus/latest/configuration/configuration/#remote_write On Tue, Oct 20, 2020 at 4:35 PM Al wrote: > I have a use-case where I would

[prometheus-users] Publish incoming scraped metrics to another database

I have a use-case where I would like to have the ability for a Prometheus write metrics locally while being able to also stream the same metrics to another type of external database. The goal is to ship these metrics as they're scraped so queries on the remote database can be executed with the

[prometheus-users] Re: NTP metrics not available while using node exporter

Yes i had tried it previosly but we do have our won NTP servers with which it did not showed correct information like , the output will be : # HELP node_ntp_leap NTPD leap second indicator, 2 bits. # TYPE node_ntp_leap gauge node_ntp_leap 0 # HELP node_ntp_offset_seconds ClockOffset between NTP a

[prometheus-users] Re: Blackbox smtp_starttls and imap_starttls don't get metrics

Thank you for all yours help. With debug command: curl 'localhost:9115/probe?target=smtp.google.com:25&module=smtp_starttls&debug=true' I found problem. Problem was because in prometheus.yml I was set only hostname without port number. caller=tcp.go:37 module=smtp_starttls target=my_mail_serve

Re: [prometheus-users] Re: blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

Any certificate in the chain which is expired or invalid will "break things": i.e. clients will not accept the certificate as valid, if they cannot establish a chain of trust back to the root. >From the linked github discussion about negative time to expire, I understood these would be hugely n

Re: [prometheus-users] Re: blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

Hi Brian, In this case the cert has expired on Oct 13 22:12:47 2020 GMT. Since it's not last one in chain it's not breaking things. I can set the filter accordingly ( with smth like > -7), just thought there might be some other solution. On Tue, Oct 20, 2020 at 12:20 PM Brian Candler wrote: >

[prometheus-users] Re: NTP metrics not available while using node exporter

If you're checking the ntp service on the host where node_exporter is running, then remove '--collector.ntp.server="10.0.0.0" --collector.ntp.server-is-local' All you need is --collector.ntp # curl -sS localhost:9100/metrics | grep 'ntp_' # HELP node_ntp_leap NTPD leap second indicator, 2 bits.

[prometheus-users] NTP metrics not available while using node exporter

Hi , I want to monitor if the time goes out of sync with NTP server . There are issues related to this so need to address this asap . Node exporter : /node_exporter --collector.ntp --collector.ntp.server="10.0.0.0" --collector.ntp.server-is-local i am unable to see any metrics related to NTP

[prometheus-users] Re: blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

Filter it to ignore values which are "too negative": expr: (probe_ssl_earliest_cert_expiry - time()) / 86400 < 14 > -365 -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send

[prometheus-users] Re: Blackbox smtp_starttls and imap_starttls don't get metrics

Oh, there's a much way to get the debug output, which is to add &debug=true to the URL. curl 'localhost:9115/probe?target=smtp.google.com:25&module=smtp_starttls&debug=true' -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe f

[prometheus-users] Re: Blackbox smtp_starttls and imap_starttls don't get metrics

The other thing you can do is to run blackbox_exporter with flag --log.level=debug, and then you'll see in detail what's going on in its stderr output. Either run it in the foreground, or look at "journalctl -eu blackbox_exporter" if running it under systemd. Here is an example of a probe whic

[prometheus-users] blackbox exporter's probe_ssl_earliest_cert_expiry giving negative values

I understand there's an ongoing discussion on this issue. How do you prevent false(or true) alerts when one of the applications is providing multiple certs and one of these has expired? Silencing these is not solution. -- You receiv

[prometheus-users] Re: Prometheus Monitoring for Java Web Applications

Please find the my service file details below and let me know where I am going wrong Details: [Unit] Description=Wind Explore - xplore-service After=syslog.target network.target [Service] Type=forking EnvironmentFile=/opt/tomcat/servers/xplore-wind-server/bin/setenv.env #Environment="TOMCAT_OPTS

[prometheus-users] Prometheus Monitoring for Java Web Applications

Hi Team, Could you suggest some proper blogs for Java Web Applications monitoring? Thank you, Regards, Shivali Chauhan -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send

Re: [prometheus-users] Prometheus alert not working for an event based metric

On 19/10/2020 22:02, Arnav Bose wrote: Hi, I have a metric which sends data only in case of a specific event. In other words, it will not have regular continuous telemetry every 15 seconds, but it will be there for a single data point. Now, I configured an alert to check if the metric exists

Re: [prometheus-users] Deploy Pushgateway across multiple pods

On 20/10/2020 00:09, Quan Chau wrote: Is there any workaround for this? Or Pushgateway is not supposed to be deployed across multiple pods at all? Pushgateway has no clustering ability, so you should only run a single instance. -- You received this message because you are subscribed to the

[prometheus-users] Tomcat application Monitoring

Hi Team, Could you please suggest some blog for Tomcat application Monitoring? Thank you Regards, Shivali Chauhan -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an em