[prometheus-users] Re: The node_filesystem_size_bytes query result is inconsistent with the server result

I have solved the problem. The monitoring is normal. Thank you. 在2020年8月14日星期五 UTC+8 上午9:58:44 写道： > Thank you for your answer. I'm currently node_exporter is deployed in > kubernetes and monitored by Prometheus. Does kubernetes deploy Reference > documents for the exporter? > >

[prometheus-users] Alert condition XOR

We are trying to use time series as alert thresholds following this blog https://www.robustperception.io/using-time-series-as-alert-thresholds Rules (xor_rule.yml) groups: - name: xor-mock rules: - record: resource:critical expr: 0.6 labels: resource_type: cpu:usage severity: critical -

[prometheus-users] Re: The node_filesystem_size_bytes query result is inconsistent with the server result

Thank you for your answer. I'm currently node_exporter is deployed in kubernetes and monitored by Prometheus. Does kubernetes deploy Reference documents for the exporter? 在2020年8月13日星期四 UTC+8 下午7:13:24 写道： > It's because you're running node_exporter inside docker, so node_exporter > sees the

[prometheus-users] What node_network_transmit_drop_total exactly refers to?

I'm currently dealing with some AWS instances with this metrics higher randomly. I'm not sure what this refers to. Is this somehow related with some metrics from ifconfig? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe

[prometheus-users] Multiple Prometheus containers on same server

I would like to have multiple containers of Prometheus on same machine and each of these containers belongs to different teams and scrape from remote targets belonging to that team. How can I achieve this? -- You received this message because you are subscribed to the Google Groups "Prometheus

Re: [prometheus-users] Conditional routing to alertmanager

Hi, On 8/13/20 7:56 PM, Johny wrote: > i have a requirement which requires routing only alerts for > pagerduty to a specific alert manager mesh due to proxy set up. All > other alerts are sent to default alertmanager. Is it possible to do > this conditional routing in prometheus alerting

[prometheus-users] Re: Conditional routing to alertmanager

Could you send alerts to both alertmanagers, and then filter them using different routing rules on each one? > > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an

[prometheus-users] Conditional routing to alertmanager

i have a requirement which requires routing only alerts for pagerduty to a specific alert manager mesh due to proxy set up. All other alerts are sent to default alertmanager. Is it possible to do this conditional routing in prometheus alerting configuration? Alternatively is it possible to

[prometheus-users] Re: rate/increase function gives unexpected spike

rate and irate should take care of that automatically. However if the counter goes 300,000 -> 0 -> 300,000 then you'll see a big spike of course. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop

[prometheus-users] Display top 5 digits only Grafana with Prometheus

I have Grafana and my data source is Prometheus. I have + 100 digits which set in stat in grafana I want explore top 5 digits or numbers within some period of time such as 12 hrs. How can I do it? Any idea or specifi query? Thanks. -- You received this message because you are subscribed to

[prometheus-users] Re: rate/increase function gives unexpected spike

I just realized the issue is with counter decreasing at times and losing monotonicity. Thanks. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: [prometheus-users] password_file basic auth for scrape config

It is the username string in the main config file. On 13 Aug 08:42, Justin Thomas wrote: > What about the username? > > On Thursday, August 13, 2020 at 6:58:57 AM UTC-7, Julien Pivotto wrote: > > > > On 13 Aug 06:56, Justin Thomas wrote: > > > The prometheus docs have the below: > > > > > >

Re: [prometheus-users] password_file basic auth for scrape config

What about the username? On Thursday, August 13, 2020 at 6:58:57 AM UTC-7, Julien Pivotto wrote: > > On 13 Aug 06:56, Justin Thomas wrote: > > The prometheus docs have the below: > > > > # Sets the `Authorization` header on every scrape request with the > > # configured username and

Re: [prometheus-users] snmp_exporter and job showing down

One thought, maybe there's an open file descriptor limit on the snmp_exporter that's being hit? On Thu, Aug 13, 2020 at 5:18 PM Ben Kochie wrote: > It looks like the error is coming from the SNMP implementation, when > trying to use a standard net Dialer. > > >

Re: [prometheus-users] snmp_exporter and job showing down

It looks like the error is coming from the SNMP implementation, when trying to use a standard net Dialer. https://github.com/soniah/gosnmp/blob/cce23a3123384acf2aebdee032c5ef38698fe290/gosnmp.go#L255-L258 If my understanding of the code is correct, this should be using a normal Golang DNS

RE: [prometheus-users] Multiple ip addresses returned via srv, prometheus only trying one

I have set a silent-drop on c.c.c.42, then after a while prometheus falls back on a different ip, on which it is allowed to get the metrics. But strange thing is that if it successfully polls on this ip. It stop and tries the bad ip again. -Original Message- To: prometheus-users

Re: [prometheus-users] snmp_exporter and job showing down

boilerplate.. - job_name: 'protocols' file_sd_configs: - files: - protocols_targets.json metrics_path: /snmp params: module: [protocols] relabel_configs: - source_labels: [__address__] target_label: __param_target - source_labels: [__param_target] target_label: instance - target_label:

Re: [prometheus-users] snmp_exporter and job showing down

Yes, that looks like a DNS issue to me. What is the prometheus.yml configuration for this? On Thu, Aug 13, 2020 at 3:08 PM dari...@gmail.com wrote: > Hello, > > I have snmp exporter with various network devices, which works fine most > of the time. However, sometime I notice false alerts and

[prometheus-users] Re: rate/increase function gives unexpected spike

Can you provide more direct evidence of your claim - i.e. the exact API calls and responses you are performing to get the values you show? And what prometheus version? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from

[prometheus-users] Multiple ip addresses returned via srv, prometheus only trying one

My prometheus is stuck trying to get metrics from the last ip address c.c.c.42, which is not reachable for prometheus. My dns is configured like this # dig srv +short _metrics._haproxy.dev._tcp.marathon.mesos 0 1 31912 haproxy.dev-e5dqo-s3.marathon.mesos. # dig +short

Re: [prometheus-users] password_file basic auth for scrape config

On 13 Aug 06:56, Justin Thomas wrote: > The prometheus docs have the below: > > # Sets the `Authorization` header on every scrape request with the > # configured username and password. > # password and password_file are mutually exclusive. > basic_auth: > [ username: >

[prometheus-users] password_file basic auth for scrape config

The prometheus docs have the below: # Sets the `Authorization` header on every scrape request with the # configured username and password. # password and password_file are mutually exclusive. basic_auth: [ username:

[prometheus-users] snmp_exporter and job showing down

Hello, I have snmp exporter with various network devices, which works fine most of the time. However, sometime I notice false alerts and when I look at the job, there are gaps of. which snmp exporter doesn't register this as 0, its just a gap. When looking at snmp exporter logs I noticed these

[prometheus-users] rate/increase function gives unexpected spike

There is one data point in series where rate/irate/increase gives an unexpected spike. underlying series has 2 points with a small increase. *timeseries irate=irate(series[1m]) *12:15:00 300,000 12:14:58400,000 12:14:50

Re: [prometheus-users] Grouping of alarms (group_interval, group_wait and repeat_interval)

Yes, you're right. E-Mail-Notifications works. After research, I found out that OpsGenie deduplicates the notifications using the alias created by the AlertManager through the group labels: https://github.com/prometheus/alertmanager/issues/1598 The group labels contain the grouping data

[prometheus-users] Automating Prometheus config management

Dear community, we are working on an integration for our open-source project Keptn to automatically setup and configure scrape jobs and alerting rules for Prometheus based on SRE best-practices. Our current implementation lacks a bit of flexibility in the sense that it can

[prometheus-users] Re: The node_filesystem_size_bytes query result is inconsistent with the server result

It's because you're running node_exporter inside docker, so node_exporter sees the filesystems as they are inside the docker container. See: https://github.com/prometheus/node_exporter#using-docker It's better to run node_exporter directly on the host - for example, copy the binary to each

[prometheus-users] do alertmanager supporting push alert to flock by webhook

Hi there I would like to setup the webhook from alertmanager to flock, but I can see it most related are slack_configs or webhook_configs, I had setup the incoming webhook on Flock, also updated the alertmanager.yml config, but I can't push alert message to Flock, I cant see any doc to setup

[prometheus-users] Alert manager config not working

HEllo , I modified the alermanger.yml configuration in order to get email alerts: Here is my configuration , For information the SMTP server is internal and we have direct access to global: smtp_smarthost: SMTP_hostname smtp_from: company@ smtp_require_tls: false route: receiver:

[prometheus-users] The node_filesystem_size_bytes query result is inconsistent with the server result

Host operating system: output of uname -a Linux master 3.10.0-1062.18.1.el7.x86_64 #1 SMP Tue Mar 17 23:49:17 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux node_exporter version: output of node_exporter --version node_exporter v1.0.1 Are you

[prometheus-users] Re: Basic auth config for alertmanager in prometheus.yml

Thank you Brian, works like breeze now, i've read the documentation but somehow did not manage to put the variables at the right place seems i have to learn mor about YAML. Thanks to you again Brian! Am Montag, 10. August 2020 17:33:06 UTC+2 schrieb Brian Candler: > > The documentation at >

[prometheus-users] Re: How to get Tomcat Response code using JMX exporter

Hi Arthi, I am looking for a way to monitor my Apache Tomcat but I am still undecided and I don't know what to choose between the JMX_Exporter and the Tomcat exporter (https://github.com/nlighten/tomcat_exporter). Is it possible to share with us which metric did you get to monitor your tomcat.

[prometheus-users] Re: GaugeMetricFamily Timestamp with Pushgateway

This won't work. Most importantly, Prometheus itself does not allow ingestion of historical metrics in any form. Furthermore, pushgateway is not intended to store history of a metric, just the most recent value. You may want to look at another project. For example, VictoriaMetrics has a

Re: [prometheus-users] Monitor Fortigate Firewalls with snmp exporter

https://itforvn.com/prometheus-tu-a-den-z-phan-03-giam-sat-firewall-fortigate-qua-snmp-voi-prometheus/ Vào lúc 18:10:59 UTC+7 ngày Thứ Sáu, 2 tháng 8, 2019, sup...@gmail.com đã viết: > Looks like a problem with the MIB files. > > On Wed, Jul 31, 2019, 01:35 Aakash Masand wrote: > >> I am

[prometheus-users] Re: Intergrating Fortigate SNMP with promethes

https://itforvn.com/prometheus-tu-a-den-z-phan-03-giam-sat-firewall-fortigate-qua-snmp-voi-prometheus/ Vào lúc 01:24:37 UTC+7 ngày Thứ Sáu, 3 tháng 4, 2020, andre...@gmail.com đã viết: > So this is what I have for my node exporter scraper. I was also trying > out DNS service Discovery which

[prometheus-users] Re: SNMP exporter

please refer this article. https://itforvn.com/prometheus-tu-a-den-z-phan-03-giam-sat-firewall-fortigate-qua-snmp-voi-prometheus/ Vào lúc 10:12:22 UTC+7 ngày Thứ Bảy, 18 tháng 7, 2020, andre...@gmail.com đã viết: > I am curious to see how you have this setup in the prometheus.yml. Which >

[prometheus-users] GaugeMetricFamily Timestamp with Pushgateway

Hello everyone, I am working on a tool to push historical metrics (1-5 min old) to push gateway. I have tried using the Gauge form prometheus-client but it does not support setting an older timestamp. GaugeMetricFamily seems to support it but i am not able to find an example of how to use it with