[prometheus-users] What is the use of AlertManager templates ?.

2020-05-11 Thread Abdul Rahuman Seeni Mohamed
Hi, I have the requirement to modify data of alert by creating templates (overriding default.tmpl) in alertManager. I have few questions about template in AlertManaer, What is the use of AlertManager?. Can we modify data of alert by creating new template and overriding default.tmpl ?. In w

[prometheus-users] what is the recommended value for --query.lookback-delta when we have varying frequencies of collection

2020-05-11 Thread Rajesh Reddy Nachireddi
Hi, what is the recommended value for --query.lookback-delta when we have varying frequencies of collection As we have different networking devices which are emitting the metrics at their own frequency for example: Device 1 to Device 10 --->streaming telemetry is collected every 1 second Device

Re: [prometheus-users] "Instance" returned by query data hiding

2020-05-11 Thread li yun
My data has been kept for 1 year, and the data is very valuable. I used IP addresses when I crawled before this, so now every query returns an IP address, and I want to hide these returned IP addresses. I now change to the host name, but the historical data will still appear IP address 在 2020年5

Re: [prometheus-users] SNMP

2020-05-11 Thread Bruce
you can try influxdb Le lundi 4 mai 2020 20:25:14 UTC+1, Colton Conor a écrit : > > Ben, > > I agree with you on LIbreNMS being too slow and is too outdated. Do you > have any recommendations other than that, or do you feel that all systems > are too slow and is too outdated compared to Promet

[prometheus-users] Re: How to add http_proxy environment variable to prometheus alertmanager.yml ?

2020-05-11 Thread Mubeen Nakade
Hi Pravin S, Please use below, its appropriate way and a 100% solution. In file ---> alertmanager.yml Under Global Section global: http_config: proxy_url: 'http://your-proxy:3128' On Tuesday, May 12, 2020 at 2:54:40 AM UTC+5:30, Pravin S wrote: > > Hi > > Please can anyone suggest how t

[prometheus-users] Re: Prometheus HTTPs setup questions

2020-05-11 Thread H T
Thanks Brian for all your help. I am now able to connect to remote extractor using server_name and through TLS on that particular server. On Saturday, May 9, 2020 at 12:23:15 AM UTC-7, Brian Candler wrote: > > On Saturday, 9 May 2020 02:40:03 UTC+1, H T wrote: > >> Thanks, Brian for the info. I w

[prometheus-users] Re: SNMPWALK PROBLEM

2020-05-11 Thread Bruce
shall i allow acces from host to prometheus on udp port number 161? i alreadu set a rule on my firewall to allow all services ! Le lundi 11 mai 2020 13:18:05 UTC+1, Brian Candler a écrit : > > If your firewall is blocking pings, then it may be blocking SNMP as well. > > Try adding a rule which per

[prometheus-users] Re: How to add http_proxy environment variable to prometheus alertmanager.yml ?

2020-05-11 Thread Pravin S
Thanks Sayf . That solution worked by adding the reference of proxy.conf inside the alertmanager.service. but still notification are not going to slack. Able to see the data output on alertmanager " http://localhost:9093/api/v1/alerts"; when instance was shutdown but still notification not get

Re: [prometheus-users] How to add http_proxy environment variable to prometheus alertmanager.yml ?

2020-05-11 Thread Pravin S
Thanks Sayf. I already have alertmanager.service file to start/stop the alertmanager. Is there any way to add the file reference inside this alertmanager.service file ? cat /usr/lib/systemd/system/alertmanager.service.d/proxy.conf [Service] Environment="HTTP_PROXY=http://proxy.example.com:

Re: [prometheus-users] How to add http_proxy environment variable to prometheus alertmanager.yml ?

2020-05-11 Thread sayf eddine Hammemi
For me it is easier to setup alert manager as a systemd service then add a drop-in directory to force proxy only on it with the file : /usr/lib/systemd/system/alertmanager.service.d/proxy.conf that contains [Service] Environment="HTTP_PROXY=http://proxy.example.com:80/"; "NO_PROXY=localhost,127.0.0

[prometheus-users] How to add http_proxy environment variable to prometheus alertmanager.yml ?

2020-05-11 Thread Pravin S
Hi Please can anyone suggest how to add the environment variable of http_proxy as i am facing issues with sending alert notifications to slack. I am able to see the alert coming Prometheus alert manager : local host:9093/#/alerts but they are not getting forwarded to slack due to firewall is

[prometheus-users] Re: PromQL: comparison to custom metric and/or static threshold

2020-05-11 Thread Brian Candler
Here are a couple of things to help understand why the original expression doesn't work as expected. 1. The comparison operators are filters, returning a vector of 0 or more elements which is subset of all the available timeseries, not a boolean value. (foo > my_custom_threshold) is comparing

Re: [prometheus-users] PromQL: comparison to custom metric and/or static threshold

2020-05-11 Thread Harald Koch
On Mon, May 11, 2020, at 11:47, Justin W wrote: > Hi all, > > I'm trying to compare the calculated filesystem used to either a static > threshold, or a custom threshold if a certain metric is present. What I have > so far is: > > ((avg(node_filesystem_used_bytes{mountpoint=~".*foo.*"}) by > (s

[prometheus-users] Re: PromQL: comparison to custom metric and/or static threshold

2020-05-11 Thread Brian Candler
There's an example of this in https://www.robustperception.io/using-time-series-as-alert-thresholds *"You could also provide a default, so only those teams wishing to override it need to configure a threshold. Here the default is 42:"* The trick is to get some other timeseries which has the same

Re: [prometheus-users] Prometheus is not showing the metric gathered from netdata

2020-05-11 Thread Yashar Nesabian
Changing the netdata master node fixed the problem, but I don't have any logical explanation for it. On Monday, May 11, 2020 at 2:06:46 AM UTC+4:30, Julius Volz wrote: > > I wonder if maybe at one point Netdata returned timestamps that are in the > future for those time series, and now your prod

[prometheus-users] SNMP exporter with Vertiv PDU

2020-05-11 Thread Hamed
Has anyone monitored a Vertiv PDU with SNMP exporter? What metrics are most valuable to monitoring PDUs. Anyone tried importing community dash 12104. I removed instance name in the query and I am not able to see any data for the table. default query from install of 12104 dash: (lgpPduRcpEntry

[prometheus-users] PromQL: comparison to custom metric and/or static threshold

2020-05-11 Thread Justin W
Hi all, I'm trying to compare the calculated filesystem used to either a static threshold, or a custom threshold if a certain metric is present. What I have so far is: ((avg(node_filesystem_used_bytes{mountpoint=~".*foo.*"}) by (site)/avg( node_filesystem_size_bytes{mountpoint=~".*foo.*"}) by (

[prometheus-users] Re: Alertmanager API cant create silences

2020-05-11 Thread Łukasz Mierzwa
What are you passing under "id"? You only pass id when editing existing silence (it must be an id of a valid active silence), not when creating a new one. On Monday, 11 May 2020 14:46:47 UTC+1, TechJunkie wrote: > > Hie all , > I am struck trying to POST a python dictionary as json for creating

[prometheus-users] Alertmanager API cant create silences

2020-05-11 Thread TechJunkie
Hie all , I am struck trying to POST a python dictionary as json for creating silence . The following is my data that i am posting to alertmanager silences endpoint: data ={ "id": id, "matchers": [ { "name": matcherName,

[prometheus-users] Re: SNMPWALK PROBLEM

2020-05-11 Thread Brian Candler
If your firewall is blocking pings, then it may be blocking SNMP as well. Try adding a rule which permits UDP port 161 from your source address. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receivi

Re: [prometheus-users] Re: [prometheus-developers] Looking for a maintainer for the collectd_exporter

2020-05-11 Thread Julius Volz
Awesome, thanks for the insight, Florian! I suggest to mark the collectd_exporter then, and move it into our junkyard organization after a while of nobody complaining. I'll send a PR for that. On Sun, May 10, 2020 at 9:36 PM Florian Forster wrote: > Hi Julius, hi Harald, hi lists, > > I'm not a

[prometheus-users] Drop metrics based on label values

2020-05-11 Thread piyush sharma
Hello , I want to achieve one thing . I have a label env which has 2 values prod and stage I want that if env = prod , then metrics should be collected and if env = stg metrics should be dropped. Is there any way I can achieve this ? I see the example below but it drops metrics based on t

[prometheus-users] Re: SNMP exporter

2020-05-11 Thread Brian Candler
It's the same question you asked on Apr 22: https://groups.google.com/d/topic/prometheus-users/KJlEfHqWSdE/discussion If you can't get SNMP to work with a Fortigate using snmpwalk, then I'm afraid this is not an issue with Prometheus. I suggest you either try your vendor for support, or a disc

Re: [prometheus-users] "Instance" returned by query data hiding

2020-05-11 Thread Stuart Clark
On 2020-05-11 10:47, li yun wrote: My instances are all public IP addresses. I hope that the instance returned when querying data is a hidden or disguised instance. Is there any way to do it? For example, the following return: {"status": "success", "data": {"resultType": "matrix", "result": [{"me

Re: [prometheus-users] remote_read: inconsistency between remote storage(influxDB) and Prometheus results.

2020-05-11 Thread Sohaib Omar
there is a command-line parameter called *lookback-delta *which controls the loopback. read more about it here: https://prometheus.io/docs/prometheus/latest/migration/#flags On Monday, 11 May 2020 12:26:26 UTC+5, Sohaib Omar wrote: > > Thanks, Stuart for the reply, is the look back configurable

[prometheus-users] Re: Alertmanager configuration

2020-05-11 Thread Da Sm
Thanks for the template snip - Here's what I finally ended up going with - *alertmanager.yml* slack_configs: - api_url: channel: '#' color: '{{ template "SLACK_MSG_COLOR" . }}' send_resolved: true title: '{{ template "SLACK_MSG_TITLE" . }}' text: '{

[prometheus-users] Re: AlertManager not running.

2020-05-11 Thread Saurabh Jain
Thank you Yashar ... I am able to run Alertmanager now .. There was special character in the file due to which it was getting exited from the process On Monday, May 11, 2020 at 3:50:24 PM UTC+5:30, Yashar Nesabian wrote: > > what is the content of your alertmanager.yml file? > Did you evaluate

[prometheus-users] Re: AlertManager not running.

2020-05-11 Thread Yashar Nesabian
what is the content of your alertmanager.yml file? Did you evaluate them using the command "amtool"? Do you get any errors when you run the alertmanager binary manually? e.g : /usr/local/sbin/alertmanager \ --config.file=/etc/alertmanager/alertmanager.yml \ --storage.path=/var/lib/alertmanager

[prometheus-users] Re: AlertManager not running.

2020-05-11 Thread Saurabh Jain
Hi, Pls find below output C:\Users\SaurabhJain\Desktop\Bharti\prometheus-2.17.1.windows-amd64.tar\prometheus-2.17.1.windows-amd64>promtool.exe check config prometheus.yml Checking prometheus.yml SUCCESS: 1 rule files found Checking alerts.yml SUCCESS: 1 rules found Thanks On Monday, May

[prometheus-users] Re: AlertManager not running.

2020-05-11 Thread Yashar Nesabian
Hi Can you please check your configuration file to see if they are correct? for prometheus: promtool check config /etc/prometheus/prometheus.yml for alertmanager: amtool check-config /etc/alertmanager/alertmanager.yml On Monday, May 11, 2020 at 2:04:00 PM UTC+4:30, Saurabh Jain wrote: > > > Hi

[prometheus-users] "Instance" returned by query data hiding

2020-05-11 Thread li yun
My instances are all public IP addresses. I hope that the instance returned when querying data is a hidden or disguised instance. Is there any way to do it? For example, the following return: {"status": "success", "data": {"resultType": "matrix", "result": [{"metric": {"server": "beijing", "dire

[prometheus-users] Right way to implement prometheus_client.multiprocess.MultiProcessCollector

2020-05-11 Thread 'Albert Aleksandrov' via Prometheus Users
Hi all! I have: 1. django app run with python manage.py runserver 2. celery worker run with celery -A project worker -l info 3. celery beat run with celery -A project beat -l info They will be deployed in their own pods in kubernetes. */metrics* endpoint is exposed in Django app but metri

[prometheus-users] AlertManager not running.

2020-05-11 Thread Saurabh Jain
Hi, I am trying to run AlertManager but it is not running even after I configured prometheus.yml file. pls take a look of yml file and kindly advice if I am missing any configuration. global: scrape_interval: 15s evaluation_interval: 15s external_labels: cluster: eu1 replica: 0

Re: [prometheus-users] textfile collector and system/application assertion tests

2020-05-11 Thread Ben Kochie
While this is a possible pattern, it doesn't typically follow Prometheus best practices. The idea behind Prometheus is you want to expose data directly from the thing being monitored, and make the logical decision for "ok/not-ok" on the Prometheus server. This allows for a lot of advantages over h

[prometheus-users] /mertics endpoint in Django process but metrics gathering in Celery process

2020-05-11 Thread 'Albert Aleksandrov' via Prometheus Users
Hi all! I have: 1. django app run with python manage.py runserver 2. celery worker run with celery -A project worker -l info 3. celery beat run with celery -A project beat -l info They will be deployed in their own pods in kubernetes. */metrics* endpoint is exposed in Django app but metrics

[prometheus-users] Re: SNMP exporter

2020-05-11 Thread Bruce
Yes i did Le lundi 11 mai 2020 07:57:33 UTC+1, Kiran Ali a écrit : > > Did you set source ip while configuring snmp on Fortigate? > > On Monday, May 11, 2020 at 7:28:41 AM UTC+5, Bruce wrote: >> >> Hi ! >> I'am monitoring snmp device using prometheus snmp exporter ! >> >> I already set up a rule

[prometheus-users] Re: Using service account IAM roles in EKS

2020-05-11 Thread Chelo Montilla
I'm trying to get it working with the latest version 0.8.0, but I'm getting this error: May 08, 2020 12:45:40 PM io.prometheus.cloudwatch.CloudWatchCollector collect WARNING: CloudWatch scrape failed com.amazonaws.services.resourcegroupstaggingapi.model.AWSResourceGroupsTaggingAPIException: User

Re: [prometheus-users] remote_read: inconsistency between remote storage(influxDB) and Prometheus results.

2020-05-11 Thread Sohaib Omar
Thanks, Stuart for the reply, is the look back configurable? I need my Prometheus queries result to be in sync with my remote storage. On Monday, 11 May 2020 12:11:06 UTC+5, Stuart Clark wrote: > > On 11/05/2020 08:06, Sohaib Omar wrote: > > > For example, even with the *read_recent: true, *when

Re: [prometheus-users] remote_read: inconsistency between remote storage(influxDB) and Prometheus results.

2020-05-11 Thread Stuart Clark
On 11/05/2020 08:06, Sohaib Omar wrote: For example, even with the *read_recent: true, *when a certain time-series has stopped being appended in remote_storage, Prometheus(the one which remote_reads) is still able to return the result at least for 5 to 6 minutes later. The last point for belo