[prometheus-users] blackbox exporter returns Gateway Time-out when running the URL manually

2020-11-11 Thread nesa...@gmail.com
I have a blackbox exporter deployed on a K8S cluster, The problem is, some URLs (which are using the default http_2xx module) get "context deadline exceeded" in the logs (the timeout is 15s) It's weird because when I click on the blackbox exporter link in the Prometheus job, I get 504 Gateway Ti

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Akshay Sulakhe
Stupid error from my side, fixed it. Change was to add : i = Info('supplier_log_file', 'All Supplier related information', registry=registry) instead of just a single registry On Thursday, 12 November, 2020 at 11:10:22 am UTC+5:30 Akshay Sulakhe wrote: > Hi, > > Sorry for that, new to Goo

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Akshay Sulakhe
Hi, Sorry for that, new to Google Groups. I have pasted the formatted one below. Also note, I have changed the info line mentioned like this, as shown in prometheus client github i.info({'summary':line}) Still I get the same error. from prometheus_client import Info, Metric, CollectorR

Re: [prometheus-users] blackbox exporter - scraping with grafana cloud agent - using consul sd for blackbox address

2020-11-11 Thread david goodine
Brian, Thank you, that was very helpful - this is the config I ended up with (copy/paste breaks the yaml spacing): scrape_configs: - job_name: 'blackbox-ba-[% key "global/config/env" %]' metrics_path: /probe params: target: ['mineralsoft.dev.ba.drillinginfo.com'] consul_sd_configs: - services: ['

[prometheus-users] Re: Permission issues "open /data/queries.active: permission denied"

2020-11-11 Thread sshark wsk
Managed to overcome the issue by creating a separate POD for initContainer which changed the /data folder permission Thank You On Monday, November 9, 2020 at 12:37:02 AM UTC+11 sshark wsk wrote: > Hi All, > > I am trying to install prometheus via Gitlab managed apps to monitor my > micro k8s c

[prometheus-users] Routing Prometheus alerts to MS Teams channels

2020-11-11 Thread Zhang Zhao
Hi, Anyone has integrated Prometheus alerts to MS teams? I configured the alert manager to route alerts. The msteams pod was running. However I didn’t see anything in the log. Any advice where was wrong??? prometheus-msteams-7b4c84455f-lpjbv 1/1 Running 0 3h15m {“branch”:“HEAD”,“build_date”:“20

Re: [prometheus-users] blackbox exporter - scraping with grafana cloud agent - using consul sd for blackbox address

2020-11-11 Thread Brian Brazil
On Wed, 11 Nov 2020 at 21:46, david goodine wrote: > > Hi, > We are running blackbox exporter as a Nomad allocation, so its ip:port is > dynamic. We had been running a prometheus instance, also in Nomad, and it > was configured with consul-template to dynamically set the __address__: > > - targe

[prometheus-users] blackbox exporter - scraping with grafana cloud agent - using consul sd for blackbox address

2020-11-11 Thread david goodine
Hi, We are running blackbox exporter as a Nomad allocation, so its ip:port is dynamic. We had been running a prometheus instance, also in Nomad, and it was configured with consul-template to dynamically set the __address__: - target_label: __address__ replacement: [% range $i, $s :=

Re: [prometheus-users] Prometheus query to count unique label values

2020-11-11 Thread Matthias Rampke
You can directly use the count function for this: count by(customer) (customer_alerts) /MR On Wed, Nov 11, 2020, 17:41 Shilpa Akhilesh wrote: > Hi, > am looking for a way to count the unique label values and show each > count for each customer name. Here are my metrics. I need to get the cou

Re: [prometheus-users] Re: Tool for performance/load test

2020-11-11 Thread Bartłomiej Płotka
Hi, We wrote also some tooling for generating blocks with arbitrary data: http://github.com/thanos-io/thanosbench Somo yolo part of podcast we did showing how to do it: https://youtu.be/j4TAGO019HU?t=1251 Kind Regards, Bartek Płotka (@bwplotka) On Wed, 11 Nov 2020 at 16:34, Anoop Mohan wrote:

[prometheus-users] Prometheus query to count unique label values

2020-11-11 Thread Shilpa Akhilesh
Hi, am looking for a way to count the unique label values and show each count for each customer name. Here are my metrics. I need to get the count as apple=1, orange=1. customer_alerts(alertname="a", customername="apple") customer_alerts(alertname="b", customername="orange") cu

Re: [prometheus-users] Re: Tool for performance/load test

2020-11-11 Thread Anoop Mohan
Thanks Richard for your suggestion. Found another tool https://artillery.io/ for doing this, as I just need to check the performance of the GET requests. Thanks & Regards, Anoop Mob# +91-7293009486 E-mail : anoopmohan@gmail.com On Thu, Nov 5, 2020 at 4:11 AM Richard Anton wrote: > Have y

[prometheus-users] Handling federated data

2020-11-11 Thread Anoop
Hi, I have a global prometheus which is federating data from the cluster prometheus instances. The cluster prometheus is responsible for scraping data from other applications inside the cluster. The Grafana data source is configured to point to global prometheus. [image: federation.jpg] Now,

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Brian Candler
Well, your python without linebreaks is unreadable. However I do notice this: i.info({line}) which means you are passing a Python *set* rather than a *dict* and I don't think that will turn out well. >>> {"hello"} {'hello'} >>> type({"hello"}) -- You received this message because you are

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Akshay Sulakhe
Hi, Agree, Along with that, I will also be sending counters for errors. These counters will be maintained in the script directly. Any idea about the current issue? On Wednesday, 11 November, 2020 at 5:50:51 pm UTC+5:30 b.ca...@pobox.com wrote: > On Wednesday, 11 November 2020 10:19:27 UTC, A

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Brian Candler
On Wednesday, 11 November 2020 10:19:27 UTC, Akshay Sulakhe wrote: > > I want to send individual log file lines to push-gateway. > 1. Prometheus is not a logging system, it's a metrics system. It does not handle individual log entries, only periodic samples in a timeseries. 2. Push-gateway is no

[prometheus-users] Re: Sending Info object to push gateway failing

2020-11-11 Thread Akshay Sulakhe
Error log formatted: Traceback (most recent call last): File "complete.py", line 21, in _send_data_to_gateway(line) File "complete.py", line 6, in _send_data_to_gateway i = Info('supplier_log_file', 'supplier_infor', reg) File "/home/ubuntu/.local/lib/python3.6/site-packages/prometheus_clien

[prometheus-users] Sending Info object to push gateway failing

2020-11-11 Thread Akshay Sulakhe
Hello, I want to send individual log file lines to push-gateway. The best case I thought of this was to use Info object. The below mentioned code is working for Summary or Gauge, but not for Info. I am getting an iteration warning. What am I doing wrong? I am new to python and prometheus/push