Re: [prometheus-users] Debugging OOM issue.

2020-11-24 Thread Ben Kochie
No, concurrency only affects how many queries are running at the same time. On Wed, Nov 25, 2020 at 8:45 AM Yagyansh S. Kumar wrote: > Thanks, Ben. Was thinking of doing the same because a single query is > causing my Prometheus to go down occasionally. > One query though, will limiting the

Re: [prometheus-users] Debugging OOM issue.

2020-11-24 Thread Ben Kochie
Maybe set a lower `--query.max-samples` flag setting. The default is 50 million samples. I typically lower this to 20 million to avoid too-heavy queries. You can also lower the defualt `--query.max-concurrency=20` to avoid overloading. Likely, if you need to make large queries, you should

[prometheus-users] Selectors in kubernetes_sd_configs don't restrict services based on labels

2020-11-24 Thread Shubham Shrivastav
Hello, I'm trying to scrape all services that have labels *app: core. *However, after adding the below section to kubernetes_sd_configs, I'm not getting limited services in the Prometheus targets list. In fact, the configuration file does not save saying not able to parse the YAML config file.

[prometheus-users] Templating

2020-11-24 Thread Chaitanya Bayana
Hi All, We have configured multiple Prometheus alerts with one single template in Alertmanager configuration and every alert is triggered with Runbook and Grafana link. Now the problem is, All my alerts are referring to different Grafana dashboards. Currently whenever we receive any alert,

Re: [prometheus-users] Debugging OOM issue.

2020-11-24 Thread yagyans...@gmail.com
Thanks, Christian. Today I noticed something that is totally new to me. Prometheus went down and I got the query because of which it went down but strangely at that time I checked the server did not go OOM, the Memory dropped directly from constant usage of 77% to zero, but usually when a

[prometheus-users] Re: what's the best practice to collect metrics and write to different remote storage with different bear_token_file

2020-11-24 Thread jun min
BTW, someone also make another suggestions, maybe useful for people who have same scenerio. Instead of having a agent to scrape data for every tenant, we can use one prometheus to scrape the data, and write a remote write adapter to receive these data, split them, and route to different

[prometheus-users] what is the right way to setup alertmanager in Federation?

2020-11-24 Thread radhamani...@gmail.com
If we enable Alertmanagers in dedicated clusters, then how do we route the alerts to receiver ? Do we send the alerts to receivers directly from dedicated clusters? or should we route the alerts from dedicated clusters to central Federation Alertmanager? If yes, how to chain the alertmanagers?

[prometheus-users] Metrics API not registered when using promethus adapter

2020-11-24 Thread kumar k
Hi I have installed a new prometheus adaptor using this https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-adapter,i could see v1beta1.custom.metrics.k8s.io registered,but couldn't see the

Re: [prometheus-users] Re: How to enable STS to address CWE-693: Protection Mechanism Failure in node_exporter?

2020-11-24 Thread Selvam Elangovan
Perfect. you are spot on. Thanks for your inputs. It helps us. Thanks & Regards, Selvam E. On Tue, 24 Nov 2020, 23:00 b.ca...@pobox.com, wrote: > I'm guessing what's happened is: > 1. You've run an (unnamed) security scanner against node_exporter > 2. The scanner has come back with this

Re: [prometheus-users] Prometheus using AWS Timestream

2020-11-24 Thread Stuart Clark
On 24/11/2020 14:06, 'ellis...@googlemail.com' via Prometheus Users wrote: the guy that wrote the adapter suggests that a Grafana plugin would be used to read the information from Timestream in AWS. Yes, but that doesn't help for alerting, recording rules, etc. which are in Prometheus. --

[prometheus-users] Re: How to enable STS to address CWE-693: Protection Mechanism Failure in node_exporter?

2020-11-24 Thread b.ca...@pobox.com
node_exporter isn't accessed via a browser - it's accessed only from prometheus scrapes. If you configure prometheus to scrape using https, then it will only use https. STS won't make any difference. Furthermore, if you configure node_exporter to use TLS, then it will *only* serve TLS. It

[prometheus-users] How to enable STS to address CWE-693: Protection Mechanism Failure in node_exporter?

2020-11-24 Thread Selvam Elangovan
How to enable STS to address CWE-693: Protection Mechanism Failure in node_exporter? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: [prometheus-users] Prometheus using AWS Timestream

2020-11-24 Thread 'ellis...@googlemail.com' via Prometheus Users
the guy that wrote the adapter suggests that a Grafana plugin would be used to read the information from Timestream in AWS. On Tuesday, 24 November 2020 at 12:47:12 UTC Stuart Clark wrote: > On 24/11/2020 09:53, 'ellis...@googlemail.com' via Prometheus Users wrote: > > Hi all, > > > > Is

Re: [prometheus-users] Prometheus using AWS Timestream

2020-11-24 Thread Stuart Clark
On 24/11/2020 09:53, 'ellis...@googlemail.com' via Prometheus Users wrote: Hi all, Is anyone using Prometheus in AWS to monitor and if so have you thought about using Timestream as a remote storage solution? I can see that there is a remote write adapter available at

[prometheus-users] Prometheus using AWS Timestream

2020-11-24 Thread 'ellis...@googlemail.com' via Prometheus Users
Hi all, Is anyone using Prometheus in AWS to monitor and if so have you thought about using Timestream as a remote storage solution? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails

[prometheus-users] Re: Timescale DB setup

2020-11-24 Thread Harkishen Singh
Hey Sree hari, I had sent you a follow mail mentioning the details. Is it resolved by now? If not, feel free to mention on TimescaleDB slack on promscale channel: invite link

[prometheus-users] Re: Security on Prometheus target

2020-11-24 Thread b.ca...@pobox.com
1. basic_auth is HTTP basic authentication : a standard and well-documented HTTP mechanism. The exporter itself will have to implement this mechanism of course (or you can sit the exporter behind a proxy which implements it) 2. the