Re: [prometheus-users] How do you add scrape targets to a Prometheus server that was installed with Kubernetes-helm?

2020-06-11 Thread Zhang Zhao
Thanks for you advice. Yes, the VMs are outside the cluster. For adding additional scrape configs, what file specifically shall I update? Are you using stable/prometheus-operator Helm chart to deploy Prometheus as well? > On Jun 11, 2020, at 9:01 PM, 赵一晗 wrote: > > There are two ways to solve

[prometheus-users] Re: How do you add scrape targets to a Prometheus server that was installed with Kubernetes-helm?

2020-06-11 Thread 赵一晗
There are two ways to solve this problem: 1. servicemoniors; You can create a corresponding crd servicemonior 2. additionalScrapeConfigs you could add additionalScrapeConfigs to your prometheus If the additional collection point is outside the cluster ,I think the second one additiona

[prometheus-users] generatorURL field in AlertManager

2020-06-11 Thread 林浩
Hi, Is there is any way we can customize the field "generatorURL" , for example, replace pod name prometheus-84c7d47b68-t47m2 in the below example to a pod IP address? "generatorURL" : "http://prometheus-84c7d47b68-t47m2:9090/graph?g0.expr=ciaas_latest_pod_ready_time%7Bjob%3D%22assertion-po

Re: [prometheus-users] Re: Prometheus not able to start and gives error "opening storage failed:: found unsequential head chunk error"

2020-06-11 Thread Murali Krishna Kanagala
Try deleting the contents WAL folder and start the service. Ideally you can delete the last WAL where the service is failing to start. It is in the log just before Prometheus stopping. On Thu, Jun 11, 2020, 2:26 AM neel patel wrote: > Hi Julien, > > Unfortunately i don't have previous logs. And

[prometheus-users] vector cannot contain metrics with the same labelset

2020-06-11 Thread li yun
I execute the following query label_replace(sum_over_time(augmento{coins="xxx"}[20m]), "instance", "", "", "") Got the following error: vector cannot contain metrics with the same labelset What am I doing wrong? thank you very much for your help -- You received this message because you are

[prometheus-users] How do you add scrape targets to a Prometheus server that was installed with Kubernetes-helm?

2020-06-11 Thread Zhang Zhao
*Background: * *I *have installed Prometheus on AKS using the helm chart stable/prometheus-operator. *The Problem:* I had couple of VMs (Linux and Windows), where node exporter and wmi exporter had installed that need to connect to the Prometheus running on Kubernetes. I cannot figure out h

[prometheus-users] Scripts for Windows Metrics - Required

2020-06-11 Thread Freddy Mack
Hello, Can I have scripts for the below Windows Metrics: § CPU utilization Warning at 89%, Alarm at 90% § Memory utilization Warning at 90%, Alarm at 95% § File System uti

[prometheus-users] Prometheus + PushGateway + TLS - How to?

2020-06-11 Thread Michael Black
I'm trying to set up Prometheus and Pushgateway on the same box with TLS support. I have ngix doing a reverse proxy and it's working but I can't the applications to work. When I try to specify the target in the prometheus.yml it breaks the service complaining about the bind address already bein

[prometheus-users] Difference on counter per time range

2020-06-11 Thread Marcos F. Lobo
Hi all, I have a metric in my application (using micrometer) and I have a counter that increases each time a method is executed. Of course, this counter is reset only if the app is restarted. This metric is exposed to Prometheus and I can query it in the UI. Now the question. Is there a way to

[prometheus-users] Data link from Graph to Table in Grafana

2020-06-11 Thread anya...@gmail.com
Hello, dear colleagues! I created two dashboard with the same metric: Table and Graph. Both dashboard have similar labels "instance", "job" and "store". I added a data link to the Filed "Store" in the Table (it's a column), but click on this link on each store opens the whole Graph. Could you he

[prometheus-users] Re: aggregation rule results do not match raw data

2020-06-11 Thread 'Michael Lando' via Prometheus Users
picture of the diff https://user-images.githubusercontent.com/26199476/84378497-ed4b7b80-abec-11ea-8923-665d067607f1.png On Thursday, June 11, 2020 at 3:18:21 PM UTC+3 Michael Lando wrote: > hi > *,*in order to improve the query time we setup an aggregation rule, > record: fastly:rt_requests_tota

[prometheus-users] [ANN] errors.fail - free service for probing errors

2020-06-11 Thread Daniel Lorch
Dear all I have recently started to use Prometheus and blackbox_exporter. My main interest was to build up SLI/SLO dashboards for the services I run. The SLI dashboards are configured to compute the ratio between "all god events" divided by "all events" over a period of 28d, as suggested by the

Re: [prometheus-users] How to specify lookback using Prometheus Operator

2020-06-11 Thread Christian Hoffmann
Hi, On 6/9/20 12:16 AM, Shallow Purple wrote: > We have certain metrics which are aggregated and  for which datapoint > comes in every 10 min interval or 1 hour interval.  > So, I ask for data for right now, there might not be any but few minutes > later, one datapoint will arrive.  Hence, we want

[prometheus-users] Email notification doesn't Work

2020-06-11 Thread Frederic Arnould
Hello, Somebody could check my configuration ? My postfix works correctly, but not mails in my prometheus container. [root@admin-toto ~]# docker exec -it monitor_prometheus sh /prometheus # cat alertmanager.yml global: resolve_timeout: 5m smtp_smarthost: 10.10.10.10 smtp_from: al...@aler

Re: [prometheus-users] Different rules for different targets

2020-06-11 Thread Frederic Arnould
Hello, Many Thanks, it works ! Have a nice day, Regards Le mardi 9 juin 2020 18:07:51 UTC+2, Christian Hoffmann a écrit : > > Hi, > > the simplest adjustment would be the following, it seems: > > Change your first rule to stop applying to toto2 and change the second > one to only apply for

Re: [prometheus-users] Question regarding Open Metrics format and how to handle errors

2020-06-11 Thread vivek kodira
Thanks Stuart. For anyone else with this issue, there is indeed an example [here](https://github.com/prometheus/docs/blob/master/content/docs/instrumenting/exposition_formats.md) that I had missed: The error is passed as a label. `msdos_file_access_time_seconds{path="C:\\DIR\\FILE.TXT",error="C

[prometheus-users] Re: Max unspecified value for Promtool unit testing

2020-06-11 Thread Brian Candler
The scrape time. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit htt

Re: [prometheus-users] how to get precise scape timestamp

2020-06-11 Thread 林浩
I see. many thanks Brain! 在 2020年6月10日星期三 UTC+8下午8:34:36,Brian Candler写道: > > Not in prometheus - because it's an API. The consumer of the API is > responsible for rendering the time in human-readable form. >> >> > However, you can always write a little Python script or whatever that > replaces

[prometheus-users] Re: Prometheus not able to start and gives error "opening storage failed:: found unsequential head chunk error"

2020-06-11 Thread neel patel
Hi Julien, Unfortunately i don't have previous logs. And i don't think, it is related to disk as i have ~28GB storage available. Below is the output of my root file system. /dev/sda396G 69G 28G 72% / /dev/sda1 297M 207M 91M 70% /boot tmpfs 378M 0 378M 0%

Re: [prometheus-users] Prometheus not able to start and gives error "opening storage failed:: found unsequential head chunk error"

2020-06-11 Thread Julien Pivotto
That could have been triggered by something else (oom, disk full..) Do you have the logs from before that point? On 10 Jun 23:50, neel patel wrote: > Prometheus was working fine before 2 days and today when i stop and start > it again, it shows below error and not able to start the prometheus.