Re: [prometheus-users] How to design a well target labels scheme?

On 18/12/2020 02:54, Allenzh li wrote: Hi I use prometheus to monitor service. At first, it was simple. I use four labels(team, product, service, instance) to identify a service, the metric like ``` metric_name{team="t1", product="p1", instance="i1", service="s1", other business label} ```

Re: [prometheus-users] Preserve labels during Aggregation

On 17/12/2020 22:43, Raghu Udiyar wrote: I supposed it wouldn't be an aggregation - its more like a filter. What I want is to return the series with the max value, with all labels intact. -- It does sound a bit like you are wanting topk. Does that do what you are looking for? -- You

Re: [prometheus-users] Preserve labels during Aggregation

On 17/12/2020 17:57, Raghu Udiyar wrote: Hello When using aggregations such as `max(metric1) by (lable1)`, all the other labels are stripped. Is it possible to preserve the labels, akin to *selecting* the `max` series. This is more of a filter, not an aggregation. I'm not quite sure I

Re: [prometheus-users] Port Monitoring

On 16/12/2020 08:06, Anthony Billones wrote: Hi, We have multiple containers in an instance. based on my understanding, we would need to add a clientlib to each of the container. Is there a way that we can add something to the instance, instead of per container, for prometheus to monitor the

Re: [prometheus-users] Bind node_exporter to listen only from a foreign ip

On 14/12/2020 23:03, Jim Daemon wrote: Hello is it possible to make node exporter to listen only from specific IP, that ip is not a local interface, it can be the ip of another server ex prometheus server. This would be usefull if you dont want everyone in the netowork to access the metrics

Re: [prometheus-users] Typical usecase for using the "amtool alert add" command

r example). Are you able to give some more information on what use cases you are trying to handle? -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails fr

Re: [prometheus-users] How do I set the maintenance cycle

On 2020-12-14 10:25, zhengwei y wrote: How do I set the maintenance cycle ? such as silence all alarms from 0:00 to 1:00 am every day? You can create silences in advance & there is an API to create them automaticlly. -- Stuart Clark -- You received this message because you are subscr

Re: [prometheus-users] Best practice for gathering metrics from client sites

that you are wanting to monitor). -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.co

Re: [prometheus-users] Couldn't start prometheus server

On 14/12/2020 07:23, luan minh wrote: -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com

Re: [prometheus-users] How to enable Multitenancy in Prometheus in Cloud foundry

On 09/12/2020 15:22, Animesh Kumar wrote: Hi Team, Thank you for the response, Is there a document to deploy Thanos as a cloud foundry application? Unfortunately I'm not an expert in either Thanos or Cloud Foundary. Ben & co does such a thing exist that you know of? -- You received this

Re: [prometheus-users] Hunting down the root cause of fluctuating node_filesystem_avail_bytes

On 09/12/2020 14:48, iono sphere wrote: I am not sure who could I ask this, but I would like to try here. Currently, I'm seeing something weird in my server. Thanks to Prometheus and Node-Exporter, I have seen that node_filesystem_avail_bytes has been fluctuating up and down for hundreds of

Re: [prometheus-users] How to enable Multitenancy in Prometheus in Cloud foundry

On 09/12/2020 13:10, Animesh Kumar wrote: Hi Team, I am trying to check if we can make Prometheus tenant aware in such a way that there is a data separation. Prometheus has no native support for multi-tenancy. All data within a single Prometheus server is stored together. It would be

Re: [prometheus-users] Re: Zero downtime upgrade of node_exporters

15 second scrape interval, the chances of a lost >scrape >> are pretty low. And even then, the Prometheus design is robust >against a >> few lost scrapes. >> >> Just test it carefully, and have a good rollback plan. >> >> On Tue, Dec 8, 2020 at 9:52 PM Stuart Cla

Re: [prometheus-users] Promql is a bit complicated. Is there any way to reduce the difficulty of use？

On 09/12/2020 08:34, Allenzh li wrote: The key problem is that ordinary users need to learn PromQL, even if grafana is provided, the cost of promql learning cannot be reduced. It is not easy for everyone to learn PromQL. If users need to create/update dashboards or alerts then yes they need

Re: [prometheus-users] Promql is a bit complicated. Is there any way to reduce the difficulty of use？

On 09/12/2020 06:50, Allenzh li wrote: When create a prometheus alerting rule, the promql is a bit complicated for ordinary users. Since I want to hide native promql expr and labels, ordinary users only select some metric name or labels in a web page then can create a alerting rule. Is

Re: [prometheus-users] Re: Zero downtime upgrade of node_exporters

On 08/12/2020 18:21, Feder John wrote: Basically my question is: * How would you solve running 2 exporters on the same hosts, exposing 2 sets of metrics to 2 different ports? Running multiple instances of the same exporter is generally not a problem. You just need to ensure you set the

Re: [prometheus-users] Gauge Metrics not getting updated

On 04/12/2020 21:54, Victor Augusto Farias Dinis wrote: Hi there! I am trying to build a few set of metrics for the health information of my Spring Boot Application (it has the Actuator framework as the metrics aggregator). At first, I have tried to implement a gauge metric, intercepting the

Re: [prometheus-users] Impact of rule group iteration misses

Are you saying there are 3 million time series for the http_server_requests_seconds_bucket metric, or in total for the server? Looking at your query the uri label looks very problematic - if that is the URI called by an external Internet user that has infinite cardinality, as they could just

Re: [prometheus-users] PromQL query to sort by numbers

On 30/11/2020 13:44, Tom005 wrote: Ok yeah, I can see that and I can do that. I'm actually using the graph visualisation though, which I need. Is there a way to sort from that? I'm not an expert, so you might be better asking the Grafana people, but google does mention how to do it via the

Re: [prometheus-users] PromQL query to sort by numbers

On 30/11/2020 13:31, Tom005 wrote: Right, I am using grafana to display. Is there a way to do that do you know? Appreciate that it might be going slightly off topic away from Prometheus. Exactly how you do it will depend on the visualisation you are using and the version. For example for a

Re: [prometheus-users] PromQL query to sort by numbers

On 30/11/2020 13:06, Tom005 wrote: Sorry, yeah I actually meant the metric labels, I'd like to sort from the metric label in that order. How data is displayed is up to whatever system is doing the API query. For example Grafana has various sort options. -- You received this message because

Re: [prometheus-users] PromQL query to sort by numbers

On 30/11/2020 11:52, Tom005 wrote: I have a metric that I'd like to sort by numbers. Currently it is sorted like this: 0, 1, 11, 12, 13... 2, 20,21... etc. I'd like it to go like this: 0, 1, 2, 3, 3...10, 11, 12... etc. Is that possible? How do you mean you have a metric sorted like that? Do

Re: [prometheus-users] losing metrics

can reach 15 On the >other >hand I am saving that information in a database and I don't really need >that much data > >El jue, 26 nov 2020 a las 15:31, Stuart Clark >() >escribió: > >> On 26/11/2020 17:18, Josefo Serra wrote: >> > Hi, I'm losing metrics between

Re: [prometheus-users] losing metrics

On 26/11/2020 17:18, Josefo Serra wrote: Hi, I'm losing metrics between scraps and I understand that it's because I scrape every 10 minutes and they must "expire" or something. Could someone tell me which parameter I have to modify? Thanks! The maximum scrape interval should be 2 minutes, so

Re: [prometheus-users] Monitor java heap space used in my APP

Is your Java application being directly instrumented using the Java client library, or are you using the JMX exporter? On 26 November 2020 10:18:09 GMT, Bharathwaj Shankar wrote: >I have configured prometheus for my java app recently.I frequently need >to >monitor java heap space used by the

Re: [prometheus-users] Alert goes to Firing --> Resolved --> Firing immediately.

On 25/11/2020 16:27, Yagyansh S. Kumar wrote: On Wed, 25 Nov, 2020, 9:34 pm Stuart Clark, <mailto:stuart.cl...@jahingo.com>> wrote: Is the second instance still running? If you are having some cluster communications issues that could result in what you are seeing. Both

Re: [prometheus-users] Prometheus using AWS Timestream

On 25/11/2020 16:27, Ryan Booz wrote: As the makers of Promscale, we're very attuned to the needs of effective Prometheus deployments. With that in mind, one thing to consider with Timestream is that ingest performance from a single client seems to be a current limitation. The creator of this

Re: [prometheus-users] Alert goes to Firing --> Resolved --> Firing immediately.

. If you look in Prometheus (UI or ALERTS metric) does the alert continue for the whole period or does it have a gap? On 25 November 2020 14:58:50 GMT, "Yagyansh S. Kumar" wrote: >On Wed, 25 Nov, 2020, 8:26 pm Stuart Clark, >wrote: > >> How many Alertmanager instances

Re: [prometheus-users] Alert goes to Firing --> Resolved --> Firing immediately.

How many Alertmanager instances are there? Can they talk to each other and is Prometheus configured and able to push alerts to them all? On 25 November 2020 14:07:41 GMT, "Yagyansh S. Kumar" wrote: >Hi Stuart. > >On Wed, 25 Nov, 2020, 6:56 pm Stuart Clark, >wrote: &g

Re: [prometheus-users] Alert goes to Firing --> Resolved --> Firing immediately.

On 25/11/2020 11:46, yagyans...@gmail.com wrote: The alert formation doesn't seem to be a problem here, because it happens for different alerts randomly. Below is the alert for Exporter being down for which it has happened thrice today.   - alert: ExporterDown     expr: up == 0     for: 10m   

Re: [prometheus-users] Different databases for different targets

Prometheus stores data in a time series database, which is designed specifically for the needs of the application. That data is stored on disk in a variety of files and directories, including a Write Ahead Log (WAL) and set of blocks. Running PromQL queries is how you can see what is stored in

Re: [prometheus-users] Prometheus using AWS Timestream

On 24/11/2020 14:06, 'ellis...@googlemail.com' via Prometheus Users wrote: the guy that wrote the adapter suggests that a Grafana plugin would be used to read the information from Timestream in AWS. Yes, but that doesn't help for alerting, recording rules, etc. which are in Prometheus. --

Re: [prometheus-users] Prometheus using AWS Timestream

On 24/11/2020 09:53, 'ellis...@googlemail.com' via Prometheus Users wrote: Hi all, Is anyone using Prometheus in AWS to monitor and if so have you thought about using Timestream as a remote storage solution? I can see that there is a remote write adapter available at

Re: [prometheus-users] Storing log events data

On 23/11/2020 21:41, kiran wrote: Hello I am trying to push log events for lambda functions in Prometheus. I am trying to see if we can even save this kind of data and if so any recommended structure in Prometheus. E.g whenever a lambda function is invoked, AWS puts log events data and each

Re: [prometheus-users] How to query a pushgateway for metrics via Python?

library there is the delete_from_gateway method, but otherwise you can just use the requests library (or urllib) to call the API - the calls are just standard HTTP(s) requests. Best Peter Den tor. 19. nov. 2020 kl. 18.52 skrev Stuart Clark mailto:stuart.cl...@jahingo.com>>: On 18/1

Re: [prometheus-users] Re: Use different receiver for each list in the blackbox file.

  label2: value So, in total targets:   - target1   - target2 labels:   label1: value   label2: value Em sexta-feira, 20 de novembro de 2020 às 14:02:12 UTC-3, Stuart Clark escreveu: On 20/11/2020 16:47, juan chaves wrote: what did you say i understand. however

Re: [prometheus-users] Re: Use different receiver for each list in the blackbox file.

On 20/11/2020 16:47, juan chaves wrote: what did you say i understand. however there is the blackbox_exporter and the files site01.yml and site02.yml in file_sd_configs, I need each one to direct to an alert rule. then it is easy to target the alert rules matching the alertmanager routes.

Re: [prometheus-users] The possibility of multiple push gateways

e cron job will also fail alongside the node exporter. Equally if the node exporter fails or has a blip it doesn't stop the cron job from recording metrics, as that is just a file creation operation on the server rather than requiring an API call. -- Stuart Clark -- You received this message b

Re: [prometheus-users] Metrics with Future Time stamp and value

On 19/11/2020 22:54, Brian Brazil wrote: On Thu, 19 Nov 2020 at 21:53, Curious > wrote: Hello Everyone, I'm using Prometheus metrics to train Facebook Prophet to forecast data for next 15 minutes. I plan to put back the forecasting data back into

Re: [prometheus-users] How to query a pushgateway for metrics via Python?

On 18/11/2020 21:31, Peter Toft wrote: A variant that I could use - in lack of better - would be to delete all metrics from Python Den ons. 18. nov. 2020 kl. 11.46 skrev Peter Toft mailto:peter.t...@gmail.com>>: I have a case where I probably have to push say 200 metrics from Python

Re: [prometheus-users] Windows Process Monitoring

On 17/11/2020 14:09, Aleksandar Ilic wrote: Thanks for the info. Is the process monitoring provided by win exporter any good and can it be used? The windows exporter is just exposing metrics from various Windows sources, so they are as good as those different sources. You won't

Re: [prometheus-users] The possibility of multiple push gateways

On 17/11/2020 03:42, Andy Pan wrote: I think you might misunderstand what I said, the load-balancer is not for Prometheus collection metrics (Prometheus collects metrics from all push gateways) but for business servers pushing metrics. In this case, would this be the workaround? If you have

Re: [prometheus-users] Actions on Alerts Alertmanager

On 16/11/2020 22:15, Jhanssen Fávaro wrote: Hi Folks, Quick question about actions on alerts, is there anyway to take some action upon an alert that was caught by alertmanager ? I mean in a way to automatically resolve the incident, for exemple executing a playbook or calling ansible-tower for

Re: [prometheus-users] Sawarm service discovery not finding correct endpoint port

On 16/11/2020 21:12, Carlos Colaço wrote: Prometheus is using port 80 instead of 8080 when using service discovery to get Cadvisor containers. Config: ```   # Create a job for Docker Swarm containers.   - job_name: 'dockerswarm'     dockerswarm_sd_configs:   - host:

Re: [prometheus-users] The possibility of multiple push gateways

On 16/11/2020 02:57, Andy Pan wrote: Is there a right path forward for Prometheus to collect metrics from multiple push gateways directly instead of going through a load-balancer? There is nothing special about the push gateway as far as Prometheus is concerned. It is just a target to

Re: [prometheus-users] Get recent value if a metric

it every 2 minutes, so there would be no issues with staleness. On Fri, Nov 13, 2020 at 4:03 AM Stuart Clark <mailto:stuart.cl...@jahingo.com>> wrote: On 13/11/2020 02:47, kiran wrote: > Hello all > > I have a use case where I have a metric coming once

Re: [prometheus-users] The possibility of multiple push gateways

On 13/11/2020 08:34, Andy Pan wrote: I've been investigating the push gateway for the past few days and I read this page https://prometheus.io/docs/practices/pushing/ which shows some pitfalls when using push gateway, I noticed there is a single point issue with push gateway, but I was

Re: [prometheus-users] Get recent value if a metric

On 13/11/2020 02:47, kiran wrote: Hello all I have a use case where I have a metric coming once every 24 hours and that time varies per team. Now for each team we want to get most recent value of that metric. Here issue is I don’t know the offset or time duration as to when was the last

Re: [prometheus-users] promql to cut label name

On 10/11/2020 14:32, ishu...@gmail.com wrote: Hi, I have a query with promql. I have prom sd configuration to scrape metrics from my kube cluster. I want to know if it is possible to cut string and apply it as label name. My project has test01, test02 and preprod environments but namespaces

Re: [prometheus-users] Using the Promstack in Serverless Environments?

On 03/11/2020 14:54, Tim Schwenke wrote: Whenever I have (almost) bare metal servers, VMs or managed container clusters like Kubernetes with GKS / EKS or something like AWS ECS, going for a stack consisting out of Prometheus, Grafana, Alertmanager etc. is almost a no-brainer for me at this

Re: [prometheus-users] Prometheus alert not working for an event based metric

On 19/10/2020 22:02, Arnav Bose wrote: Hi, I have a metric which sends data only in case of a specific event. In other words, it will not have regular continuous telemetry every 15 seconds, but it will be there for a single data point. Now, I configured an alert to check if the metric exists

Re: [prometheus-users] Deploy Pushgateway across multiple pods

On 20/10/2020 00:09, Quan Chau wrote: Is there any workaround for this? Or Pushgateway is not supposed to be deployed across multiple pods at all? Pushgateway has no clustering ability, so you should only run a single instance. -- You received this message because you are subscribed to the

Re: [prometheus-users] keep stalled metric until prometheus scrapes new value for the metric

Is that ID something to do with the event or related to something else? Label should be very carefully used to ensure cardinality is controlled. Things like user IDs, IP addresses or other unique references should not be used. If that is a unique ID that label should be removed. If you are

Re: [prometheus-users] AWS lambda functions

On 2020-10-15 11:15, kiran wrote: Hello all Can Prometheus be used to monitor AWS lambda functions? If so, please point me in right direction? Yes. You can use the CloudWatch Exporter to fetch information for all AWS products, including Lambda. -- Stuart Clark -- You received

Re: [prometheus-users] Re: Prometheus HA Setup.

On 10/10/2020 08:43, yagyans...@gmail.com wrote: d) If we do use 2 separate disks for the 2 instances, how will we manage the config files? I mean is there any way to make the changes on any one instance and those get replicated to other instance automatically or will we have to do that

Re: [prometheus-users] Alerting dashboard solution

or acknowledge. Any tool that you could recommend? Have you looked at Karma? https://github.com/prymitive/karma -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails fro

Re: [prometheus-users] Way to search and count different texts in different logfiles

that can do this in a siple way? This sounds like a good fit for mtail or the grok exporter: https://github.com/google/mtail https://github.com/fstab/grok_exporter -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users&q

Re: [prometheus-users] query_range returns no results when using some step values

On 23/09/2020 20:25, Francois Valiquette wrote: - What's the prometheus version?     -> 2.15.2 - What's the scrape interval for this metric?     -> scrape_interval: 30m Due to staleness the maximum scrape interval is about 2 minutes, so you will be seeing the metric regularly going stale,

Re: [prometheus-users] Re: Metric type for basic web analytics

On 15/09/2020 06:11, Nick wrote: Keeping cardinality explosion in mind, what's a decent maximum number of exported metrics that can be considered performant for scraping and time-series processing? As I mainly need the counter total, I can split the web analytics to reduce the number of

Re: [prometheus-users] Prometheus disconnected data recovery

On 15/09/2020 04:16, tiecheng shen wrote: Hello, I am a newbie to prometheus. I have a requirement. When the prometheus server and the captured client are disconnected from the network, prometheus cannot capture the data when the network is disconnected, and the graph will be disconnected when

Re: [prometheus-users] How to keep data of removed hosts?

to use? -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the

Re: [prometheus-users] How to keep data of removed hosts?

On 10/09/2020 10:48, Martin Emrich wrote: Hello! Our prometheus contains metrics of our kubernetes cluster. Today, I wanted to look at data of a node (EC2 instance on AWS) that has been removed yesterday. But all the data regarding the VM is gone. In contrast, data of a Kubernetes Pod that

Re: [prometheus-users] Monitoring rate of events

On 08/09/2020 14:51, John Dexter wrote: I'm looking at adopting Prometheus for our system, one thing we want to monitor are incoming alarms (and alarm clearances). Metrics of use would be: * Total number of active alarms * Rate of alarms being raised * Rate of alarms being cleared The

Re: [prometheus-users] Modifying labels on default Prometheus metrics

On 08/09/2020 13:35, Ayush Kumar wrote: Hi Everyone, I work with .NET Core applications and we use Prometheus along with Grafana for dashboarding. I wanted to know if there's a way to add a new Label to the default metrics that Prometheus has, for example:

Re: [prometheus-users] Implemention advice: Prometheus for mature Windows client/server system

se you can write your own exporter in a variety of languages - as long as it is possible to get the data out of the application using some mechanism. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this g

Re: [prometheus-users] the timestamp of data points in prometheus

Prometheus should take into account the time taken to complete the scrape. But for a very overloaded server anything could happen. Note that where you have multiple things to scrape Prometheus will try to spread things over the scrape period. For example with 10 targets being scraped every 2

Re: [prometheus-users] Prometheus generate status metric (Value: 0, 1, 2, 3)

On 14/08/2020 18:22, Thomas Berger wrote: Thanks for the quick replies. An exporter's goal of only making the metrics available is perfectly fine. It doesn't have to be the exporter who carries out an assessment, but somebody should do it, because without an evaluation of the values ​​metrics

Re: [prometheus-users] Re: file_sd_configs custom params for each target

"job": "vmware" }, "params": { "section": ["origin"] } } ] You should be able to do something like this via relabelling. Basically you can encode extra information in your target using delimiters such as : and then split that in the rel

Re: [prometheus-users] Newbie question

You will need an exporter to convert that format into the Prometheus text format to allow it to be scraped. I don't know if there is something already available, but if not it should be fairly straightforward to create something using the language of your choice and one of the Prometheus

Re: [prometheus-users] Re: Prometheus for Solr Monitoring

-- [1] https://groups.google.com/d/msgid/prometheus-users/a022682c-929e-4743-8266-96590d3bf464o%40googlegroups.com?utm_medium=email_source=footer -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this

Re: [prometheus-users] Prometheus for Solr Monitoring

ped" level=error ts=2020-08-07T10:03:08.155Z caller=main.go:764 err="opening storage failed: lock DB directory: resource temporarily unavailable" Any help would be much appreciated. How are you storing the data in Prometheus? A local hard drive? -- Stuart Clark -- You received

Re: [prometheus-users] Golang microservice promQL client example or package?

On 07/08/2020 02:04, 'Luke Hamilton' via Prometheus Users wrote: I am wondering if there is a golang based promQL client package or exmaples anywhere on how I can call a Prometheus server we have collecting a bunch of data that we need to use for a billing service thats built in Go. When you

Re: [prometheus-users] Dynamically create recording rules

On 06/08/2020 20:36, we...@kubecost.com wrote: Hi all, We're looking to dynamically create/edit recording rules. Does anyone know a way to do this at run-time without using a sidecar or modifying the rule_files directly? For example, is there an API that would allow this and then we can pass

Re: [prometheus-users] Getting Security Policy : frame-ancestors error , please suggest

On 05/08/2020 17:54, sunils...@gmail.com wrote: Hi All, In our current setup Prometheus is non-ssl configured , which means I am accessing Prometheus as http://server-name:9090 During our recent Security scan below details were reported . Please advise , what step I can take for this .

Re: [prometheus-users] How to Optimize Prometheus High memory？

On 05/08/2020 09:37, Liu Chang wrote: [prometheus]# ./bin/prometheus --version prometheus, version 2.19.2 ./bin/prometheus --config.file=./conf/prometheus.yml --web.listen-address="0.0.0.0:8089" --storage.tsdb.retention.size=200GB *Killed process 203738 (prometheus) total-vm:241826816kB,

Re: [prometheus-users] Prometheus as TSDB on medical device

lisch-deutsch/scenario.html [3] https://groups.google.com/d/msgid/prometheus-users/34b64f38-183d-4112-94fd-8b22801375e7o%40googlegroups.com?utm_medium=email_source=footer -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

Re: [prometheus-users] Monitor multiple Swarm clusters in a single one using the new Prometheus:v2.20.0

.com. > > > > -- > Julien Pivotto > @roidelapluie > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubsc

Re: [prometheus-users] Re: Alertmanager sending duplicate alert to webhook receiever

is good. What is shown in the peers section under "Status" in the UI? -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prome

Re: [prometheus-users] Re: Alertmanager sending duplicate alert to webhook receiever

[2] https://groups.google.com/d/msgid/prometheus-users/5034fe12-8931-4659-b40d-0d697b644bd2o%40googlegroups.com?utm_medium=email_source=footer -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and s

Re: [prometheus-users] Alertmanager sending duplicate alert to webhook receiever

It sounds like your replicas aren't meshing with each other. Do the command lines for each one include the IP address or dns names of the other replicas? On 29 July 2020 08:49:06 BST, Nabarun Sen wrote: >Hi All, > >I need a help as my alertmanager sending duplicate alert( for 1 alert 3 >

Re: [prometheus-users] How to configure Prometheus to scrape application related metrics

re in Prometheus so >that >the metrics will get pumped in? > >Thanks >Vikram Y > >On Thursday, July 23, 2020 at 9:44:07 AM UTC-5, Stuart Clark wrote: >> >> On 23/07/2020 15:23, vikram yerneni wrote: >> > Fellas, >> > I am not a developer, just an

Re: [prometheus-users] How to configure Prometheus to scrape application related metrics

On 23/07/2020 15:23, vikram yerneni wrote: Fellas, I am not a developer, just an engineer. I setup our own Prometheus/Grafana Setups and started scraping all Node, pod & basic metrics. However the development teams started dumping their application level metrics and requesting the application

Re: [prometheus-users] Spring MVC client example

Do you see the expected data at /prometheus within your app? Prometheus is a pull based system, so you will need to update your scrape configuration to pull data from that endpoint periodically. On 20 July 2020 23:19:32 BST, Coder Noob wrote: >Hello, > >I am trying to integrate my Spring MVC

Re: [prometheus-users] Multiple exporters per machine

that don't have native metrics support. In addition the separation over multiple exporters ensures you don't have a single point of failure causing total metrics loss (at most you'd just lose the metrics that a specific exporter was handling). -- Stuart Clark -- You received this message

Re: [prometheus-users] hardware requirments to install prometheus

On 16/07/2020 14:17, diyawary wrote: On Thursday, 16 July 2020 13:26:14 UTC+5:30, Stuart Clark wrote: On 2020-07-16 08:52, diyawary wrote: > Hi Team, > > Please help to identify the hardware requirements for installation of > prometheus ,I am plannin

Re: [prometheus-users] Response String from Blackbox Exporter.

, July 16, 2020 at 12:27:34 PM UTC+5:30 Stuart Clark wrote: Prometheus only supports using numbers as the values for time series. However it is possible to use modules in the blackbox exporter to check the response of a request. On 16 July 2020 07:44:46 BST, "yagyans...@gmai

Re: [prometheus-users] hardware requirments to install prometheus

to scrape, how often and how many metrics are returned. Additionally the amount of queries being performed and any additional tools on the same box (e.g. remove read/write tools, blackbox exporter, SNMP exporter, etc.) will affect requirements too. -- Stuart Clark -- You received

Re: [prometheus-users] Response String from Blackbox Exporter.

Prometheus only supports using numbers as the values for time series. However it is possible to use modules in the blackbox exporter to check the response of a request. On 16 July 2020 07:44:46 BST, "yagyans...@gmail.com" wrote: > >Hi. Is it possible to get the response string given by the

Re: [prometheus-users] Is there any limits for prometheus monitoring?

On 15/07/2020 21:40, Adso Castro wrote: Seconded. Clark's right. My current scenario is kinda the same (pod memory keep floating between 12~16GB) and I'm currently working on identifying why do I have so much targets (17k at the moment) and doing all the records I can to relieve stress from

Re: [prometheus-users] Re: Max unspecified value for Promtool unit testing

%40googlegroups.com [1]. Links: -- [1] https://groups.google.com/d/msgid/prometheus-users/9a4e4b21-730b-4f10-ab83-2f856649218fo%40googlegroups.com?utm_medium=email_source=footer -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users&qu

Re: [prometheus-users] Best way to scrape metrics from a JSON log files

On 12/07/2020 15:00, Yashar Nesabian wrote: Hi, some of our applications are generating JSON style logs, for now, we are using elastic search to store the logs and show them in the Grafana but this is not a good choice to use elastic search. I tried to use mtail but as their developers

Re: [prometheus-users] Secure /federate endpoint

On 09/07/2020 15:33, Andrei Zegheru wrote: Hi, Is there a way to secure */federate* endpoint for a Prometheus instance so that it can be accessed only by the main Prometheus server? Yes. Run a reverse proxy in front of Prometheus and then you can add whatever authentication or restrictions

Re: [prometheus-users] What is the Prometheus's memory elimination strategy?

ffected at some point - disk access (even SSD) is generally significantly slower than memory access. Disk IO usage would increase as well as CPU IO time. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscr

Re: [prometheus-users] What to do for metrics that are not updated as often as the node_exporter is called?

On 07/07/2020 20:20, copocaneta wrote: This user at github asked this question that was not answered: judos commented on Mar 29 Can anyone explain why the node exporter does not support timestamps for

Re: [prometheus-users] Recording rules at the end of hour

of 2 minutes ensures there is at least once update every 5 minutes even if one scrape fails. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, sen

Re: [prometheus-users] How Protected Prometheus (OpenID Auth enaled) can be use as target in federation Prometheus scrape config

best suited for people, with other forms better for machines. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus

Re: [prometheus-users] Prometheus compaction failed and no space left

. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web vi

Re: [prometheus-users] Prometheus compaction failed and no space left

ad block: write compaction: write chunks: no space left on device" How can i solve that please ? That is saying you have run out of disk space wherever Prometheus is configured to store the database. -- Stuart Clark -- You received this message because you are subscribed to the Google

Re: [prometheus-users] Re: Prometheus Scrapping Issue for query-exporter

On 26/06/2020 07:27, Pravin Patil wrote: if I scrap it manually, it will show me the expected results If that database change causes it to not output a particular metric at all it will disappear from Prometheus after about 5 minutes. Generally counters shouldn't just disappear, instead

Re: [prometheus-users] Automatic update in service discovery for prometheus

on machine startup, so if a server is stopped or restarted the Consul registration will be updated each time the server boots. -- Stuart Clark -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop

<    1   2   3   4   5   6   >