[prometheus-users] wal compression

2020-03-30 Thread veena thimmegowda
Hi, I'm new to prometheus. I want to know how "storage.tsdb.wal-compression" argument works on 1. installation 2. In prometheus already installed without wal compression flag and after few days prometheus upgraded with wal compression flag enabled. -- You received this message because you are

[prometheus-users] IOT architecture with prometheus; mqtt, aws, pushgateway

2020-03-30 Thread A R
Hello, I have a Prometheus instance up and am trying to figure out the best route to get my IOT sensor data into it. My devices publish a JSON to a MQTT topic every minute and I'm uncertain about the best practices on how to ingest or scrape these metrics. After reading the documentation, using

Re: [prometheus-users] PROMETHUS FAILURE

2020-03-30 Thread João Paulo de Melo Cavalcante
I cannot find the directories you have indicated, I cannot in any way adjust this error. would it be the case to put another version of prometheus? segunda-feira, 30 de Março de 2020 às 18:29:52 UTC-3, Christian Hoffmann escreveu: > > Hi, > > first, your mail does not seem to be readable in m

Re: [prometheus-users] PROMETHUS FAILURE

2020-03-30 Thread Christian Hoffmann
Hi, first, your mail does not seem to be readable in my mail client (Thunderbird) -- it's black text on black background. You may want to adjust this to reach a larger audience. :) I don't see any obvious errors in your screenshot. I suggest looking at the full log output (journalctl -u prometheu

[prometheus-users] PROMETHUS FAILURE

2020-03-30 Thread João Paulo de Melo Cavalcante
Guys, I'm with error in prometheus, when executing the command systemclt remains prometheus, he presents this error that is attached. Can anyone help? prometheus, version 2.17.0-rc.0 -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsu

[prometheus-users] Re: How to solve "Two hour in-memory prometheus data during upgrade/failover"

2020-03-30 Thread Brian Candler
It Works For Me™, but I don't use Thanos. Maybe you should try to make a standalone test case that reproduces the problem. My suspicion is you're not letting prometheus shutdown cleanly. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To

[prometheus-users] Re: Finding metrics using description

2020-03-30 Thread Weston Greene
What do you mean "description"? Is "description" a label you have on the metric? If so: `{the_metrics_description=~".*search term.*"}` On Monday, March 30, 2020 at 12:33:49 PM UTC-4, Filip Grządkowski wrote: > > Hey, > > We're using a standard Prometheus + Alertmanager setup. We have a number

[prometheus-users] Re: How to solve "Two hour in-memory prometheus data during upgrade/failover"

2020-03-30 Thread Shaam Dinesh
Hi Brain Thanks for the response, yes I am still leveraging persistent disk to mitigate the restarts but it was not helping to save 2 hours data as configured I there any better way to address it On Tuesday, March 31, 2020 at 12:35:40 AM UTC+5:30, Brian Candler wrote: > > When you stop prometh

[prometheus-users] Re: How to solve "Two hour in-memory prometheus data during upgrade/failover"

2020-03-30 Thread Brian Candler
When you stop prometheus it writes out its WAL to disk, and when you start it it reads in WAL back from disk. This is why a prometheus restart can take several minutes (and you should ensure that your supervisor process isn't configured to do a hard kill after a short timeout). Of course it wo

[prometheus-users] Finding metrics using description

2020-03-30 Thread Filip Grządkowski
Hey, We're using a standard Prometheus + Alertmanager setup. We have a number of metrics across multiple processes, containers and instances. I'd like to be able to search all exported metrics not only by name (which is possible in prometheus graph UI), but also show their description for users to

[prometheus-users] How to solve "Two hour in-memory prometheus data during upgrade/failover"

2020-03-30 Thread Shaam Dinesh
Hi Team, *Current setup:* I am using using prometheus setup running along with thanos for extended storage to accomodate 2 months of data for longer persistence 1. 2 Instances of prometheus (0 replica/1 replica) and both this instances enabled with thanos-sidecar 2. thanos-sidecar su

[prometheus-users] Re: Basic webhook for alertmanager/prometheus

2020-03-30 Thread Brian Candler
Therefore you need to include your webhook receiver in some routes too. Here's one option: routes: # Send everything to webhook - receiver: 'webhook' continue: true - match: severity: warning receiver: 'mail' - match: severity: critical receive

Re: [prometheus-users] Re: Data retention policy

2020-03-30 Thread Brian Candler
On Monday, 30 March 2020 09:34:01 UTC+1, REMI DRUILHE wrote: > > In our context, Prometheus is storing system metrics and business metrics, > especially the number of accesses to the methods of our API. > >> >>> That presumably is an aggegate of all calls to a particular method. If you recorded c

[prometheus-users] Re: Monitor number of seconds since metric change as prometheus time series

2020-03-30 Thread Weston Greene
This was already partially answered in https://stackoverflow.com/questions/54148451 But not sufficiently, so I'm asking here and in the Stack Overflow: https://stackoverflow.com/questions/60928468 Here is the image of the graph: [image: Screen Shot 2020-03-30 at 06.18.07.png] On Monday, Ma

[prometheus-users] Re: Monitor number of seconds since metric change as prometheus time series

2020-03-30 Thread Weston Greene
This was already partially answered in https://stackoverflow.com/questions/54148451 But not sufficiently, so I'm asking here and in the Prometheus Google Group: https://groups.google.com/d/topic/prometheus-users/JxepDL9eosQ/discussion Here is the image of the graph: [image: Screen Shot 2020-0

[prometheus-users] Monitor number of seconds since metric change as prometheus time series

2020-03-30 Thread Weston Greene
I have the Recording rule pattern: ```yaml - record: last-update expr: | timestamp(changes(metric-name[450s]) > 0) or last-update ``` However, that doesn't work. The `or last-update` part doesn't return a value. I have tried using an offset, ` or (last-update offset 45

[prometheus-users] pod restart count and alert

2020-03-30 Thread Veeresh Reddy
Recently, one of pods is in CrashLoopBackOff due to a configuration problem. The state persisted for 33 days and we didn't know about it. There is a pod restarts metric available in Thanos, so we can use that to set up an alert for some number of pod restarts per minute. would anyone suggest me

[prometheus-users] pod restart count and alert

2020-03-30 Thread Veeresh Reddy
Recently, one of pods is in CrashLoopBackOff due to a configuration problem. The state persisted for 33 days and we didn't know about it. There is a pod restarts metric available in Thanos, so we can use that to set up an alert for some number of pod restarts per minute. would anyone suggest me

[prometheus-users] How to get accurate CPU Utilization by Process on Windows?

2020-03-30 Thread Chandan Kumar
Hello, I've configured Grafana to get CPU utilization using wmi_process_cpu_time_total.However, it doesn't give accurate results. I tried the below query as suggested here

Re: [prometheus-users] Re: Documentation missing: Howto set exporters port?

2020-03-30 Thread Christian Hoffmann
Hi, the command line help contains the hint for the relevant flag: $ blackbox_exporter --help |& grep listen --web.listen-address=":9115" The address to listen on for HTTP requests. Kind regards, Christian On 3/30/20 1:31 PM, Boris Kairat wrote: > Sorry for that - I did not remem

[prometheus-users] Re: Documentation missing: Howto set exporters port?

2020-03-30 Thread Boris Kairat
Sorry for that - I did not remember that this mailing list is not specific for the "blackbox_exporter" so my question is about the "blackbox_exporter"!!! Am Montag, 30. März 2020 13:30:30 UTC+2 schrieb Boris Kairat: > > Hi everybody! > > Brian sent me here to ask questions so I do: > > The docu

[prometheus-users] Documentation missing: Howto set exporters port?

2020-03-30 Thread Boris Kairat
Hi everybody! Brian sent me here to ask questions so I do: The documentation says "Blackbox exporter is configured [...] and command-line flags (such as [...] what port to listen on [...]". I really tried hard but could not find information about howto set a different port the exporter is liste

[prometheus-users] Re: Basic webhook for alertmanager/prometheus

2020-03-30 Thread Danny de Waard
route: # A default reciever receiver: 'default' # The child route trees. routes: # This routes performs a regular expression match on alert labels to # catch alerts that are related to a list of services. - match: severity: warning receiver: 'mail' - ma

Re: [prometheus-users] Re: Data retention policy

2020-03-30 Thread REMI DRUILHE
In our context, Prometheus is storing system metrics and business metrics, especially the number of accesses to the methods of our API. We do not have any direct user data stored in Prometheus. But I think that someone could cross-reference the data to find something more specific about someone