Re: [prometheus-users] Metric Relabeling

Hi All, Any help on this plz. Thank You Regards Sakthi On Fri, 7 May 2021 at 9:44 PM, Sakthi Raam wrote: > Hi Ben, Thanks for the information. This requires configuration change > which application teams are reluctant to do so hence looking to drop them > on Prometheus end before storing it. >

Re: [prometheus-users] What is the best alternative of Deadmanssnitch to monitor Prometheus itself

https://healthchecks.io/ https://github.com/healthchecks/healthchecks On Mon, May 17, 2021 at 10:26 PM sai kiran wrote: > Hello, > > I am trying to monitor Prometheus to keep a tab if it is running and not > broke when new deployments or changes. I found Deadmansnitch is popular.. > But, I am l

Re: [prometheus-users] Difference between 2 metrics

Just write metric_a - metric_b . See https://prometheus.io/docs/prometheus/latest/querying/operators/#arithmetic-binary-operators On Mon, May 17, 2021 at 8:07 PM Sachin Patil wrote: > Hi Team, > > is there any Prometheus alert rule function to get the difference between > 2 metrics > > > Thank

[prometheus-users] What is the best alternative of Deadmanssnitch to monitor Prometheus itself

Hello, I am trying to monitor Prometheus to keep a tab if it is running and not broke when new deployments or changes. I found Deadmansnitch is popular.. But, I am looking for opensource and self hosted service. Thanks, Sai -- You received this message because you are subscribed to the Google

[prometheus-users] Difference between 2 metrics

Hi Team, is there any Prometheus alert rule function to get the difference between 2 metrics Thanks and regards, Sachin P. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from

[prometheus-users] karma pod CrashLoopBackOff

> > Hi, > > I have installed karma as a deployment in minikube using this command (helm install --generate-name -f values.yaml stable/karma), with following values.yaml. i have prometheus operator running in localhost:9090 portforward.. still i get this error. do i need to create ingress or a

[prometheus-users] Prometheus disk full scenario

Hi, I'm running a Prometheus with a PVC on K8S. What can we do when Prometheus consumes the entire disk space (8Gi)? Assume, I have already configured it at installation both time (15d) and size based retention (8Gi). I want to restore my Prometheus Service and free up some space. Any ideas?

[prometheus-users] Shifting time that Prometheus writes blocks/chunks to disk

I run a large internal datacenter that hosts thousands of instances of OpenShift, each of which has two instances of Prometheus running. Looking into a performance issue that we have been experiencing, we noticed the Prometheus always writes new blocks/chunks exactly on the hour. When this is

Re: [prometheus-users] Re: Fire a specific alert once a day

Hi i got similar issue i would like to get alert only once a day at specific time. Already added alertmanager routes as mentioned above. I tried with my rule but not query is wrong for scalar got instant vector. (max_over_time(probe_sucess[20h]) == 0 ) and on () vector(hour() == 10) Please su

[prometheus-users] Alert for Persistent volume

Do we have alerts for low disk space in Persistent volume? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To

Re: [prometheus-users] Monitoring NFS service

Also this option is set: *--path.procfs=/host/proc* On Monday, May 17, 2021 at 2:06:47 PM UTC+3:30 Seyed Mustafa Afzouni wrote: > > I have an issue with monitoring NFS (running at Host) on node-exporter > which is docker, Node-Exporter using */proc *directory > that bidden to docker: > > */proc

Re: [prometheus-users] Monitoring NFS service

I have an issue with monitoring NFS (running at Host) on node-exporter which is docker, Node-Exporter using */proc *directory that bidden to docker: */proc:/host/proc [Read-Only]* Other metrics are good but the NFS not working, because '*nfsd*' and '*nfs*' file is not showing in these path: *

[prometheus-users] Is there a way to limit the cardinality of a counterVec in golang sdk?

as we all know, vector metrics should not many different label values (https://prometheus.io/docs/practices/naming/#labels). but some user abuse label, target will expose large body in /metric endpoint. then it will cause prometheus server OOM (event if set `sample_limit` at config file).

[prometheus-users] Re: kubernetes sevice discovery

Prometheus pods and Avalanche pods are reside in a same k8s cluster. On Monday, May 17, 2021 at 4:17:41 PM UTC+8 nina guo wrote: > I'm going to use a tool Avalanche to generate metrics automatically. > > GitHub - open-fresh/avalanche: Prometheus/OpenMetrics endpoint series > generator for load t

[prometheus-users] kubernetes sevice discovery

I'm going to use a tool Avalanche to generate metrics automatically. GitHub - open-fresh/avalanche: Prometheus/OpenMetrics endpoint series generator for load testing. prometheus configmap updated as below, but the pods are unable to be discovered curren

[prometheus-users] Re: Pronetheus-Netbox integration

Hi We just recently integrated netbox and use it as service discovery for Prometheus (we use https://github.com/FlxPeters/netbox-prometheus-sd for this task). Are you trying to scrape netbox to get metrics (according to https://netbox.readthedocs.io/en/stable/additional-features/prometheus-me