[prometheus-users] How to drop all the bucket metrics (which is prone to explode huge cardinality)with right regex pattern

Hi Team, we have tried with below regex pattern to drop all the metrics as below - http_request_duration_seconds_bucket we have tried below 2 regex patterns, but none of them helped metric_relabel_configs: - source_labels: [__name__] regex: (.+)_bucket and .*_bucket action: drop Can some

[prometheus-users] Prometheus Config Scrapping Multiple Kubernetes Cluster

Hi Guys, We wanted to have prometheus which would scrape metrics across more than 1 cluster different kubernetes cluster As far as I understand *using kubernetes_sd_configs we just happened to configure single master-api service till date *and* But with Multi cluster approach how do we devise

[prometheus-users] Prometheus metrics based autoscaling apart from default HPA scaling in kubernetes

Hi Team How do we achieve prometheus metrics based auto-scaling in kubernetes workloads and any best practices or pointers would be highly helpful Regards Dinesh -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this gro

[prometheus-users] Prometheus Latest Version Upgrade - Help/Guidance Needed

*Problem context:* we are currently running with year old version of prometheus version-2.13 which was less error prone with HTTP Superflous exception compare to the near latest version till 2.17 and due to the same reason we are still persisting with 2.13 version *Options:* Perhaps, we want

Re: [prometheus-users] Demerits of federated prometheus with multiple shards

, 2020 at 7:46:33 PM UTC+5:30 dineshnithy...@gmail.com wrote: > Can someone just share the knowledge about trades on sharding Prometheus > into multiple nodes > > Any hints/pointers would definitely be helpful > > On Fri, 28 Aug, 2020, 12:31 pm dineshnithy...@gmail.co

[prometheus-users] Demerits of federated prometheus with multiple shards

Hi Team, we have implemented huge number of shards in prometheus which scrapes 1000 target nodes across the enterprise we are currently in process of running some load test and ascertain the unknowns one below and need some guidance on the same - 1. On what cases sharding approach can fa

[prometheus-users] How to Debug - Error on ingesting out-of-order samples" num_dropped=xx

Hi Team, we are currently facing issues where metrics were getting dropped throwing exception as "Error on ingesting out-of-order samples" - And this happens only for specific job configs and need pointers on On what circumstances does it happens and any alternative solutions to it ?

[prometheus-users] Any Metric/Alert When Consul dns disconnects from prometheus

Hi Team, we predominantly use multiple consul_sd_configs and have a service regex to scrape metrics across 1000's of target nodes Issues: Sometimes we observe that consul dns malfunctions and due to which prometheus drops connectivity to consul server and while this happens all the metric ing