If you want to filter out some metrics, and you can't control this on the 
exporter, then you can use metric relabelling 
<https://prometheus.io/docs/prometheus/latest/configuration/configuration/#metric_relabel_configs>
 
to drop any that you don't want to ingest into the database.

On Friday, 7 October 2022 at 08:55:27 UTC+1 Stuart Clark wrote:

> On 07/10/2022 04:09, Muthuveerappan Periyakaruppan wrote:
> > we have a situation , where we have 8 to 15 million head series in 
> > each Prometheus and we have 7 instance of them (federated). Our 
> > prometheus are in a constant flooded situation handling the incoming 
> > metrics and back end recording rules. 
>
> 8-15 million time series on a single Prometheus instance is pretty high. 
> What spec machine/pod are these?
>
> When you say "flooded" what are you meaning?
>
> > One thought which came to was - do we have something similar to log 
> > level for prometheus metrics ? If its there then... we can benefit 
> > from it .... by configuring to run all targets in error level in 
> > production and in debug/info level in development... This will help 
> > control flooding of metrics.
> >
> I'm not sure what I understand what you are suggesting. What would be 
> the difference between setting this hypothetical "error" and "debug" 
> levels? Are you meaning some metrics would only be exposed on some 
> environments?
>
> -- 
> Stuart Clark
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/61e858bd-0701-4263-ac39-ed6942938c9bn%40googlegroups.com.

Reply via email to