Hi All,

I have a question for a use case. If we are pushing batch jobs metrics to 
Pushgateway.

Some of the job groups of those metrics are getting pushed to pushgateway 
every 24 hrs. So, metric values are updating once in a day. 

There are other job groups pushing to pushgateway every 15 seconds, and 
updating metrics values every 15 seconds in Pushgateway. 

Eg.
Backup_timestamp: xxxxx
Backup_files_count: xxxx
so values are getting updated for same metrics. So, All these requests are 
overwriting the metrics value so not much increase in storage with time. 


Now, Prometheus is scraping all the jobs every 30 seconds. Even job groups 
with metrics getting pushed every 24 hrs at a time in Pushgateway, 
prometheus is scraping every 30 seconds. 

Do you think Pushgateway scraping with such short time interval adding 
storage even though metric value stay same for 24 hrs. 

For this reason, one way is to clean Pushgateway job which are older than 
maybe few seconds like 50 seconds. So, Prometheus will not scrape job at 
all. This way I can save Prometheus storage and scraping effort? 

Consider I'm pushing 10k metrics in total part of different job groups. 
Half of those are getting pushed/updated to Pushgateway only once in a day? 

So, the question is how much it impact on storage of Prometheus if 
Prometheus scraping metrics from Pushgateway every 30 seconds with no 
change in value for 1 day.

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/9b0e6fd4-0df5-40dd-bf3e-c632677c972fn%40googlegroups.com.

Reply via email to