Yes. So, Prometheus is scraping at every scrape interval. Is it adding to Prometheus storage at every scrape interval even if no change in value in Pushgateway metrics?
-- Regards, Anuj Tyagi On Friday, March 18, 2022 at 6:00:03 AM UTC-4 Stuart Clark wrote: > On 18/03/2022 03:38, anuj tyagi wrote: > > Hi All, > > > > I have a question for a use case. If we are pushing batch jobs metrics > > to Pushgateway. > > > > Some of the job groups of those metrics are getting pushed to > > pushgateway every 24 hrs. So, metric values are updating once in a day. > > > > There are other job groups pushing to pushgateway every 15 seconds, > > and updating metrics values every 15 seconds in Pushgateway. > > > > Eg. > > Backup_timestamp: xxxxx > > Backup_files_count: xxxx > > so values are getting updated for same metrics. So, All these requests > > are overwriting the metrics value so not much increase in storage with > > time. > > > > > > Now, Prometheus is scraping all the jobs every 30 seconds. Even job > > groups with metrics getting pushed every 24 hrs at a time in > > Pushgateway, prometheus is scraping every 30 seconds. > > > > Do you think Pushgateway scraping with such short time interval adding > > storage even though metric value stay same for 24 hrs. > > > > For this reason, one way is to clean Pushgateway job which are older > > than maybe few seconds like 50 seconds. So, Prometheus will not scrape > > job at all. This way I can save Prometheus storage and scraping effort? > > > > Consider I'm pushing 10k metrics in total part of different job > > groups. Half of those are getting pushed/updated to Pushgateway only > > once in a day? > > > > So, the question is how much it impact on storage of Prometheus if > > Prometheus scraping metrics from Pushgateway every 30 seconds with no > > change in value for 1 day. > > The storage usage for a metric that isn't changing is next to nothing, > so I wouldn't worry about it. What you describe would be exactly how I'd > expect Pushgateway to be behaving - some metrics are updated more > frequently and others less, but they are always there and being scraped > at the same frequency. > > -- > Stuart Clark > > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/a2e0d051-28d4-42f8-83ed-86e6d404e475n%40googlegroups.com.
