*How often are you scraping this metric?* Every 30 seconds. Nowhere near enough to account for the difference.
*Do these counters reset often?* Nope. I'm using a custom exporter where I don't reset the counters. That said, if I restart the exporter, the counters will obviously reset. *What do you mean by "do a count against the real values" - what values are you looking at?* A little backstory. This is tracking API Calls to an API Gateway. We put a summary line of this information into our logs which is forwarded to Splunk. So Splunk captures the raw data. The API Gateway also forwards the API call data to the custom exporter. It's the exact same data. So when I say "Real values" I'm looking at the count of the summary line in Splunk filtering using the same parameters as my Prometheus Query. *Assuming the counters don't reset often, you may find it useful to compare the output of* *apigateway_apicount_counter* *apigateway_apicount_counter offset 15m* *and also the differences:* *apigateway_apicount_counter - apigateway_apicount_counter offset 15m* With all the labels involved, I'm dealing with a couple thousand rows in these queries. The last one (counter - offset) does have a difference in the numbers which is a value roughly equal to all the nodes combined in my original query. *You may also find sum by (node) (....) simpler than the long list of "without" fields.* Good call. Can you tell I'm new? ;-) On Friday, October 16, 2020 at 11:28:03 AM UTC-5 [email protected] wrote: > How often are you scraping this metric? > > Do these counters reset often? > > What do you mean by "do a count against the real values" - what values are > you looking at? > > Assuming the counters don't reset often, you may find it useful to compare > the output of > apigateway_apicount_counter > apigateway_apicount_counter offset 15m > > and also the differences: > apigateway_apicount_counter - apigateway_apicount_counter offset 15m > > You may also find sum by (node) (....) simpler than the long list of > "without" fields. > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/76994383-03aa-4c1f-b3ab-64ec68d03eb7n%40googlegroups.com.
