It appears the issue is tied to the use of regex wild card filter in
experession
expr: my_sample_label{label1="..",label4=~".+"}
When I remove the 2nd label, issue goes away.
expr: my_sample_label{label1=".."}
THis is strange as all underlying series clearly have label4 values. Why is
this failing then?
On Friday, January 29, 2021 at 3:17:29 PM UTC-5 Johny wrote:
> I'm having a consistent problem wherein some recorded metrics are missing
> randomly.
>
> The underlying expression evaluates to around 50-100 time series. When I
> filter the expression to produce fewer number of time series (5-10), then
> the recorded metrics are available and I don't see the issue. Is there some
> sort of limit on time series in Prometheus per rule expression?
>
> 5 labels in time series.
> e.g.
>
> my_sample_label{label1="test1_test1.test1",label2="32323",label3="abc",label4="d32938-3230-dd.dd.ss",label5="ksldkdls"}
>
> I even tried on a prometheus node with a single rule and I see the same
> pattern.
>
> any help appreciated.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/7fc899f7-c0d4-4e17-8d65-d9a56ebc074fn%40googlegroups.com.
