Flink KafkaConsumer metrics in DataDog

Hello , We have enabled DataDogHTTPReporter to fetch metrics on flink v1.13.1 running on kubernetes. The metric flink.operator.KafkaConsumer.records_lag_max is not displaying accurate values. It also displays 0 most of the time and when it does fetch a value, it seems to be wrong when I compare th

Re: Flink KafkaConsumer metrics in DataDog

AFAIK this metric is directly forwarded from Kafka as-is; so Flink isn't calculating anything. I suggest to reach out to the Kafka folks. On 25/08/2021 17:23, Shilpa Shankar wrote: Hello , We have enabled DataDogHTTPReporter to fetch metrics on flink v1.13.1 running on kubernetes. The metric

Re: Flink KafkaConsumer metrics in DataDog

Yes we are also facing the same problem and not able to find any solution. On Thu, Aug 26, 2021 at 5:59 PM Chesnay Schepler wrote: > AFAIK this metric is directly forwarded from Kafka as-is; so Flink isn't > calculating anything. > > I suggest to reach out to the Kafka folks. > > On 25/08/2021 1

Re: Flink KafkaConsumer metrics in DataDog

We disabled kafka consumer metrics in flink via setting register.consumer.metrics to false in KafkaSource and enabled kafka consumer integration in datadog agent as explained here . On Fri, Aug 27, 2021 at 8:44 AM Deb