Re: DataDog and Flink

2021-03-24 Thread Vishal Santoshi
://app.datadoghq.com/api/v1/series?api_key=0ffa36e48f5042465635b5843fa3f2a6%7D> >>>>> ) >>>>> >>>>> which implies that the Socket timeout was masking this issue. The 2000 >>>>> was just a huge payload that DD was unable to parse in

Re: DataDog and Flink

2021-03-24 Thread Vishal Santoshi
). Now we could go lower but that makes less sense. We could >>>> play with >>>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html#system-scope >>>> to reduce the size of the tags ( or keys ). >>>> >>>> >>>> >>>> >>>> >

Re: DataDog and Flink

2021-03-24 Thread Arvid Heise
;>> play with >>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html#system-scope >>> to reduce the size of the tags ( or keys ). >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> On

Re: DataDog and Flink

2021-03-24 Thread Matthias Pohl
keys ). >> >> >> >> >> >> >> >> >> >> On Tue, Mar 23, 2021 at 11:33 AM Vishal Santoshi < >> vishal.santo...@gmail.com> wrote: >> >>> If we look at this >>> <https://github.com/apache/flink/blob/97bf

Re: DataDog and Flink

2021-03-23 Thread Vishal Santoshi
t this >> <https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java#L159> >> code , the metrics are divided into chunks up-to a max size. and enqueued

Re: DataDog and Flink

2021-03-23 Thread Vishal Santoshi
e size of the tags ( or keys ). On Tue, Mar 23, 2021 at 11:33 AM Vishal Santoshi wrote: > If we look at this > <https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/

Re: DataDog and Flink

2021-03-23 Thread Vishal Santoshi
If we look at this <https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java#L159> code , the metrics are divided into chunks up-to a max size. and enqueued

Re: DataDog and Flink

2021-03-22 Thread Arvid Heise
Hi Vishal, I have no experience in the Flink+DataDog setup but worked a bit with DataDog before. I'd agree that the timeout does not seem like a rate limit. It would also be odd that the other TMs with a similar rate still pass. So I'd suspect n/w issues. Can you log into the TM's machine and try

DataDog and Flink

2021-03-20 Thread Vishal Santoshi
. That said the exception is still not helpful. Any ideas from folks who have used DataDog reporter with Flink. I guess even best practices may be a sufficient beginning. Regards.