://app.datadoghq.com/api/v1/series?api_key=0ffa36e48f5042465635b5843fa3f2a6%7D>
>>>>> )
>>>>>
>>>>> which implies that the Socket timeout was masking this issue. The 2000
>>>>> was just a huge payload that DD was unable to parse in
). Now we could go lower but that makes less sense. We could
>>>> play with
>>>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html#system-scope
>>>> to reduce the size of the tags ( or keys ).
>>>>
>>>>
>>>>
>>>>
>>>>
>
;>> play with
>>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html#system-scope
>>> to reduce the size of the tags ( or keys ).
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On
keys ).
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Tue, Mar 23, 2021 at 11:33 AM Vishal Santoshi <
>> vishal.santo...@gmail.com> wrote:
>>
>>> If we look at this
>>> <https://github.com/apache/flink/blob/97bf
t this
>> <https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java#L159>
>> code , the metrics are divided into chunks up-to a max size. and enqueued
e size of the tags ( or keys ).
On Tue, Mar 23, 2021 at 11:33 AM Vishal Santoshi
wrote:
> If we look at this
> <https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/
If we look at this
<https://github.com/apache/flink/blob/97bfd049951f8d52a2e0aed14265074c4255ead0/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java#L159>
code , the metrics are divided into chunks up-to a max size. and enqueued
Hi Vishal,
I have no experience in the Flink+DataDog setup but worked a bit with
DataDog before.
I'd agree that the timeout does not seem like a rate limit. It would also
be odd that the other TMs with a similar rate still pass. So I'd suspect
n/w issues.
Can you log into the TM's machine and try
. That said the exception is still
not helpful.
Any ideas from folks who have used DataDog reporter with Flink. I guess
even best practices may be a sufficient beginning.
Regards.