Re: Problem with KafkaSource and watermark idleness

2022-08-14 Thread Yan Shen
Thanks David, I am working on a flink datastream job that does a temporal join of two kafka topics based on watermarks. The problem was quite obvious when I enabled idleness and data flowed through much faster with different results even though the topics were not idle. Regards. On Mon, Aug 15,

Re: Problem with KafkaSource and watermark idleness

2022-08-14 Thread David Anderson
Although I'm not very familiar with the design of the code involved, I also looked at the code, and I'm inclined to agree with you that this is a bug. Please do raise an issue. I'm wondering how you noticed this. I was thinking about how to write a failing test, and I'm wondering if this has some

Re: Metrics OOM java heap space

2022-08-14 Thread yu'an huang
You can follow the ticked https://issues.apache.org/jira/browse/FLINK-10243 as mentioned in that stack overflow question to set this parameter: “metrics.latency.granularity": https://nightlies.apache.org/flink/flink-docs-master/docs/deploymen