Re: Streaming job gets slower and slower

2017-09-04 Thread Till Rohrmann
Hi Aparup, the slow-down can have multiple reasons. One reason could be that your computation in Timeseries-Analytics becomes more complex over time and therefore it slows down resulting in back pressure at the sources. This could be, for example, caused by accumulating a large state. Here the

Streaming job gets slower and slower

2017-08-27 Thread Aparup Banerjee (apbanerj)
We have a flink job with 7 subtasks. See graph below. This is on flink 1.2. [cid:image001.png@01D31EC7.FB4B5620] Here each source task consumes from a kafka topic. Data rate is low around 70-80 messages per sec. What we are noticing is after running for 2 hours or so the source tasks starts