Does Flink automatically apply the rebalance operator ?

2020-07-30 Thread Suraj Puvvada
Hello We are testing a simple use case where we read from kafka -> process and write to kafka. I have set parallelism of the job to 3 and parallelism for the process function to 6. When I looked at the job graph in the Flink UI noticed that between the source and process function a rebalance step

Re: Does Flink automatically apply the rebalance operator ?

2020-08-11 Thread Robert Metzger
Hi Suraj, yes, this is the expected and desired behavior: a rebalance is introduced so that all 6 process functions are performing work. On Thu, Jul 30, 2020 at 8:53 PM Suraj Puvvada wrote: > Hello > > We are testing a simple use case where we read from kafka -> process and > write to kafka. >