Re: Flink 1.5 job distribution over cluster nodes

2018-07-18 Thread Till Rohrmann
Hi Shachar, with Flink 1.5 we added resource elasticity. This means that Flink is now able to allocate new containers on a cluster management framework like Yarn or Mesos. Due to these changes (which also apply to the standalone mode), Flink no longer reasons about a fixed set of TaskManagers

Flink 1.5 job distribution over cluster nodes

2018-07-17 Thread Shachar Carmeli
Hi, We have 4 jobs with parallelism 3 that are running over 3 task manager with 4 slots per each , each task manager runs on a different VM , On Flink 1.3.2 the jobs were evenly distributed per node each job took one task slot of each task manager . After upgrading to flink 1.5 , each job is