The timeline of Flink support Reactive mode in Yarn

2021-05-20 Thread Bing Jiang
Hi, community. For streaming applications, auto scaling is critical to guarantee our resource provision, not big or small. i.e. it is cost efficiency requirements from public cloud (AWS) players. I read the document of FLIP-159

Re: The timeline of Flink support Reactive mode in Yarn

2021-05-20 Thread Robert Metzger
Hey Bing, The idea of reactive mode is that it reacts to changing resource availability, where an outside service is adding or removing machines to a Flink cluster. Reactive Mode doesn't work on an active resource manager such as YARN, because you can not tell YARN from the outside to remove resou