Have you checked config param cluster.evenly-spread-out-slots ?
On Mon, Aug 28, 2023 at 10:31 PM Lu Niu <qqib...@gmail.com> wrote: > Hi, Flink users > > We have recently observed that the allocation of Flink TaskManagers in our > YARN cluster is not evenly distributed. We would like to hear your thoughts > on this matter. > > 1. Our setup includes Flink version 1.15.1 and Hadoop 2.10.0. > 2. The uneven distribution is that out of a 370-node YARN cluster, there > are 16 nodes with either 0 or 1 vCore available, while 110 nodes have more > than 10 vCores available. > > Is such behavior expected? If not, is there a fix provided in Flink? > Thanks! > > Best > Lu >
