Re: Has Flink a kafka processing location strategy?

2019-06-18 Thread Konstantin Knauf
Hi Theo, no, sorry, the Kafka partitions that each subtask is assigned to is only determined by the index of the subtask. Best, Konstantin On Mon, Jun 17, 2019 at 2:57 PM Theo Diefenthal < theo.diefent...@scoop-software.de> wrote: > Hi, > > > > We have a Hadoop/YARN Cluster with Kafka and

Has Flink a kafka processing location strategy?

2019-06-17 Thread Theo Diefenthal
Hi, We have a Hadoop/YARN Cluster with Kafka and Flink/YARN running on the same machines. In Spark (Streaming), there is a PreferBrokers location strategy, so that the executors consume those kafka partitions which are served from the same machines kafka broker. (