Hi Theo,
no, sorry, the Kafka partitions that each subtask is assigned to is only
determined by the index of the subtask.
Best,
Konstantin
On Mon, Jun 17, 2019 at 2:57 PM Theo Diefenthal <
theo.diefent...@scoop-software.de> wrote:
> Hi,
>
>
>
> We have a Hadoop/YARN Cluster with Kafka and
Hi,
We have a Hadoop/YARN Cluster with Kafka and Flink/YARN running on the
same machines.
In Spark (Streaming), there is a PreferBrokers location strategy, so that
the executors consume those kafka partitions which are served from the
same machines kafka broker. (