Hi,
Yes Dawid is correct. Communications between two tasks on the same
TaskManager are not going through the network, but via "local" channel
(`LocalInputChannel`). It's still serialising and deserializing the data,
but there are no network overheads, and local channels have only half of
the
Hi,
If tasks end up in the same TaskManager, they us LocalInputChannel(s),
which does not go through network, but reads directly from local partitions.
I am also pulling in @Piotr who might give you some more insights, or
correct me if I am wrong.
[1]
Hi,
I'm confused about slots communication in same taskmanager.
Assume only one job which running on per-job cluster with parallalism= 6.
Each taskmanager with 3 slot.
There are 6 slot:
slot 1-1, slot 1-2, slot 1-3,
slot 2-1, slot 2-2 , slot 2-3
Assume the job has 'KeyBy' operator, thus,
