: Will broadcast stream affect performance because of the absence of
operator chaining?
Hi,
No, I think you are right, I forgot about the broadcasting requirement.
Piotrek
On 6 Aug 2019, at 13:11, 黄兆鹏 wrote:
Hi, Piotrek,
I previously considered your first advice(use union record type), but I found
), and handle new
messages coming in.
The good news
From: Piotr Nowojski
Date: Tuesday, August 6, 2019 at 8:55 PM
To: 黄兆鹏
Cc: user
Subject: Re: Will broadcast stream affect performance because of the absence of
operator chaining?
Hi,
No, I think you are right, I forgot about the broadcasting
messages coming in.
The good news
From: Piotr Nowojski
Date: Tuesday, August 6, 2019 at 8:55 PM
To: 黄兆鹏
Cc: user
Subject: Re: Will broadcast stream affect performance because of the absence of
operator chaining?
Hi,
No, I think you are right, I forgot about the broadcasting requirement.
Piotrek
";
> Date: Tue, Aug 6, 2019 06:57 PM
> To: "黄兆鹏";
> Cc: "user";
> Subject: Re: Will broadcast stream affect performance because of the absence
> of operator chaining?
>
> Hi,
>
> Have you measured the performance impact of braking the operat
you!
-- Original --
From: "Piotr Nowojski";
Date: Tue, Aug 6, 2019 06:57 PM
To: "黄兆鹏";
Cc: "user";
Subject: Re: Will broadcast stream affect performance because of the absence
of operator chaining?
Hi,
Have you m
gt;
>
>
> ------ Original ----------
> From: "Piotr Nowojski";
> Date: Tue, Aug 6, 2019 04:23 PM
> To: "黄兆鹏";
> Cc: "user";
> Subject: Re: Will broadcast stream affect performance because of the absence
>
6, 2019 04:23 PM
To: "黄兆鹏";
Cc: "user";
Subject: Re: Will broadcast stream affect performance because of the absence
of operator chaining?
Hi,
Broadcasting will brake an operator chain. However my best guess is that Kafka
source will be still a performance bottleneck
Hi,
Broadcasting will brake an operator chain. However my best guess is that Kafka
source will be still a performance bottleneck in your job. Also Network
exchanges add some measurable overhead only if your records are very
lightweight and easy to process (for example if you are using RocksDB
Hi all,
My flink job has dynamic schema of data, so I want to consume a schema kafka
topic and try to broadcast to every operator so that each operator could know
what kind of data it is handling.
For example, the two streams just like this:
OperatorA -> OperatorB -> OperatorC
^
