Re: Watermark in broadcast

2017-12-14 Thread Tzu-Li (Gordon) Tai
gineer, Data
 4 World Trade Center, 46th Floor, New York, NY 10007
     From: Seth Wiesman <swies...@mediamath.com> Date: Wednesday, December 13, 2017 at 12:04 PM To: Timo Walther <twal...@apache.org>, "user@flink.apache.org" <user@flink.apache.org> Subject: Re: Waterma

Re: Watermark in broadcast

2017-12-14 Thread Fabian Hueske
> > > *From: *Seth Wiesman <swies...@mediamath.com> > *Date: *Wednesday, December 13, 2017 at 12:04 PM > *To: *Timo Walther <twal...@apache.org>, "user@flink.apache.org" < > user@flink.apache.org> > *Subject: *Re: Watermark in broadcast > > >

Re: Watermark in broadcast

2017-12-13 Thread Seth Wiesman
iesman <swies...@mediamath.com> Date: Wednesday, December 13, 2017 at 12:04 PM To: Timo Walther <twal...@apache.org>, "user@flink.apache.org" <user@flink.apache.org> Subject: Re: Watermark in broadcast Hi Timo, I think you are correct. This stream is consumed from K

Re: Watermark in broadcast

2017-12-13 Thread Seth Wiesman
k.apache.org> Subject: Re: Watermark in broadcast Hi Seth, are you sure that all partitions of the broadcasted stream send a watermark? processWatermark is only called if a minimum watermark arrived from all partitions. Regards, Timo Am 12/13/17 um 5:10 PM schrieb Seth Wiesman: Hi, How are

Re: Watermark in broadcast

2017-12-13 Thread Timo Walther
Hi Seth, are you sure that all partitions of the broadcasted stream send a watermark? processWatermark is only called if a minimum watermark arrived from all partitions. Regards, Timo Am 12/13/17 um 5:10 PM schrieb Seth Wiesman: Hi, How are watermarks propagated during a broadcast

Watermark in broadcast

2017-12-13 Thread Seth Wiesman
Hi, How are watermarks propagated during a broadcast partition? I have a TwoInputStreamTransformation that takes a broadcast stream as one of its inputs. Both streams are assigned timestamps and watermarks before being connected however I only ever see watermarks from my non-broadcast stream.