Re: Question about DataStream serialization

Right now, it is exactly "Object.hash % getNumberOfParallelSubtasks()”... > On 09 Dec 2015, at 02:37, Radu Tudoran wrote: > > Object.hash % getNumberOfParallelSubtasks()

Re: Question about DataStream serialization

e notify the sender > by phone or email immediately and delete it! > > > -Original Message- > From: Aljoscha Krettek [mailto:aljos...@apache.org] > Sent: Tuesday, December 08, 2015 5:00 PM > To: user@flink.apache.org > Subject: Re: Question about DataStream serialization >

RE: Question about DataStream serialization

and delete it! -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: Tuesday, December 08, 2015 5:00 PM To: user@flink.apache.org Subject: Re: Question about DataStream serialization Hi, it is not possible in an officially supported way. There is however a trick that you

Re: Question about DataStream serialization

ssemination) > by persons other than the intended recipient(s) is prohibited. If you receive > this e-mail in error, please notify the sender by phone or email immediately > and delete it! > > > -Original Message- > From: Aljoscha Krettek [mailto:aljos...@

RE: Question about DataStream serialization

. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: Tuesday, December 08, 2015 4:20 PM To: user@flink.apache.org Subject: Re: Question about DataSt

Re: Question about DataStream serialization

Ah, I see what’s the problem. Operator state is scoped to the key of the incoming element. In the open() method, no element has been received yet, so the key of the incoming element is basically NULL. So the open() method initializes state for key NULL. In flatMap() we actually have a key of inc

RE: Question about DataStream serialization

uding, but not >> limited to, total or partial disclosure, reproduction, or dissemination) by >> persons other than the intended recipient(s) is prohibited. If you receive >> this e-mail in error, please notify the sender by phone or email immediately >> and delete it! &g

Re: Question about DataStream serialization

ted to, total or partial disclosure, reproduction, >> or dissemination) by persons other than the intended recipient(s) is >> prohibited. If you receive this e-mail in error, please notify the sender by >> phone or email immediately and delete it! >> >> -Origina

Re: Question about DataStream serialization

gwen TAO, Wanzhou MENG, >> Lifang CHEN Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, >> HRB 56063, >> Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN >> >> This e-mail and its attachments contain confidential information from >> HUAWEI, wh

RE: Question about DataStream serialization

j...@apache.org] Sent: Tuesday, December 08, 2015 8:42 AM To: user@flink.apache.org Subject: Re: Question about DataStream serialization Hi Radu, you are right. The open() method is called for each parallel instance of a rich function. Thus, if all instanced use the same code, you might read the sam

Re: Question about DataStream serialization

d herein in any way > (including, but not limited to, total or partial disclosure, > reproduction, or dissemination) by persons other than the intended > recipient(s) is prohibited. If you receive this e-mail in error, please > notify the sender by phone or email immediately and delete it! > &g

RE: Question about DataStream serialization

mail in error, please notify the sender by phone or email immediately and delete it! From: Robert Metzger [mailto:rmetz...@apache.org] Sent: Tuesday, December 01, 2015 6:21 PM To: user@flink.apache.org Cc: Goetz Brasche Subject: Re: Question about DataStream serialization Hi Radu, both emails reache

Re: Question about DataStream serialization

Hi Radu, both emails reached the mailing list :) You can not reference to DataSets or DataStreams from inside user defined functions. Both are just abstractions for a data set or stream, so the elements are not really inside the set. We don't have any support for mixing the DataSet and DataStrea