Re: Deterministic rescale for test

2021-01-15 Thread Arvid Heise
stom` and provide a partitioner if you want to >> control explicitly how elements are distributed to downstream tasks. >> >> >> >> *From: *Martin Frank Hansen >> *Reply-To: *"m...@berlingskemedia.dk" >> *Date: *Thursday, January 14, 2021 at 1:48 AM

Re: Deterministic rescale for test

2021-01-14 Thread Martin Frank Hansen
elements are distributed to downstream tasks. > > > > *From: *Martin Frank Hansen > *Reply-To: *"m...@berlingskemedia.dk" > *Date: *Thursday, January 14, 2021 at 1:48 AM > *To: *user > *Subject: *Deterministic rescale for test > > > > Hi, > > I

Re: Deterministic rescale for test

2021-01-14 Thread Jaffe, Julian
erministic rescale for test Hi, I am trying to make a test-suite for our Flink jobs, and are having problems making the input-data deterministic. We are reading a file-input with parallelism 1 and want to rescale to a higher parallelism, such that the ordering of the data is the same every time. I

Deterministic rescale for test

2021-01-14 Thread Martin Frank Hansen
Hi, I am trying to make a test-suite for our Flink jobs, and are having problems making the input-data deterministic. We are reading a file-input with parallelism 1 and want to rescale to a higher parallelism, such that the ordering of the data is the same every time. I have tried using