Re: sorting data into sink

2018-03-14 Thread Fabian Hueske
Hi, To be honest, I did not understand your requirements and what you are looking for. stream.keyBy("partition").addSink(...) will partition the output on the "partition" attribute before handing it to the sink. Hence, all records with the same "partition" value will be handled by the same parall

sorting data into sink

2018-03-13 Thread Telco Phone
Does any know if this is a correct assumption DataStream sorted = stream.keyBy("partition"); Will automattically put same record to the same sink thread ? The behavior I am seeing is that a Sink setup with multiple threads is see data from the same hour. Any good examples of how to sort data so