Ordering expectations of data

2016-08-12 Thread Bart Wyatt
​Hello all, We have a kafka topic with lots of partitions where data is partitioned by an upstream publisher on "session". In flink we read this topic and another single partition topic which contains configuration definitions for a little flatMap based operation. We also do a little bit

Re: Ordering expectations of data

2016-08-16 Thread Ufuk Celebi
Your approach of using a CoFlatMap with a slowly changing second input (the config source) is a common pattern and a good choice for this. The ordering of events between the sources and the CoFlatMap should be maintained if the parallelism matches. There is no repartitioning going on (the CoFlatMa