Hi Ruibin, Are you finding how to generate watermark pre Kafka partition? Flink provides Kafka-partition-aware watermark generation. [1]
Best, Vino [1]: https://ci.apache.org/projects/flink/flink-docs-stable/dev/event_timestamps_watermarks.html#timestamps-per-kafka-partition 邢瑞斌 <xingro...@gmail.com> 于2019年12月25日周三 下午8:27写道： > Hi, > > I'm trying to use Kafka as an event store and I want to create several > partitions to improve read/write throughput. Occasionally I need to rewind > offset to a previous position for recomputing. Since order isn't guaranteed > among partitions in Kafka, does this mean that Flink won't produce the same > results as before when rewind even if it uses event time? For example, > consumer for a partition progresses extremely fast and raises watermark, so > events from other partitions are discarded. Is there any ways to prevent > this from happening? > > Thanks in advance! > > Ruibin >
