Re: Questions about join and exactly-once

2018-07-31 Thread Fabian Hueske
Hi Minglei, 1. Not sure if you are asking for a specific problem, but IMO the main challenge is that there are many different ways (and meanings) to join two streams. The required semantics always depend on the concrete use case. If you want to perform an simple equality join with SQL semantics, y

Questions about join and exactly-once

2018-07-30 Thread zhangminglei
Hi, I would like to ask 2 questions. 1. Currently, what is the problem of flink join ? And what is the essential difference between batch join and stream join ? 2. What are the shortcomings of current exactly-once ? Thanks minglei.