Re: Join two streams from Kafka

2021-02-11 Thread Arvid Heise
Hi Shamit, unless you have some temporal relationship between the records to be joined, you have to use a regular join over stream 1 and stream 2. Since you cannot define any window, all data will be held in Flink's state, which is not an issue for a few millions but probably means you have to

Join two streams from Kafka

2021-02-09 Thread Shamit
Hello Flink Users, I am newbie and have question on join of two streams (stream1 and stream2 ) from Kafka topic based on some key. In my use case I need to join with stream2 data which might be year old and more. Now if on stream1 the data gets arrived today and I need to join with stream2