Re: Understanding how joins work in Kafka streams

2016-10-10 Thread Eno Thereska
Hi Sachin, Yes it will be called each time a key is modified, it will do this continuously until you stop the app. Eno > On 9 Oct 2016, at 16:50, Sachin Mittal wrote: > > Hi, > It is actually a KTable-KTable join. > > I have a stream (K1, A) which is aggregated as (Key,

Re: Understanding how joins work in Kafka streams

2016-10-09 Thread Sachin Mittal
Hi, It is actually a KTable-KTable join. I have a stream (K1, A) which is aggregated as (Key, List) hence it creates a KTable. I have another stream (K2, B) which is aggregated as (Key, List) hence it creates another KTable. Then I have KTable (Key, List).leftJoin( KTable(Key, List),

Re: Understanding how joins work in Kafka streams

2016-10-09 Thread Eno Thereska
Hi Sachin, Some comments inline: > On 9 Oct 2016, at 08:19, Sachin Mittal wrote: > > Hi, > I needed some light on how joins actually work on continuous stream of data. > > Say I have 2 topics which I need to join (left join). > Data record in each topic is aggregated like

Understanding how joins work in Kafka streams

2016-10-09 Thread Sachin Mittal
Hi, I needed some light on how joins actually work on continuous stream of data. Say I have 2 topics which I need to join (left join). Data record in each topic is aggregated like (key, value) <=> (string, list) Topic 1 key1: [A01, A02, A03, A04 ..] Key2: [A11, A12, A13, A14 ..] Topic 2