Re: KStream-to-KStream Join Example

2016-07-14 Thread Michael Noll
Vivek, another option for you is to replace the `map()` calls with `mapValues()`. Can you give that a try? Background: You are calling `map()` on your two input streams, but in neither of the two cases are you actually changing the key (it is always the userId before the map, and it stays the

Re: KStream-to-KStream Join Example

2016-07-14 Thread Matthias J. Sax
Hi, Both streams need to be co-partitioned, ie, if you change the key of one join input, you need to re-partitioned this stream on the new key via .through(). You should create the topic you use in through() manually, before you start your Kafka Streams application. (For future release, this

Re: KStream-to-KStream Join Example

2016-07-13 Thread vivek thakre
Yes, there are same number of partitions to both the topic, also same partition key i.e userId If I just join the streams without applying the map functions (in this case userClickStream and userEventSrtream) , it works. Thanks, Vivek On Wed, Jul 13, 2016 at 4:53 PM, Philippe Derome

Re: KStream-to-KStream Join Example

2016-07-13 Thread Philippe Derome
Did you specify same number of partitions for the two input topics you are joining? I think that this is usually the first thing people ask to verify with errors similar to yours. If you are experimenting with learning some concepts, it is simpler to always use one partition for your topics. On

KStream-to-KStream Join Example

2016-07-13 Thread vivek thakre
Hello, I want to join 2 Topics (KStreams) Stream 1 Topic : userIdClicks Key : userId Value : JSON String with event details Stream 2 Topic : userIdChannel Key : userId Value : JSON String with event details and has channel value I could not find any examples with KStream-to-KStream Join.