Re: KafkaStreams GroupBy with new key. Can I skip repartition?

2020-03-01 Thread Murilo Tavares
I agree with Mathias. Can’t see how this KIP/PR helps with the problem described in the KAFKA-4835... On Sun, Mar 1, 2020 at 2:16 PM Matthias J. Sax wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > I don't think that KIP-221 addressed the discussed use case. > > KIP-221 allows to

Re: Are RocksDBWindowStore windows hopping or sliding?

2020-03-01 Thread Matthias J. Sax
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 If you want to put a record into multiple window, you can do a `put()` for each window. The DSL uses the store in the exact same manner for hopping window (compare the code I shared in the last reply). Even if windows are overlapping, the

Re: KafkaStreams GroupBy with new key. Can I skip repartition?

2020-03-01 Thread Matthias J. Sax
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 I don't think that KIP-221 addressed the discussed use case. KIP-221 allows to force a repartitioning manually, while the use case describe in the original email was to suppress/skip a repartitioning ste p. The issue to avoid unnecessary