A `StickyRangeAssignor` is not the same as a `JoinAssignor` that needs
to do co-partitioning.
Also, does "sticky" assignment and "range" assignment not contradict
each other a little bit?
>> Regarding how I am using a KV store instead of a kafka compacted topic: I
>> simply prepend my keys
Hi Matthias,
Once KIP-429 is released, all non-sticky assignors will be as useful. Any user
that wants to take advantage of KIP-429 needs to use a sticky assignor.
Currently there is only 1 sticky assignor in the kafka project, which is
similar to RoundRobinAssignor, but a sticky verion. I
Mike,
I am still not sure, why we need to add this assignor to the project.
Even after you pointed out that you cannot use Kafka Streams, the idea
of the consumer to make the `PartitionAssignor` interface public and
plugable is, that the project does not need to add strategies for all
kind of use
In light of KIP-429, I think there will be an increased demand for sticky
assignors. So, I'd like to restart the conversation about adding the sticky
streams assignor,
https://cwiki.apache.org/confluence/display/KAFKA/KIP-315%3A+Stream+Join+Sticky+Assignor.
It’d be great to get feedback on
Hi Mike,
Thanks for sharing your feedbacks and the blocker features for Kafka
Streams. They are very helpful.
Guozhang
On Wed, Jun 20, 2018 at 2:47 PM, Mike Freyberger
wrote:
> Matthias,
>
> Thanks for the feedback. For our use case, we have some complexities that
> make using the existing
Matthias,
Thanks for the feedback. For our use case, we have some complexities that make
using the existing Streams API more complicated than using the Kafka Consumer
directly.
- We are doing async processing, which I don't think is currently available
(KIP-311 is handling this).
- Our
Mike,
thanks a lot for the KIP. I am wondering, why Streams API cannot be used
for perform the join? Would be good to understand the advantage of
adding a `StickyStreamJoinAssignor` compared to using Streams API? Atm,
it seems to be a redundant feature to me.
-Matthias
On 6/20/18 1:07 PM, Mike
Hi everybody,
I’ve created a proposal document for KIP-315 which outlines the motivation of
adding a new partition assignment strategy that can used for streaming join use
cases.
It’d be great to get feedback on the overall idea and the proposed
implementation.
KIP Link:
