[
https://issues.apache.org/jira/browse/KAFKA-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925539#comment-17925539
]
Nicholas Telford edited comment on KAFKA-18765 at 2/10/25 10:50 AM:
--------------------------------------------------------------------
A simple solution might be to add an optional {{Joined<K, V, VO>
withAutoStreamPartitioner(StreamPartitioner partitioner)}} to {{Joined}} and
friends, that enables the configuration of the automatic repartitioning, but
only if auto-repartitioning takes place (i.e. it does not force a repartition
if none is required).
Since this would add to the API, it looks like a KIP would be required,
although a pretty straight-forward one.
was (Author: nicktelford):
A simple solution might be to add an optional {{Joined<K, V, VO>
withAutoStreamPartitioner(StreamPartitioner partitioner)}} to {{Joined}} and
friends, that enables the configuration of the automatic repartitioning, but
only if auto-repartitioning takes place (i.e. it does not force a repartition
if none is required.
Since this would add to the API, it looks like a KIP would be required,
although a pretty straight-forward one.
> Custom StreamsPartitioner for auto-repartitioning
> -------------------------------------------------
>
> Key: KAFKA-18765
> URL: https://issues.apache.org/jira/browse/KAFKA-18765
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Affects Versions: 4.0.0
> Reporter: Nicholas Telford
> Priority: Minor
>
> There is currently no way to configure the {{StreamsPartitioner}} used by
> auto-repartitioning when using the Kafka Streams DSL. The default
> {{StreamsPartitioner}} is always used.
> This can create a problem for users, whereby joining/aggregating with a
> stream/table that has been partitioned with a custom partitioner may not work
> as expected, if the user does not explicitly {{repartition()}} the stream
> first with the custom {{{}StreamsPartitioner{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
