filpano commented on PR #11326: URL: https://github.com/apache/kafka/pull/11326#issuecomment-3029065614
Thanks for the earnest reply despite my somewhat tongue-in-cheek comment. To shed some background light on the motivation: we currently have a use case where any large variation of record counts between partitions makes stream processing downstream prohibitively expensive due to required window sizes. As such, using something like the `RoundRobinPartitioner` seemed like the perfect fit to prevent skew in downstream processing tasks. To put it another way: yes, a backport would be very helpful. For what it's worth, I've tested the updated partitioner logic here with a large number of records in a local test and it seems to be performing as it should (variance between partitions of _< 0.01%_). If there's anything I can do in the way of further testing to help, please let me know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
