Re: [DISCUSS] KIP-874: TopicRoundRobinAssignor

2022-10-24 Thread Mathieu Amblard
Hi Sophie, Thank you for your message. The TopicRoundRobinAssignor has been already implemented (because the existing ones do not address our use cases correctly), it implements the interface you mentionned, and I have made a PR to the Kafka repo where you can see the source code. It was in a

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #109

2022-10-24 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-874: TopicRoundRobinAssignor

2022-10-24 Thread Sophie Blee-Goldman
Hey Mathieu, Apologies if you already know this, but the partition assignor interface is fully pluggable. That means you can plug in a custom PartitionAssignor implementation, without having to go through a KIP or commit any code to the AK repo. I suspect some of the current unknowns and

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1317

2022-10-24 Thread Apache Jenkins Server
See

Faster connector config dev cycles - A vision and prototype

2022-10-24 Thread Greg Harris
Hey All, I'd like to share with you a potential improvement to the workflow for Connect users that may make connector configurations easier to develop and debug. The focus for this is on reducing the number of manual steps involved in seeing the effects of a config change, so that each iteration

[jira] [Created] (KAFKA-14336) Reduce allocations from MetadataResponse#convertToNodeArray

2022-10-24 Thread David Schlosnagle (Jira)
David Schlosnagle created KAFKA-14336: - Summary: Reduce allocations from MetadataResponse#convertToNodeArray Key: KAFKA-14336 URL: https://issues.apache.org/jira/browse/KAFKA-14336 Project: Kafka

[jira] [Created] (KAFKA-14335) Admin.listConsumerGroups should allow filtering, pagination

2022-10-24 Thread Kirk True (Jira)
Kirk True created KAFKA-14335: - Summary: Admin.listConsumerGroups should allow filtering, pagination Key: KAFKA-14335 URL: https://issues.apache.org/jira/browse/KAFKA-14335 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1316

2022-10-24 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-13518) Update gson dependency

2022-10-24 Thread Manikumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-13518. --- Fix Version/s: 3.4.0 Resolution: Fixed > Update gson dependency > -- > >

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

2022-10-24 Thread Jun Rao
Hi, David, Thanks for the updated KIP. A few more comments. 90. ConsumerGroupTargetAssignmentMemberValue: 90.1 Do we need to include MemberId here given that it's in the key already? 90.2 Since there is no new record if the new member assignment is the same, it seems that AssignmentEpoch doesn't

[jira] [Created] (KAFKA-14334) DelayedFetch purgatory not completed when appending as follower

2022-10-24 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-14334: Summary: DelayedFetch purgatory not completed when appending as follower Key: KAFKA-14334 URL: https://issues.apache.org/jira/browse/KAFKA-14334 Project: Kafka

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

2022-10-24 Thread Magnus Edenhill
Hi, one minor comment on the latest update: Den mån 24 okt. 2022 kl 16:26 skrev David Jacot : > * Jason pointed out that the member id handling is a tad weird. The > group coordinator generates the member id and then trusts the member > when it rejoins the group. This also implies that the

Re: [VOTE] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-10-24 Thread ShunKang Lin
Hi everyone, Thanks Luke. I have submitted a PR https://github.com/apache/kafka/pull/12545, please take a look. Best, ShunKang Luke Chen 于2022年10月24日周一 09:56写道: > Hi ShunKang, > Yes, this vote can be concluded. > You can start to implement it. > > Thanks. > Luke > > > On Fri, Oct 21, 2022 at

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

2022-10-24 Thread David Jacot
Hi all, hi Jason, Based on Jason's feedback, I have updated the KIP as follows. * Jason pointed out that the member id handling is a tad weird. The group coordinator generates the member id and then trusts the member when it rejoins the group. This also implies that the client could directly

Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

2022-10-24 Thread Chris Egerton
+1 (binding). Thanks for the KIP! On Sat, Oct 22, 2022 at 3:38 AM Urbán Dániel wrote: > Hi everyone, > > I would like to start a vote on KIP-710 which aims to support running a > dedicated MM2 cluster in distributed mode: > > >

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-10-24 Thread Andrew Grant
Hey David, Thanks for the KIP. I had a few small questions. “The ZK data migration will copy the existing ZK data into the KRaft metadata log and establish the new KRaft active controller as the active controller from a ZK perspective.” How will the code get all the ZooKeeper config? Will it

[jira] [Created] (KAFKA-14333) Kafka Admin delete records java doc is missing information about supported cleanup.policy

2022-10-24 Thread Tomasz Kaszuba (Jira)
Tomasz Kaszuba created KAFKA-14333: -- Summary: Kafka Admin delete records java doc is missing information about supported cleanup.policy Key: KAFKA-14333 URL: https://issues.apache.org/jira/browse/KAFKA-14333

[jira] [Created] (KAFKA-14332) Split out checkstyle configs between test and main

2022-10-24 Thread Matthew de Detrich (Jira)
Matthew de Detrich created KAFKA-14332: -- Summary: Split out checkstyle configs between test and main Key: KAFKA-14332 URL: https://issues.apache.org/jira/browse/KAFKA-14332 Project: Kafka

[jira] [Created] (KAFKA-14331) Upgrade to Scala 2.13.10

2022-10-24 Thread Viktor Somogyi-Vass (Jira)
Viktor Somogyi-Vass created KAFKA-14331: --- Summary: Upgrade to Scala 2.13.10 Key: KAFKA-14331 URL: https://issues.apache.org/jira/browse/KAFKA-14331 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14330) The Kafka Connection Is High During Service Startup

2022-10-24 Thread flybird (Jira)
flybird created KAFKA-14330: --- Summary: The Kafka Connection Is High During Service Startup Key: KAFKA-14330 URL: https://issues.apache.org/jira/browse/KAFKA-14330 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14329) KafkaAdminClient#listOffsets should query by partition dimension

2022-10-24 Thread shizhenzhen (Jira)
shizhenzhen created KAFKA-14329: --- Summary: KafkaAdminClient#listOffsets should query by partition dimension Key: KAFKA-14329 URL: https://issues.apache.org/jira/browse/KAFKA-14329 Project: Kafka

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-10-24 Thread Luke Chen
Hi David, Thanks for the good and complicated proposal! :) Some questions: 1. "MigrationReady" state: The KIP said: The KRaft quorum has been started I don't think we'll automatically enter this state after KRaft quorum started, do we? I think KRaft active controller should take over leadership