[jira] [Created] (KAFKA-14842) MirrorCheckpointTask can reduce the rpc calls of "listConsumerGroupOffsets(group)" of irrelevant groups at each poll

2023-03-23 Thread hudeqi (Jira)
hudeqi created KAFKA-14842: -- Summary: MirrorCheckpointTask can reduce the rpc calls of "listConsumerGroupOffsets(group)" of irrelevant groups at each poll Key: KAFKA-14842 URL:

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Dan S
I have created the jira, the PR will follow within the next few days. https://issues.apache.org/jira/browse/KAFKA-14841 Thanks again On Thu, Mar 23, 2023 at 7:33 PM Philip Nee wrote: > Awesome! > > On Thu, Mar 23, 2023 at 12:31 PM Dan S wrote: > > > I'll pick it up, thanks! > > > > On Thu, Mar

[jira] [Created] (KAFKA-14841) Call ConsumerRebalanceListener when MockConsumer rebalanced

2023-03-23 Thread Daniel Scanteianu (Jira)
Daniel Scanteianu created KAFKA-14841: - Summary: Call ConsumerRebalanceListener when MockConsumer rebalanced Key: KAFKA-14841 URL: https://issues.apache.org/jira/browse/KAFKA-14841 Project: Kafka

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1703

2023-03-23 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14840) Handle KRaft snapshots in dual-write mode

2023-03-23 Thread David Arthur (Jira)
David Arthur created KAFKA-14840: Summary: Handle KRaft snapshots in dual-write mode Key: KAFKA-14840 URL: https://issues.apache.org/jira/browse/KAFKA-14840 Project: Kafka Issue Type:

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Philip Nee
Awesome! On Thu, Mar 23, 2023 at 12:31 PM Dan S wrote: > I'll pick it up, thanks! > > On Thu, Mar 23, 2023, 19:27 Philip Nee wrote: > > > Hey Dan, > > > > Your analysis looks right. I do see TODO item there to implement the > > rebalance callback. Would you like to create a jira issue and work

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Dan S
I'll pick it up, thanks! On Thu, Mar 23, 2023, 19:27 Philip Nee wrote: > Hey Dan, > > Your analysis looks right. I do see TODO item there to implement the > rebalance callback. Would you like to create a jira issue and work on that? > > Thanks, > P > > On Thu, Mar 23, 2023 at 12:11 PM Dan S

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Philip Nee
Hey Dan, Your analysis looks right. I do see TODO item there to implement the rebalance callback. Would you like to create a jira issue and work on that? Thanks, P On Thu, Mar 23, 2023 at 12:11 PM Dan S wrote: > Hi Philip, > > Thanks for the quick reply. Yes, it's the MockConsumer, but in our

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Dan S
Hi Philip, Thanks for the quick reply. Yes, it's the MockConsumer, but in our case we're calling the variant of subscribe that takes a custom ConsumerRebalanceListener(which among other things logs when it's called), and we're then calling rebalance (to simulate a rebalance) and removing all

Re: Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Philip Nee
Hey Dan, Thanks for looking into this. Are you talking about MockConsumer? If you invoke subscribe(Collection topics), it actually registers a Noop callback. Perhaps this is what you are seeing? P On Thu, Mar 23, 2023 at 11:11 AM Dan S wrote: > Hello all, > > It seems to me based on reading

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-23 Thread Jeff Kim
Hi Yi, > Does it mean with a flexible version, the future version of these value types will stay at the version where the flexibility is first introduced? Will there be any need to bump the version again in the future? Yes, there will be no need to bump the version since we will only be adding

Should the mock consumer call the consumer rebalance listener on rebalance?

2023-03-23 Thread Dan S
Hello all, It seems to me based on reading the code, that the consumer rebalance listener that is passed into the mock consumer when subscribing to a topic is not actually called when a rebalance is simulated. My understanding is that the consumer rebalance listener is called from the consumer

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1702

2023-03-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 544945 lines...] [2023-03-23T17:49:21.581Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 176 > ZooKeeperClientTest >

[jira] [Created] (KAFKA-14839) Exclude protected variable from JavaDocs

2023-03-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14839: --- Summary: Exclude protected variable from JavaDocs Key: KAFKA-14839 URL: https://issues.apache.org/jira/browse/KAFKA-14839 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-23 Thread Yi Ding
Hi Jeff, Thanks for the update. Does it mean with a flexible version, the future version of these value types will stay at the version where the flexibility is first introduced? Will there be any need to bump the version again in the future? To enforce the version not bumping, is it possible to

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-03-23 Thread Chia-Ping Tsai
> If you have a KIP that is accepted, make sure it is listed in > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.5.0 > and that it's status is accurate. Thanks for the reminder. Have added KIP-641 to the list. Thanks, Chia-Ping > Mickael Maison 於 2023年3月23日 下午11:51 寫道: > >

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-03-23 Thread Mickael Maison
Hi Christo, Thanks for opening KIP-902. Since the timeline to Kafka 4.0 is still unclear, I think this KIP makes sense overall. Kafka should not depend on end of life dependencies. However the timing is unfortunate and considering the risks of upgrading ZooKeeper I think it's a bit too late to

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-03-23 Thread Mickael Maison
Hi all, KIP Freeze was yesterday. The next milestone is feature freeze on April 12. If you have a KIP that is accepted, make sure it is listed in https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.5.0 and that it's status is accurate. Thanks, Mickael On Fri, Mar 17, 2023 at 6:22 

[jira] [Resolved] (KAFKA-14814) Skip restart of connectors when redundant resume request is made

2023-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14814. --- Fix Version/s: 3.5.0 Resolution: Fixed > Skip restart of connectors when redundant

[jira] [Created] (KAFKA-14838) MM2 Connector/Task clients should specify client ID based on ID and role

2023-03-23 Thread Daniel Urban (Jira)
Daniel Urban created KAFKA-14838: Summary: MM2 Connector/Task clients should specify client ID based on ID and role Key: KAFKA-14838 URL: https://issues.apache.org/jira/browse/KAFKA-14838 Project:

[jira] [Created] (KAFKA-14837) The MirrorCheckPointConnector of MM2 will rebalance frequently, when the source cluster group is many more and changes frequently (but the list of configured synchronous

2023-03-23 Thread hudeqi (Jira)
hudeqi created KAFKA-14837: -- Summary: The MirrorCheckPointConnector of MM2 will rebalance frequently, when the source cluster group is many more and changes frequently (but the list of configured synchronous group does not change) Key:

[jira] [Created] (KAFKA-14836) UtilsTest testToLogDateTimeFormat unit test failing in some cases

2023-03-23 Thread Tamas Barnabas Egyed (Jira)
Tamas Barnabas Egyed created KAFKA-14836: Summary: UtilsTest testToLogDateTimeFormat unit test failing in some cases Key: KAFKA-14836 URL: https://issues.apache.org/jira/browse/KAFKA-14836