[jira] [Created] (KAFKA-14866) When the controller changes, the old controller needs to clean up some related resources when resigning

2023-03-28 Thread hudeqi (Jira)
hudeqi created KAFKA-14866: -- Summary: When the controller changes, the old controller needs to clean up some related resources when resigning Key: KAFKA-14866 URL: https://issues.apache.org/jira/browse/KAFKA-14866

[jira] [Created] (KAFKA-14865) Consumer::poll returns early on with an empty result for highly compacted KTables

2023-03-28 Thread Jira
Balázs Németh created KAFKA-14865: - Summary: Consumer::poll returns early on with an empty result for highly compacted KTables Key: KAFKA-14865 URL: https://issues.apache.org/jira/browse/KAFKA-14865

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-28 Thread Brebner, Paul
David, hi, interesting thanks! Paul From: David Arthur Date: Wednesday, 29 March 2023 at 2:37 am To: paul.breb...@netapp.com.invalid Cc: us...@kafka.apache.org , dev@kafka.apache.org , mmcfarl...@cavulus.com , Israel Ekpo , ranlupov...@gmail.com , scante...@gmail.com , show...@gmail.com ,

[jira] [Created] (KAFKA-14864) Memory leak in KStreamWindowAggregate with ON_WINDOW_CLOSE emit strategy

2023-03-28 Thread Victoria Xia (Jira)
Victoria Xia created KAFKA-14864: Summary: Memory leak in KStreamWindowAggregate with ON_WINDOW_CLOSE emit strategy Key: KAFKA-14864 URL: https://issues.apache.org/jira/browse/KAFKA-14864 Project:

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-28 Thread Jeff Kim
Hi Alexandre, Thanks for the feedback. 100. You're correct. I updated the KIP to explicitly state that once we introduce a new tagged field in a later version, that version can never be downgraded to the listed versions. 101. I don't think there is a way to differentiate the two but also not

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.3 #165

2023-03-28 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1714

2023-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 274159 lines...] [2023-03-28T21:17:37.157Z] > Task :clients:compileTestJava UP-TO-DATE [2023-03-28T21:17:37.157Z] > Task :clients:testClasses

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #101

2023-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 447577 lines...] [2023-03-28T21:20:31.542Z] [2023-03-28T21:20:31.542Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 172 >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.2 #101

2023-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 379200 lines...] [2023-03-28T21:07:50.454Z] [2023-03-28T21:07:50.454Z]

[jira] [Created] (KAFKA-14863) Plugins which do not have a valid no-args constructor are visible in the REST API

2023-03-28 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14863: --- Summary: Plugins which do not have a valid no-args constructor are visible in the REST API Key: KAFKA-14863 URL: https://issues.apache.org/jira/browse/KAFKA-14863

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-28 Thread Alexandre Dupriez
Hi Jeff, Thank you for the fast answer! 100. Got it, I think I am starting to understand based on your example exposing three Kafka versions. Please let me know if the following corresponds to the correct interpretation. Taking OffsetCommitValue as an example, the idea is to bump the schema to

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1713

2023-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 275286 lines...] [2023-03-28T16:47:24.719Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 175 > KafkaZkClientTest >

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-28 Thread David Arthur
Paul, thanks for the articles. It's great to see someone digging into KRaft! It would be interesting to see your experiments against a newer version of KRaft, such as 3.4.0. Also, we hope to improve on the maximum number of partitions with the addition of

[jira] [Resolved] (KAFKA-14843) Connector plugins config endpoint does not include Common configs

2023-03-28 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14843. --- Fix Version/s: 3.5.0 Resolution: Fixed > Connector plugins config endpoint does not

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-28 Thread Jeff Kim
Hi Alexandre, Thank you for taking a look! 100. I am not sure I fully understand what you mean by forcefully adding tagged fields. Let's say VX does not have a flexible version, VY allows deserialization but serializes with a non-flexible version, and VZ introduces a new tagged field. VX upgrade

Re: [DISCUSS] KIP-910: Update Source offsets for Source Connectors without producing records

2023-03-28 Thread Chris Egerton
Hi Sagar, Thanks for the KIP! I have some thoughts. Nits: 1. Shouldn't KAFKA-3821 [1] be linked as the Jira ticket on the KIP? Or is there a different ticket that should be associated with it? 2. The current state is listed as "Draft". Considering it's been brought up for discussion, maybe the

[jira] [Created] (KAFKA-14862) Outer stream-stream join does not output all results with multiple input partitions

2023-03-28 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-14862: - Summary: Outer stream-stream join does not output all results with multiple input partitions Key: KAFKA-14862 URL: https://issues.apache.org/jira/browse/KAFKA-14862

[jira] [Created] (KAFKA-14861) Migration Documentation should state the need for connectivity from controller to brokers when provisioning the KRaft controller quorum

2023-03-28 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14861: - Summary: Migration Documentation should state the need for connectivity from controller to brokers when provisioning the KRaft controller quorum Key: KAFKA-14861 URL:

[jira] [Created] (KAFKA-14860) New controllers created for migration should validate connectivity to brokers before starting migration

2023-03-28 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14860: - Summary: New controllers created for migration should validate connectivity to brokers before starting migration Key: KAFKA-14860 URL:

[jira] [Created] (KAFKA-14859) Support SCRAM ZK to KRaft Migration

2023-03-28 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14859: - Summary: Support SCRAM ZK to KRaft Migration Key: KAFKA-14859 URL: https://issues.apache.org/jira/browse/KAFKA-14859 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-14842) MirrorCheckpointTask can reduce the rpc calls of "listConsumerGroupOffsets(group)" of irrelevant groups at each poll

2023-03-28 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14842. --- Fix Version/s: 3.5.0 Resolution: Done > MirrorCheckpointTask can reduce the rpc

[jira] [Created] (KAFKA-14858) Standalone herder does not handle exceptions thrown from connector taskConfigs method

2023-03-28 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14858: - Summary: Standalone herder does not handle exceptions thrown from connector taskConfigs method Key: KAFKA-14858 URL: https://issues.apache.org/jira/browse/KAFKA-14858

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-28 Thread Kafka Life
This is really great information Paul . Thank you . On Tue, Mar 28, 2023 at 4:01 AM Brebner, Paul wrote: > I have a recent 3 part blog series on Kraft (expanded version of ApacheCon > 2022 talk): > > > > >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1712

2023-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 274092 lines...] [2023-03-28T11:16:51.401Z] > Task :storage:api:compileTestJava UP-TO-DATE [2023-03-28T11:16:51.401Z] > Task

Re: [DISCUSS] KIP-915: Next Gen Group Coordinator Downgrade Path

2023-03-28 Thread Alexandre Dupriez
Hi Jeff, Team, Thank you for the KIP. This is a very interesting approach. I feel it is simpler than the described alternative although it comes with tradeoffs, thanks for highlighting those. If I may, I would like to share two naive questions. 100. The KIP mentions that records will be

Re: [DISCUSS] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

2023-03-28 Thread Rajini Sivaram
Hi all, With KIP-881, consumer partition assignors attempt to improve locality by matching consumer racks with partition replica racks. At the moment, we don't rebalance when replicas change, so changes in replica racks are not taken into account for partition assignment until the next rebalance,