Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-04 Thread David Arthur
Andrew, thanks for the KIP! This is a pretty exciting effort. I've finally made it through the KIP, still trying to grok the whole thing. Sorry if some of my questions are basic :) Concepts: 70. Does the Group Coordinator communicate with the Share Coordinator over RPC or directly in-process?

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-04 Thread Justine Olshan
I'm hoping this covers the majority of comments. I will go ahead and open the vote in the next day or so. Thanks, Justine On Wed, Apr 3, 2024 at 3:31 PM Justine Olshan wrote: > Find and replace has failed me :( > > Group version seems a little vague, but we can update it. Hopefully find > and

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-04 Thread Sophie Blee-Goldman
Before I go into my own feedback, which I know not everyone has the time to read, I just want to announce that we plan to go over this KIP during the next Streams project sync on April 11. If you are interested in joining the discussion and need an invitation, just reach out to me in a separate

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #168

2024-04-04 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2782

2024-04-04 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-04 Thread Jun Rao
Hi, Abhijeet, Thanks for the KIP. Left a few comments. 1. "A drawback of using the last-tiered-offset is that this new follower would possess only a limited number of locally stored segments. Should it ascend to the role of leader, there is a risk of needing to fetch these segments from the

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-04 Thread Andrew Schofield
Hi Jun, Thanks for your comments and thorough review. I’ve added a new ShareGroupMemberMetadata record which I refer to below. Each member in a share group has a ShareGroupMemberMetadata record. Previously, members needed to rejoin the share group if the coordinator changed, but now the member ID

[jira] [Created] (KAFKA-16475) Create unit test for TopicImageNode

2024-04-04 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-16475: Summary: Create unit test for TopicImageNode Key: KAFKA-16475 URL: https://issues.apache.org/jira/browse/KAFKA-16475 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-16474) AsyncKafkaConsumer might rapidly send out successive heartbeat causing partitions getting revoked

2024-04-04 Thread Philip Nee (Jira)
Philip Nee created KAFKA-16474: -- Summary: AsyncKafkaConsumer might rapidly send out successive heartbeat causing partitions getting revoked Key: KAFKA-16474 URL: https://issues.apache.org/jira/browse/KAFKA-16474

[jira] [Created] (KAFKA-16473) KafkaDockerWrapper uses wrong cluster ID when formatting log dir

2024-04-04 Thread Sebastian Marsching (Jira)
Sebastian Marsching created KAFKA-16473: --- Summary: KafkaDockerWrapper uses wrong cluster ID when formatting log dir Key: KAFKA-16473 URL: https://issues.apache.org/jira/browse/KAFKA-16473

[jira] [Created] (KAFKA-16472) Integration tests in Java don't really run kraft case

2024-04-04 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-16472: - Summary: Integration tests in Java don't really run kraft case Key: KAFKA-16472 URL: https://issues.apache.org/jira/browse/KAFKA-16472 Project: Kafka Issue Type:

Re: [VOTE] 3.6.2 RC2

2024-04-04 Thread Manikumar
Thanks all for voting. I'm now closing the vote. The vote passes with - 3 +1 bindings votes from Divij Vaidya, Justine, and Manikumar - 3 +1 non-binding votes from Andrew, Jakub, and Lianet - 0 -1 votes I'll go ahead and finish the release process. Thanks, On Thu, Apr 4, 2024 at 8:53 PM

Re: [VOTE] 3.6.2 RC2

2024-04-04 Thread Manikumar
+1 (binding) from my side also. - verified the signatures, artifacts - ran the tests on the source archive - verified the quickstarts Thanks On Thu, Apr 4, 2024 at 7:46 PM Justine Olshan wrote: > Thanks for clarifying Manikumar! > > +1 (binding) from me > > Justine > > On Thu, Apr 4, 2024 at

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.7 #126

2024-04-04 Thread Apache Jenkins Server
See

Re: [VOTE] 3.6.2 RC2

2024-04-04 Thread Justine Olshan
Thanks for clarifying Manikumar! +1 (binding) from me Justine On Thu, Apr 4, 2024 at 3:19 AM Divij Vaidya wrote: > Hi Manikumar > > I verified the following: > - all non-minor commits in the branch are captured in release notes > - signature on the artifact match the public signature of

[jira] [Created] (KAFKA-16471) SslTransportLayer may leak SSLEngine resources

2024-04-04 Thread Gaurav Narula (Jira)
Gaurav Narula created KAFKA-16471: - Summary: SslTransportLayer may leak SSLEngine resources Key: KAFKA-16471 URL: https://issues.apache.org/jira/browse/KAFKA-16471 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-04 Thread Omnia Ibrahim
Thanks Chris for the feedback > 1. It'd be nice to mention that increasing the max offset lag to INT_MAX > could work as a partial workaround for users on existing versions (though > of course this wouldn't prevent creation of the syncs topic). I updated the KIP > 2. Will it be illegal to disable

Re: [VOTE] 3.6.2 RC2

2024-04-04 Thread Divij Vaidya
Hi Manikumar I verified the following: - all non-minor commits in the branch are captured in release notes - signature on the artifact match the public signature of Manikumar - basic topic creation & produce / consumer works with JDK8 + ARM + Kafka 3.6.2 + Scala 2.12 + ZK + compression (zstd)

[jira] [Resolved] (KAFKA-16359) kafka-clients-3.7.0.jar published to Maven Central is defective

2024-04-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16359. --- Fix Version/s: 3.8.0 3.7.1 Resolution: Fixed > kafka-clients-3.7.0.jar

[jira] [Created] (KAFKA-16470) kafka-dump-log --offsets-decoder should support new records

2024-04-04 Thread David Jacot (Jira)
David Jacot created KAFKA-16470: --- Summary: kafka-dump-log --offsets-decoder should support new records Key: KAFKA-16470 URL: https://issues.apache.org/jira/browse/KAFKA-16470 Project: Kafka

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-04-04 Thread Luke Chen
Hi Kamal, Thanks for sharing! I didn't know about the change before v2.8. If that's the case, then we have to reconsider the solution of this PR. Is making it optional a good solution? Or should we recover the snapshot if not found before uploading it? But what if the topic is created before

Re: Kafka capabilities

2024-04-04 Thread Kafka Life
Dear Kafka experts , Could anyone having this data share the details please On Wed, Apr 3, 2024 at 3:42 PM Kafka Life wrote: > Hi Kafka users > > Does any one have a document or ppt that showcases the capabilities of > Kafka along with any cost management capability? > i have a customer who is

Re: [VOTE] 3.6.2 RC2

2024-04-04 Thread Manikumar
Hi Justine, Thanks for catching this. looks like we have missed updating `docs/documentation.html` in kafka repo during 3.5 and 3.6 release. I will make sure to use the correct version when updating docs for 3.6.2 release. I will also update 3.5 and 3.6 branches with the correct heading and also