Re: [DISCUSS] KIP-932: Queues for Kafka

Hi, Andrew, Thanks for the updated KIP. A few more comments. 40. It would be useful to document the flow for serving the initial ShareGroupHeartbeatRequest. The coordinator needs to (1) write the ConsumerGroupMetadata record, the ConsumerGroupMemberMetadata record, the initial

[PR] MINOR: make ZK migrating to KRaft feature as production ready [kafka-site]

showuon opened a new pull request, #594: URL: https://github.com/apache/kafka-site/pull/594 Ref: https://github.com/apache/kafka/pull/15552 The current document about Zookeeper to kraft migration is depreciated. Accord to [KIP-833: Mark KRaft as Production

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2780

See

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Andrew (and Omnia), Thanks for the KIP. I hope to provide some feedback on this KIP soon, but I had a thought on the specific subject of group configs and MM2. If brokers validate for known groups configs then doesn't this induce an ordering requirement on upgrading clusters: Wouldn't you have

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Find and replace has failed me :( Group version seems a little vague, but we can update it. Hopefully find and replace won't fail me again, otherwise I will get another email on this. Justine On Wed, Apr 3, 2024 at 12:15 PM David Jacot wrote: > Thanks, Justine. > > * Should we also use

Re: [VOTE] 3.6.2 RC2

Thanks for clarifying! I took a look at the documentation.html file in there, and it said 3.4. Is that expected? There are some files that request fullDot version and that seemed closer to what was expected: "fullDotVersion": "3.6.2-SNAPSHOT" The upgrade.html file also looked ok. Thanks for

Re: [VOTE] KIP-1020 Move `window.size.ms` and `windowed.inner.serde.class` from `StreamsConfig` to TimeWindowedDe/Serializer class

+1 (binding) Thanks Lucia! On Tue, Apr 2, 2024 at 12:23 AM Matthias J. Sax wrote: > +1 (binding) > > > -Matthias > > On 4/1/24 7:44 PM, Lucia Cerchie wrote: > > Hello everyone, > > > > I'd like to call a vote on KIP-1020 > > < >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #107

See Changes: -- [...truncated 566445 lines...] [2024-04-03T20:38:11.915Z] > Task :raft:testClasses UP-TO-DATE [2024-04-03T20:38:11.915Z] > Task :connect:json:testClasses

[jira] [Created] (KAFKA-16469) Metadata Schema Checker

Colin McCabe created KAFKA-16469: Summary: Metadata Schema Checker Key: KAFKA-16469 URL: https://issues.apache.org/jira/browse/KAFKA-16469 Project: Kafka Issue Type: New Feature

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #125

See Changes: -- [...truncated 345162 lines...] [2024-04-03T19:56:52.128Z] [2024-04-03T19:56:52.128Z] Gradle Test Run :connect:runtime:test > Gradle Test Executor 50 >

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Thanks, Justine. * Should we also use `group.version` (GV) as I suggested in my previous message in order to be consistent? * Should we add both names to the `Public Interfaces` section? * There is still at least one usage of `transaction.protocol.verison` in the KIP too. Best, David On Wed,

Re: [VOTE] 3.6.2 RC2

Hi Justine, Yes, it is intended. For bug fix releases website docs will be updated during the final release process. We can verify the site-docs artifacts here: https://home.apache.org/~manikumar/kafka-3.6.2-rc2/kafka_2.12-3.6.2-site-docs.tgz These site-docs artifacts will be used to update

Re: [VOTE] 3.6.2 RC2

Hi Manikumar, I've verified the keys, scanned the artifacts, and other docs. I built from source and ran with a ZK cluster (since I saw that we updated ZK version in this release) I ran a few tests on this cluster. I also ran the 2.12 binary. I noticed the docs link

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

I had missed the David's message yesterday about the naming for transaction version vs transaction protocol version. After some offline discussion with Jun, Artem, and David, we agreed that transaction version is simpler and conveys more than just protocol changes (flexible records for example)

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

Thanks @Kamal Chandraprakash Greg Harris I currently do not have detailed understanding on the behaviour when empty producer snapshot restored. I will try to test out the behaviour.Meanwhile I would request other community members if they can chime in and assist if they are already aware of the

Community over Code EU 2024: Start planning your trip!

[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] Dear community, We hope you are doing great, are you ready for Community Over Code EU? Check out the featured sessions, get your tickets with special

Re: [VOTE] 3.6.2 RC2

Hi Manikumar, I did the following checks: - downloaded and built from src - ran all unit test and integration test for clients - ran quickstart with Kraft mode - ran simple workloads with the console consumer/producer - checked all links All looks good to me with this. +1 (non-binding) Thanks!

Re: [ANNOUNCE] New committer: Christo Lolov

Congrats Christo! -Bill On Wed, Mar 27, 2024 at 4:03 AM Matthias J. Sax wrote: > Congrats! > > On 3/26/24 9:39 PM, Christo Lolov wrote: > > Thank you everyone! > > > > It wouldn't have been possible without quite a lot of reviews and > extremely > > helpful inputs from you and the rest of the

Participate in the ASF 25th Anniversary Campaign

Hi everyone, As part of The ASF’s 25th anniversary campaign[1], we will be celebrating projects and communities in multiple ways. We invite all projects and contributors to participate in the following ways: * Individuals - submit your first contribution:

[jira] [Created] (KAFKA-16468) Listener not found error in SendRPCsToBrokersEvent

David Arthur created KAFKA-16468: Summary: Listener not found error in SendRPCsToBrokersEvent Key: KAFKA-16468 URL: https://issues.apache.org/jira/browse/KAFKA-16468 Project: Kafka Issue

[jira] [Resolved] (KAFKA-16413) Add tests for FileLock

[ https://issues.apache.org/jira/browse/KAFKA-16413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16413. Fix Version/s: 3.8.0 Resolution: Fixed > Add tests for FileLock >

Re: [DISCUSS] KIP-1031: Control offset translation in MirrorSourceConnector

Hi Omnia, Thanks for the KIP! Two small things come to mind: 1. It'd be nice to mention that increasing the max offset lag to INT_MAX could work as a partial workaround for users on existing versions (though of course this wouldn't prevent creation of the syncs topic). 2. Will it be illegal to

Re: [DISCUSS] KIP-1031: Control offset translation in MirrorSourceConnector

Hi Omnia, Thanks for the KIP! It LGTM! But I'm not an expert of MM2, it would be good to see if there is any other comment from MM2 experts. Thanks. Luke On Thu, Mar 14, 2024 at 6:08 PM Omnia Ibrahim wrote: > Hi everyone, I would like to start a discussion thread for KIP-1031: > Control

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

Hi Mickael, Thanks for your response and apologies for a huge delay in mine. My thinking is that any partition could go stale if there are no records being produced into it. If enough of such partitions are present and are owned by a single MM task, an OOM could happen. Regarding the scenario

Kafka capabilities

Hi Kafka users Does any one have a document or ppt that showcases the capabilities of Kafka along with any cost management capability? i have a customer who is still using IBM MQM and rabbit MQ. I want the client to consider kafka for messaging and data streaming. I wanted to seek your expert

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

Hi Krishna, I also have the same question as Manikumar raised: 1. Will the Docker inventory files/etc are the same for OSS Image and Docker Official Images? If no, then why not? Could we make them identical so that we don't have to build 2 images for each release? Thank you. Luke On Wed, Apr 3,

Re: [VOTE] 3.6.2 RC2

+1 (non-binding). I used the staged Scala 2.13 binaries and the staging Maven repo for my testing. All seems to work fine. Thanks for doing the release. Jakub On Thu, Mar 28, 2024 at 10:51 AM Manikumar wrote: > Hello Kafka users, developers and client-developers, > > This is the second

Re: [VOTE] 3.6.2 RC2

Hi, I downloaded the binary release and upgraded a broker from 3.6.0 to 3.6.2. Documentation and protocol links look fine. +1 (non-binding) Thanks, Andrew > On 3 Apr 2024, at 07:17, Manikumar wrote: > > Gentle reminder. Please download, test and vote for the release. > > Thanks, > > On Fri,

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

Hi Christo, 1. I agree with Doguscan that in KRaft mode, the controller won't send RPCs to the brokers (except in the migration path). So, I think we could adopt the similar way we did to `AlterReplicaLogDirs` ( KIP-858

Re: [VOTE] 3.6.2 RC2

Gentle reminder. Please download, test and vote for the release. Thanks, On Fri, Mar 29, 2024 at 4:57 PM Manikumar wrote: > Hi All, > > System test runs are green. There were 13 test failures in the first run. > All the failed tests passed in the second run. > > System test results: >