Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks for running this release, Stanislav! And thanks to all the contributors who helped implement all the bug fixes and new features we got to put out this time around. On Tue, Feb 27, 2024, 13:03 Stanislav Kozlovski < stanislavkozlov...@apache.org> wrote: > The Apache Kafka community is

Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks for running the release, Stanislav! Luke On Wed, Feb 28, 2024 at 4:06 AM Mickael Maison wrote: > Thanks to all the contributors and thank you Stanislav for running the > release! > > > On Tue, Feb 27, 2024 at 7:03 PM Stanislav Kozlovski > wrote: > > > > The Apache Kafka community is

Re: [DISCUSS] KIP-939: Support Participation in 2PC

Hi Jun, Thank you for the discussion. > For 3b, it would be useful to understand the reason why an admin doesn't authorize 2PC for self-hosted Flink I think the nuance here is that for cloud, there is a cloud admin (operator) and there is cluster admin (who, for example could manage acls on

Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks to all the contributors and thank you Stanislav for running the release! On Tue, Feb 27, 2024 at 7:03 PM Stanislav Kozlovski wrote: > > The Apache Kafka community is pleased to announce the release of > Apache Kafka 3.7.0 > > This is a minor release that includes new features, fixes, and

[jira] [Created] (KAFKA-16309) Enabling virtual threads in the Kafka Consumer

Soby Chacko created KAFKA-16309: --- Summary: Enabling virtual threads in the Kafka Consumer Key: KAFKA-16309 URL: https://issues.apache.org/jira/browse/KAFKA-16309 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

Hi, Jose, Thanks for the reply. 30. Who controls RPCs like Fetch, FetchSnapshot, DescribeQuorum RPC? They are shared between voters and observers. "The admin client will send the AddVoter and RemoveVoter requests if they are reported by ApiVersions." Does the client use supported ApiKeys or

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi, Abhijeet, Thanks for the explanation. Makes sense to me now. Just a minor comment. Could you document the exact meaning of the following two metrics? For example, is the time accumulated? If so, is it from the start of the broker or over some window? kafka.log.remote:type=RemoteLogManager,

[ANNOUNCE] Apache Kafka 3.7.0

The Apache Kafka community is pleased to announce the release of Apache Kafka 3.7.0 This is a minor release that includes new features, fixes, and improvements from 296 JIRAs An overview of the release and its notable changes can be found in the release blog post:

Re: [VOTE] 3.7.0 RC4

The thinking is that it is available for use - and it is in maven central - https://central.sonatype.com/artifact/org.apache.kafka/kafka_2.13 - but the mvnrepository seems to be an unofficial website that offers a nice UI for accessing maven central. The release is in the latter -

Re: [VOTE] 3.7.0 RC4

We wait before making the announcement. The rationale is that there is not much point announcing a release if folks cannot start using that version artifacts immediately. See "Wait for about a day for the artifacts to show up in apache mirror (releases, public group) and maven central

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

Hi Jun, Thanks for the comments. See my comments below. On Mon, Feb 26, 2024 at 4:48 PM Jun Rao wrote: > 15.1 It would be useful to document the process of changing the controller > listener. For example, what configs need to be changed in what order and > how a voter/observer selects the

Re: Assistance Needed with MM2 Heartbeat Topic Configuration

Hello, the heartbeat connector is a sink connector, so it normally would write to the target cluster. I can think of two ways to achieve what you want: 1) set up a second connect cluster that sinks to the source cluster, and run just the heartbeat connector there. 2) override the heartbeat

Re: [VOTE] 3.7.0 RC4

Hey all, Everything site-related is merged. I have been following the final steps of the release process. - Docker contains the release - https://hub.docker.com/r/apache/kafka/tags - Maven central contains the release -

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966830608 so is the blog post https://kafka.apache.org/blog#apache_kafka_370_release_announcement -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966829525 I was just going to mention. It coincided a little bit with Humbledooh bouncing some "info bot" related to the website -

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

mimaison commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966821632 Not sure if INFRA did anything or if your last push triggered something but the website has been updated! -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski merged PR #578: URL: https://github.com/apache/kafka-site/pull/578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966816792 asked in Slack too, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (KAFKA-16306) GroupCoordinatorService logger is not configured

[ https://issues.apache.org/jira/browse/KAFKA-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16306. - Fix Version/s: 3.8.0 Resolution: Fixed > GroupCoordinatorService logger is not

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2680

See Changes: -- [...truncated 349885 lines...] [2024-02-27T14:57:53.488Z] [INFO] [2024-02-27T14:57:53.488Z] [INFO] --- install:2.5.2:install (default-install) @

Assistance Needed with MM2 Heartbeat Topic Configuration

Dear Kafka Community, I am reaching out for some guidance regarding an issue I've encountered while setting up Kafka MirrorMaker2 (MM2) for data synchronization from a source cluster (A) to a target cluster (B). During my setup with MM2 on dedicated mode, I observed that the heartbeat topic is

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

mimaison commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966684594 I created https://issues.apache.org/jira/browse/INFRA-25556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi Ahmed, Thanks for the KIP. It looks like a useful addition. The use of negative timestamps, and in particular letting the user use `--time -1` or the equivalent `--time latest` is a bit peculiar in this tool already. The negative timestamps come from

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Justine, Thanks for the KIP. This area of Kafka is complicated and making it easier is good. When I use the `kafka-features.sh` tool to describe the features on my cluster, I find that there’s a single feature called “metadata.version”. I think this KIP does a handful of things: 1) It

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thank you for volunteering Josep. +1 from me. -- Divij Vaidya On Tue, Feb 27, 2024 at 9:35 AM Bruno Cadonna wrote: > Thanks Josep! > > +1 > > Best, > Bruno > > On 2/26/24 9:53 PM, Chris Egerton wrote: > > Thanks Josep, I'm +1 as well. > > > > On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan >

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

mimaison commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966317965 I'd ask in the `#asfinfra` channel in the ASF Slack or open an INFRA ticket. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966277572 @mimaison do you have any guide as to how to begin debugging this? I don't see a CI in Github -- This is an automated message from the Apache Git Service. To respond to the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2679

See

[DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi all, I would like to start a discussion on KIP-1021, which would enable getting LSO in kafka-get-offsets.sh: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1021%3A+Allow+to+get+last+stable+offset+%28LSO%29+in+kafka-get-offsets.sh Best, Ahmed

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi Jun, The existing quota system for consumers is designed to throttle the consumer if it exceeds the allowed fetch rate. The additional quota we want to add works on the broker level. If the broker-level remote read quota is being exceeded, we prevent additional reads from the remote storage

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

stanislavkozlovski commented on PR #578: URL: https://github.com/apache/kafka-site/pull/578#issuecomment-1966067709 @divijvaidya @mimaison I would like to merge this today. Do you happen to have any other comments? -- This is an automated message from the Apache Git Service. To respond

Re: [PR] 37: Update default docs to point to the 3.7.0 release docs [kafka-site]

stanislavkozlovski merged PR #582: URL: https://github.com/apache/kafka-site/pull/582 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] 37: Update default docs to point to the 3.7.0 release docs [kafka-site]

stanislavkozlovski commented on PR #582: URL: https://github.com/apache/kafka-site/pull/582#issuecomment-1966064487 I followed the release process to a tee to get these right and reviewed myself. The process doesn't necessarily ask for a reviewer, so just merging -- This is an automated

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

stanislavkozlovski merged PR #583: URL: https://github.com/apache/kafka-site/pull/583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

stanislavkozlovski commented on PR #583: URL: https://github.com/apache/kafka-site/pull/583#issuecomment-1966063081 updated the docker image and the release date, to today -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Resolved] (KAFKA-9062) Handle stalled writes to RocksDB

[ https://issues.apache.org/jira/browse/KAFKA-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-9062. -- Resolution: Won't Fix > Handle stalled writes to RocksDB > >

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep! +1 Best, Bruno On 2/26/24 9:53 PM, Chris Egerton wrote: Thanks Josep, I'm +1 as well. On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan wrote: Thanks Joesp. +1 from me. On Mon, Feb 26, 2024 at 3:37 AM Josep Prat wrote: Hi all, I'd like to volunteer as release manager for