Re: [VOTE] 3.7.0 RC4

Makes sense, thanks Ismael. I've updated it. We are released now! Thank you to all who contributed! There are two final things to do with relation to the release as per the wiki - and that is introduce 3.7 to the respective compatibility system tests for Core, Clients and Streams. Here are the

Re: [VOTE] 3.7.0 RC4

Hi, mvnrepository doesn't matter, we should update the guidelines to remove it. All that matters is that it has reached the maven central repository. Ismael On Tue, Feb 27, 2024 at 9:49 AM Stanislav Kozlovski wrote: > The thinking is that it is available for use - and it is in maven central -

Re: [VOTE] 3.7.0 RC4

The thinking is that it is available for use - and it is in maven central - https://central.sonatype.com/artifact/org.apache.kafka/kafka_2.13 - but the mvnrepository seems to be an unofficial website that offers a nice UI for accessing maven central. The release is in the latter -

Re: [VOTE] 3.7.0 RC4

We wait before making the announcement. The rationale is that there is not much point announcing a release if folks cannot start using that version artifacts immediately. See "Wait for about a day for the artifacts to show up in apache mirror (releases, public group) and maven central

Re: [VOTE] 3.7.0 RC4

Hey all, Everything site-related is merged. I have been following the final steps of the release process. - Docker contains the release - https://hub.docker.com/r/apache/kafka/tags - Maven central contains the release -

Re: [VOTE] 3.7.0 RC4

*(double-sending this to kafka-clients & users, as I forgot initially)* This vote passes with *10 +1 votes* (3 bindings) and no 0 or -1 votes. +1 votes PMC Members (binding): * Mickael Maison * Justine Olshan * Divij Vaidya Community (non-binding): * Proven Provenzano * Federico Valeri *

Re: [VOTE] 3.7.0 RC4

This vote passes with *10 +1 votes* (3 bindings) and no 0 or -1 votes. +1 votes PMC Members (binding): * Mickael Maison * Justine Olshan * Divij Vaidya Community (non-binding): * Proven Provenzano * Federico Valeri * Vedarth Sharma * Andrew Schofield * Paolo Patierno * Jakub Scholz * Josep Prat

Re: [VOTE] 3.7.0 RC4

Hi, Thanks for sorting out the docs issues. +1 (binding) Mickael On Fri, Feb 23, 2024 at 11:50 AM Stanislav Kozlovski wrote: > > Some quick updates: > > There were some inconsistencies between the documentation in the > apache/kafka repo and the one in kafka-site. The process is such that the

Re: [VOTE] 3.7.0 RC4

Some quick updates: There were some inconsistencies between the documentation in the apache/kafka repo and the one in kafka-site. The process is such that the apache/kafka docs are the source of truth, but we had a few divergences in the other repo. I have worked on correcting those with: -

Re: [VOTE] 3.7.0 RC4

Hi all, I found there is a bug (KAFKA-16283 ) in the built-in `RoundRobinPartitioner`, and it will cause only half of the partitions receiving the records. (I'm surprised our tests didn't catch it!?) After further testing, I found this issue

Re: [VOTE] 3.7.0 RC4

HI, I've downloaded, built from source and then validated JBOD with KRaft works along with migrating a cluster with JBOD from ZK to KRaft works. +1 (nonbinding) from me. --Proven On Tue, Feb 20, 2024 at 2:13 PM Justine Olshan wrote: > Hey folks, > > I've done the following to validate the

Re: [VOTE] 3.7.0 RC4

Hey folks, I've done the following to validate the release: -- validated the keys for all the artifacts -- built from source and started a ZK cluster -- ran a few workloads on it. -- ran 2.12 Kraft cluster and ran a few workloads on it I see there is a lot of ongoing discussion about the

Re: [VOTE] 3.7.0 RC4

> I am a bit unclear on the precise process regarding what parts of this get merged at what time, and whether the release first needs to be done or not. The order is as follows: 1. Release approved as part of this vote. After this we follow the steps from here:

Re: [VOTE] 3.7.0 RC4

Thanks for testing the release! And thanks for the review on the documentation. Good catch on the license too. I have addressed the comments in the blog PR, and opened a few other PRs to the website in relation to the release. - 37: Add download section for the latest 3.7 release

Re: [VOTE] 3.7.0 RC4

Great. In that case we can fix the license issue retrospectively. I have created a JIRA for it https://issues.apache.org/jira/browse/KAFKA-16278 and also updated the release process (which redirects to https://issues.apache.org/jira/browse/KAFKA-12622) to check for the correct license in both the

Re: [VOTE] 3.7.0 RC4

Hi, I agree with Josep, I don't think it's worth making a new RC just for this. Thanks Stanislav for sharing the test results. The last thing holding me from casting my vote is the missing upgrade notes for 3.7.0. Thanks, Mickael On Mon, Feb 19, 2024 at 4:28 PM Josep Prat wrote: > > I think

Re: [VOTE] 3.7.0 RC4

I think I remember finding a similar problem (NOTICE_binary) and it didn't qualify for an extra RC Best, On Mon, Feb 19, 2024 at 3:44 PM Divij Vaidya wrote: > I have performed the following checks. The only thing I would like to call > out is the missing licenses before providing a vote. How

Re: [VOTE] 3.7.0 RC4

I have performed the following checks. The only thing I would like to call out is the missing licenses before providing a vote. How do we want to proceed on this? What have we done in the past? (Creating a new RC is overkill IMO for this license issue). ## License check Test: Validate license of

Re: [VOTE] 3.7.0 RC4

The latest system test build completed successfully - https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708250728--apache--3.7--02197edaaa/2024-02-18--001./2024-02-18--001./report.html *System tests are therefore all good*. We

Re: [VOTE] 3.7.0 RC4

The upgrade test passed -> https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708103771--apache--3.7--bb6990114b/2024-02-16--001./2024-02-16--001./report.html The replica verification test succeeded in ZK mode, but failed in

Re: [VOTE] 3.7.0 RC4

Thanks all for the help in verifying. I have updated https://gist.github.com/stanislavkozlovski/820976fc7bfb5f4dcdf9742fd96a9982 with the system tests. There were two builds ran, and across those - the following tests failed two times in a row:

Re: [VOTE] 3.7.0 RC4

Hi Stanislav, it's +1 (non binding) for me. - Built from source using Java 17 and Scala 2.13. - Ran all unit and integration tests. - Used the staged Maven artifacts to test some client applications against ZK and KRaft based clusters. - Tested the Cluster-wide dynamic log adjustment for Kafka

Re: [VOTE] 3.7.0 RC4

Hey Stanislav, Thanks for the release candidate. +1 (non-binding) I tested and verified the docker image artifact apache/kafka:3.7.0-rc4:- - verified create topic, produce messages and consume messages flow when running the docker image with - default configs - configs provided via env

Re: [VOTE] 3.7.0 RC4

Hi Stanislav, Thanks for running the release. I did the following testing: - verified the check sums and signatures - ran ZooKeeper and KRaft quickstarts with Scala 2.13 binaries - ran a successful migration from ZooKeeper to KRaft We seem to be missing the upgrade notes for 3.7.0 in the docs.

Re: [VOTE] 3.7.0 RC4

+1 (non-binding). I used the staged binaries with Scala 2.13. I tried the new group coordinator and consumer group protocol which is included with the Early Access release of KIP-848. Also verified the availability of the new APIs. All working as expected. Thanks, Andrew > On 15 Feb 2024, at

Re: [VOTE] 3.7.0 RC4

+1 (non-binding). I used the staged binaries with Scala 2.13 and mostly focused on the ZooKeeper to KRaft migration with multiple tests. Everything works fine. Thanks Paolo On Mon, 12 Feb 2024, 22:06 Jakub Scholz, wrote: > +1 (non-binding). I used the staged binaries with Scala 2.13 and the

Re: [VOTE] 3.7.0 RC4

I just merged a PR to trunk that fixes some of the LogDirFailureTests. I believe the issue is mostly related to the tests and not the code. Not sure if we think it is necessary to hotfix since the change was in the tests.

Re: [VOTE] 3.7.0 RC4

Hey Justine, Good question. I have been running the system tests and I have been preparing a doc to share. I got one run completed and was waiting for a second one to cross-check, but unfortunately I had a build take 35+ hours and canceled it. I'm currently 6h into the second one, expecting it to

Re: [VOTE] 3.7.0 RC4

Hey Stan, Did we ever get system tests results? I can also start a run On Mon, Feb 12, 2024 at 1:06 PM Jakub Scholz wrote: > +1 (non-binding). I used the staged binaries with Scala 2.13 and the staged > Maven artifacts to run my tests. All seems to work fine. Thanks. > > Jakub > > On Fri, Feb

Re: [VOTE] 3.7.0 RC4

+1 (non-binding). I used the staged binaries with Scala 2.13 and the staged Maven artifacts to run my tests. All seems to work fine. Thanks. Jakub On Fri, Feb 9, 2024 at 4:20 PM Stanislav Kozlovski wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate

Re: [VOTE] 3.7.0 RC4

Hi Stanislav, Thanks for running the release. It gets a +1 (non-binding) from me. I run the following steps to validate: - Compiled with Java 17 and Scala 2.13.12 - Run unit and integration tests - "LogDirFailureTest > testIOExceptionDuringLogRoll(String).quorum=kraft" failed[1] several times

[VOTE] 3.7.0 RC4

Hello Kafka users, developers and client-developers, This is the second candidate we are considering for release of Apache Kafka 3.7.0. Major changes include: - Early Access to KIP-848 - the next generation of the consumer rebalance protocol - Early Access to KIP-858: Adding JBOD support to