The upgrade test passed -> https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708103771--apache--3.7--bb6990114b/2024-02-16--001./2024-02-16--001./report.html
The replica verification test succeeded in ZK mode, but failed in ISOLATED_KRAFT. It just seems to be very flaky. https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708100119--apache--3.7--bb6990114b/2024-02-16--001./2024-02-16--001./report.html Scheduling another run in https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6062/ On Fri, Feb 16, 2024 at 6:39 PM Stanislav Kozlovski <stanis...@confluent.io> wrote: > Thanks all for the help in verifying. > > I have updated > https://gist.github.com/stanislavkozlovski/820976fc7bfb5f4dcdf9742fd96a9982 > with the system tests. > There were two builds ran, and across those - the following tests failed > two times in a row: > > > *kafkatest.tests.tools.replica_verification_test.ReplicaVerificationToolTest#test_replica_lagsArguments:{ > "metadata_quorum": "ZK"}*Fails with the same error of > *`TimeoutError('Timed out waiting to reach non-zero number of replica > lags.')`* > I have scheduled a re-run of this specific test here -> > https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6057 > > *kafkatest.tests.core.upgrade_test.TestUpgrade#test_upgradeArguments:{ > "compression_types": [ "zstd" ], "from_kafka_version": "2.4.1", > "to_message_format_version": null}* > Fails with the same error of > *`TimeoutError('Producer failed to produce messages for 20s.')`* > *kafkatest.tests.core.upgrade_test.TestUpgrade#test_upgradeArguments:{ > "compression_types": [ "lz4" ], "from_kafka_version": "3.0.2", > "to_message_format_version": null}* > Fails with the same error of *`TimeoutError('Producer failed to produce > messages for 20s.')`* > > I have scheduled a re-run of this test here -> > https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6058/ > > On Fri, Feb 16, 2024 at 12:15 PM Vedarth Sharma <vedarth.sha...@gmail.com> > wrote: > >> Hey Stanislav, >> >> Thanks for the release candidate. >> >> +1 (non-binding) >> >> I tested and verified the docker image artifact apache/kafka:3.7.0-rc4:- >> - verified create topic, produce messages and consume messages flow when >> running the docker image with >> - default configs >> - configs provided via env variables >> - configs provided via file input >> - verified the html documentation for docker image. >> - ran the example docker compose files successfully. >> >> All looks good for the docker image artifact! >> >> Thanks and regards, >> Vedarth >> >> >> On Thu, Feb 15, 2024 at 10:58 PM Mickael Maison <mickael.mai...@gmail.com >> > >> wrote: >> >> > Hi Stanislav, >> > >> > Thanks for running the release. >> > >> > I did the following testing: >> > - verified the check sums and signatures >> > - ran ZooKeeper and KRaft quickstarts with Scala 2.13 binaries >> > - ran a successful migration from ZooKeeper to KRaft >> > >> > We seem to be missing the upgrade notes for 3.7.0 in the docs. See >> > https://kafka.apache.org/37/documentation.html#upgrade that still >> > points to 3.6.0 >> > Before voting I'd like to see results from the system tests too. >> > >> > Thanks, >> > Mickael >> > >> > On Thu, Feb 15, 2024 at 6:06 PM Andrew Schofield >> > <andrew_schofield_j...@outlook.com> wrote: >> > > >> > > +1 (non-binding). I used the staged binaries with Scala 2.13. I tried >> > the new group coordinator >> > > and consumer group protocol which is included with the Early Access >> > release of KIP-848. >> > > Also verified the availability of the new APIs. All working as >> expected. >> > > >> > > Thanks, >> > > Andrew >> > > >> > > > On 15 Feb 2024, at 05:07, Paolo Patierno <paolo.patie...@gmail.com> >> > wrote: >> > > > >> > > > +1 (non-binding). I used the staged binaries with Scala 2.13 and >> mostly >> > > > focused on the ZooKeeper to KRaft migration with multiple tests. >> > Everything >> > > > works fine. >> > > > >> > > > Thanks >> > > > Paolo >> > > > >> > > > On Mon, 12 Feb 2024, 22:06 Jakub Scholz, <ja...@scholz.cz> wrote: >> > > > >> > > >> +1 (non-binding). I used the staged binaries with Scala 2.13 and >> the >> > staged >> > > >> Maven artifacts to run my tests. All seems to work fine. Thanks. >> > > >> >> > > >> Jakub >> > > >> >> > > >> On Fri, Feb 9, 2024 at 4:20 PM Stanislav Kozlovski >> > > >> <stanis...@confluent.io.invalid> wrote: >> > > >> >> > > >>> Hello Kafka users, developers and client-developers, >> > > >>> >> > > >>> This is the second candidate we are considering for release of >> Apache >> > > >> Kafka >> > > >>> 3.7.0. >> > > >>> >> > > >>> Major changes include: >> > > >>> - Early Access to KIP-848 - the next generation of the consumer >> > rebalance >> > > >>> protocol >> > > >>> - Early Access to KIP-858: Adding JBOD support to KRaft >> > > >>> - KIP-714: Observability into Client metrics via a standardized >> > interface >> > > >>> >> > > >>> Release notes for the 3.7.0 release: >> > > >>> >> > > >>> >> > > >> >> > >> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/RELEASE_NOTES.html >> > > >>> >> > > >>> *** Please download, test and vote by Thursday, February 15th, 9AM >> > PST >> > > >> *** >> > > >>> >> > > >>> Kafka's KEYS file containing PGP keys we use to sign the release: >> > > >>> https://kafka.apache.org/KEYS >> > > >>> >> > > >>> * Release artifacts to be voted upon (source and binary): >> > > >>> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/ >> > > >>> >> > > >>> * Docker release artifact to be voted upon: >> > > >>> apache/kafka:3.7.0-rc4 >> > > >>> >> > > >>> * Maven artifacts to be voted upon: >> > > >>> >> > https://repository.apache.org/content/groups/staging/org/apache/kafka/ >> > > >>> >> > > >>> * Javadoc: >> > > >>> >> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/javadoc/ >> > > >>> >> > > >>> * Tag to be voted upon (off 3.7 branch) is the 3.7.0 tag: >> > > >>> https://github.com/apache/kafka/releases/tag/3.7.0-rc4 >> > > >>> >> > > >>> * Documentation: >> > > >>> https://kafka.apache.org/37/documentation.html >> > > >>> >> > > >>> * Protocol: >> > > >>> https://kafka.apache.org/37/protocol.html >> > > >>> >> > > >>> * Successful Jenkins builds for the 3.7 branch: >> > > >>> >> > > >>> Unit/integration tests: I am in the process of running and >> analyzing >> > > >> these. >> > > >>> System tests: I am in the process of running these. >> > > >>> >> > > >>> Expect a follow-up over the weekend >> > > >>> >> > > >>> * Successful Docker Image Github Actions Pipeline for 3.7 branch: >> > > >>> Docker Build Test Pipeline: >> > > >>> https://github.com/apache/kafka/actions/runs/7845614846 >> > > >>> >> > > >>> /************************************** >> > > >>> >> > > >>> Best, >> > > >>> Stanislav >> > > >>> >> > > >> >> > > >> > >> > > > -- > Best, > Stanislav > -- Best, Stanislav
