"Could not detect Kafka Streams version
4.1.0-SNAPSHOT.".
We get this version from
https://github.com/apache/kafka/blob/4.1/tests/kafkatest/version.py#L113
kafka/tests/kafkatest/version.py
DEV_VERSION = KafkaVersion("4.1.0-SNAPSHOT")
Does this help to fix it? Do you plan to take it on? Or do you need help
from our side?
-Matthias
On 7/25/25 8:42 AM, Mickael Maison wrote:
Hi,
Here are the system tests results:
https://drive.google.com/file/d/1wXSuwBKNWrmq1BQzfoC7B2Qelj91P2ih/view?usp=sharing
Like in RC0, these following test is consistently failing in my environment:
kafkatest.tests.core.network_degrade_test.test_rate_device_name=eth0_latency_ms=50_metadata_quorum=COMBINED_KRAFT_rate_limit_kbit=1000000_task_name=rate-1000-latency-50
I opened https://issues.apache.org/jira/browse/KAFKA-19549. Can
someone else try to run that test in their environment?
All the Streams upgrade system tests to 4.1.0 also failed with the
following error: "Could not detect Kafka Streams version
4.1.0-SNAPSHOT.".
This is probably due to the fact that the release script now merges
the release tag (4.1.0-rc1) into the release branch (4.1), so the
branch has 4.1.0 as its version.
It would be good is Streams people could take a look.
Thanks,
Mickael
On Tue, Jul 22, 2025 at 5:44 PM Kuan-Po Tseng <brandb...@gmail.com> wrote:
Hi folks,
I tested upgrading Kafka from both 3.7.2 and 3.8.1 to 4.1.0 and everything
seems good:
- Three-node KRaft cluster; verified produce/consume records worked
correctly using `kafka-producer-perf-test.sh` and
`kafka-console-consumer.sh` before and after each server upgrade.
- After upgrading one node to 4.1.0, saw repeated `The node does not
support UPDATE_RAFT_VOTER` logs — expected since server with older versions
don't support this API.
- Once all nodes were upgraded, the message disappeared. Everything worked
as expected.
+1 (non-binding)
Best,
Kuan-Po Tseng
On Tue, Jul 22, 2025 at 11:03 PM Chia-Ping Tsai <chia7...@gmail.com> wrote:
hi
If anyone wants to test 4.1.0-RC1 without the backport fix, please simply
configure the jdk_version to use another image. For example:
jdk_version="openjdk:17-bullseye" /bin/bash tests/docker/run_tests.sh
Best,
Chia-Ping
Josep Prat <josep.p...@aiven.io.invalid> 於 2025年7月22日 週二 下午10:56寫道：
Hi Mickael,
I don't think we need a new RC just because of these files. Technically
speaking these files are part of the source tarball (which we release),
but
as they are test files, I wouldn't consider them as a blocker that would
grant a new RC.
Best,
On Tue, Jul 22, 2025 at 4:51 PM Mickael Maison <mickael.mai...@gmail.com
wrote:
Hi,
Quick update regarding the system tests. My environment is back but
now we're hitting https://issues.apache.org/jira/browse/KAFKA-19501.
Debian buster which is used in the system tests is out of support and
it's apt repository has now been archived. It worked till last week
but now it's gone so we get an error when building the Docker image.
We had only updated trunk to use bullseye. I've just backported the
fix to 4.1:
https://github.com/apache/kafka/commit/d5a3acda897890379edb8819f15b144fcea564b0
The fix is only in tests/docker/Dockerfile and tests/docker/ducker-ak.
My understanding is that these files are not part of any of the
release artifacts.
So I'm considering keeping the RC1 artifacts and running the system
tests with the fix.
Let me know if my understand is incorrect, or if you'd prefer building
a new RC regardless. Obviously if we find issues with RC1, we'll do
another RC anyway.
Thanks,
Mickael
On Mon, Jul 21, 2025 at 5:04 PM Mickael Maison <
mickael.mai...@gmail.com
wrote:
Hello Kafka users, developers and client-developers,
This is the second candidate for release of Apache Kafka 4.1.0.
The release brings many new features and improvements:
- Mechanism for plugin to register metrics
- Allow running multiple versions of connector plugins
- Queue are now in preview access
- New Streams rebalance protocol in early access
- Support for OAuth jwt-bearer grant type
- Improved metadata replication
Release notes for the 4.1.0 release:
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc1/RELEASE_NOTES.html
*** Please download, test and vote by Friday July 25.
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc1/
* Docker release artifacts to be voted upon:
apache/kafka:4.1.0-rc1
apache/kafka-native:4.1.0-rc1
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc1/javadoc/
* Tag to be voted upon (off 4.1 branch) is the 4.1.0 tag:
https://github.com/apache/kafka/releases/tag/4.1.0-rc1
* Documentation:
https://kafka.apache.org/41/documentation.html
PR (https://github.com/apache/kafka-site/pull/702) is not merged yet
* Protocol:
https://kafka.apache.org/41/protocol.html
PR (https://github.com/apache/kafka-site/pull/702) is not merged yet
* Successful CI builds for the 4.1 branch:
Unit/integration tests:
https://github.com/apache/kafka/actions/runs/16415760777
System tests: The environment I use for running the system tests is
under maintenance. If someone can run the system tests, go ahead.
Otherwise I'll send an update once I'm able to run them.
* Successful Docker Image Github Actions Pipeline for 4.1 branch:
Docker Build Test Pipeline (JVM):
https://github.com/apache/kafka/actions/runs/16415783067
Docker Build Test Pipeline (Native):
https://github.com/apache/kafka/actions/runs/16415786103
Thanks,
Mickael
--
[image: Aiven] <https://www.aiven.io>
*Josep Prat*
Sr. Engineering Director, Streaming Services, *Aiven*
josep.p...@aiven.io | +491715557497
aiven.io <https://www.aiven.io> | <
https://www.facebook.com/aivencloud
<https://www.linkedin.com/company/aiven/> <
https://twitter.com/aiven_io>
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa, Hannu Valtonen,
Kenneth Chen
Amtsgericht Charlottenburg, HRB 209739 B
