This is an automated email from the ASF dual-hosted git repository.
jlprat pushed a commit to branch 3.8
in repository https://gitbox.apache.org/repos/asf/kafka.git
The following commit(s) were added to refs/heads/3.8 by this push:
new ecf30144e56 KAFKA-17227: Update zstd-jni lib (#16763)
ecf30144e56 is described below
commit ecf30144e565932e4d1cede4a28eb122eb3bfeec
Author: Josep Prat <[email protected]>
AuthorDate: Mon Aug 5 09:51:46 2024 +0200
KAFKA-17227: Update zstd-jni lib (#16763)
* KAFKA-17227: Update zstd-jni lib
* Add note in upgrade docs
* Change zstd-jni version in docker native file and add warning in
dependencies.gradle file
* Add reference to snappy in upgrade
Reviewers: Chia-Ping Tsai <[email protected]>, Mickael Maison
<[email protected]>
---
LICENSE-binary | 2 +-
docker/native/native-image-configs/resource-config.json | 4 ++--
docs/upgrade.html | 15 +++++++++++++--
gradle/dependencies.gradle | 3 ++-
4 files changed, 18 insertions(+), 6 deletions(-)
diff --git a/LICENSE-binary b/LICENSE-binary
index fc765315cdf..bbc60be12a6 100644
--- a/LICENSE-binary
+++ b/LICENSE-binary
@@ -328,7 +328,7 @@ pcollections-4.0.1, see: licenses/pcollections-MIT
---------------------------------------
BSD 2-Clause
-zstd-jni-1.5.6-3 see: licenses/zstd-jni-BSD-2-clause
+zstd-jni-1.5.6-4 see: licenses/zstd-jni-BSD-2-clause
---------------------------------------
BSD 3-Clause
diff --git a/docker/native/native-image-configs/resource-config.json
b/docker/native/native-image-configs/resource-config.json
index 121f24b6372..324d979e8db 100644
--- a/docker/native/native-image-configs/resource-config.json
+++ b/docker/native/native-image-configs/resource-config.json
@@ -25,9 +25,9 @@
}, {
"pattern":"\\Qkafka/kafka-version.properties\\E"
}, {
- "pattern":"\\Qlinux/amd64/libzstd-jni-1.5.6-3.so\\E"
+ "pattern":"\\Qlinux/amd64/libzstd-jni-1.5.6-4.so\\E"
}, {
- "pattern":"\\Qlinux/aarch64/libzstd-jni-1.5.6-3.so\\E"
+ "pattern":"\\Qlinux/aarch64/libzstd-jni-1.5.6-4.so\\E"
}, {
"pattern":"\\Qnet/jpountz/util/linux/amd64/liblz4-java.so\\E"
}, {
diff --git a/docs/upgrade.html b/docs/upgrade.html
index afd092a4c6a..f54daac896a 100644
--- a/docs/upgrade.html
+++ b/docs/upgrade.html
@@ -19,7 +19,17 @@
<script id="upgrade-template" type="text/x-handlebars-template">
-<h4><a id="upgrade_3_8_0" href="#upgrade_3_8_0">Upgrading to 3.8.0 from any
version 0.8.x through 3.6.x</a></h4>
+<h4><a id="upgrade_3_8_1" href="#upgrade_3_8_1">Upgrading to 3.8.1 from any
version 0.8.x through 3.7.x</a></h4>
+ <h5><a id="upgrade_381_notable" href="#upgrade_381_notable">Notable
changes in 3.8.1</a></h5>
+ <ul>
+ <li>In case you run your Kafka clusters with no execution permission
for the <code>/tmp</code> partition, Kafka will not work properly. It might
either refuse to start or fail
+ when producing and consuming messages. This is due to the
compression libraries <code>zstd-jni</code> and <code>snappy</code>.
+ To remediate this problem you need to pass the following JVM flags
to Kafka <code>ZstdTempFolder</code> and <code>org.xerial.snappy.tempdir</code>
pointing to a directory with execution permissions.
+ For example, this could be done via the <code>KAFKA_OPTS</code>
environment variable like follows: <code>export
KAFKA_OPTS="-DZstdTempFolder=/opt/kafka/tmp
-Dorg.xerial.snappy.tempdir=/opt/kafka/tmp"</code>.
+ This is a known issue for version 3.8.0.
+ </li>
+ </ul>
+<h4><a id="upgrade_3_8_0" href="#upgrade_3_8_0">Upgrading to 3.8.0 from any
version 0.8.x through 3.7.x</a></h4>
<h5><a id="upgrade_380_notable" href="#upgrade_380_notable">Notable
changes in 3.8.0</a></h5>
<ul>
@@ -28,7 +38,8 @@
If READ is not authorized, checkpointing is limited to offsets
mirrorred after the start of the task.
See <a
href="https://issues.apache.org/jira/browse/KAFKA-15905";>KAFKA-15905</a> for
more details.
</li>
- <li>Tiered Storage now supports clusters configured with multiple log
directories (i.e. JBOD feature).</li>
+ <li>JBOD in KRaft is no longer in early access.</li>
+ <li>Tiered Storage, which is still in early access, now supports
clusters configured with multiple log directories (i.e. JBOD feature).</li>
</ul>
<h4><a id="upgrade_3_7_1" href="#upgrade_3_7_1">Upgrading to 3.7.1 from any
version 0.8.x through 3.6.x</a></h4>
diff --git a/gradle/dependencies.gradle b/gradle/dependencies.gradle
index f7b6cef051d..2ee8bf4d749 100644
--- a/gradle/dependencies.gradle
+++ b/gradle/dependencies.gradle
@@ -165,7 +165,8 @@ versions += [
spotbugs: "4.8.0",
zinc: "1.9.2",
zookeeper: "3.8.4",
- zstd: "1.5.6-3"
+ // When updating the zstd version, please do as well in
docker/native/native-image-configs/resource-config.json
+ zstd: "1.5.6-4"
]
libs += [
