(hadoop) annotated tag release-3.4.0-RC3 updated (bd8b77f398f6 -> 6cb7b4b4d92d)
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a change to annotated tag release-3.4.0-RC3 in repository https://gitbox.apache.org/repos/asf/hadoop.git *** WARNING: tag release-3.4.0-RC3 was modified! *** from bd8b77f398f6 (commit) to 6cb7b4b4d92d (tag) tagging bd8b77f398f626bb7791783192ee7a5dfaeec760 (commit) replaces release-3.4.0-RC2 by Shilun Fan on Mon Mar 4 13:28:30 2024 +0800 - Log - Release candidate - 3.4.0-RC3 -BEGIN PGP SIGNATURE- iQIzBAABCAAdFiEECm40PGXwzjlsDKJKl4RW45ZNtwEFAmXlW/4ACgkQl4RW45ZN twGoeQ/9GeULZArBzHKuw9rUFZtk8u3l3VziFrdB42CYpW8uvYQtPSG58DcSPnc+ 8wItOS7Pkj8GPN5SmMVAd88B7U2ATGt75dai837h+gjureI+zLSsR4E9bANyakJz DAk1uXDi4mGenLL0ipcmDPahoJkYfiQUYgUZW+m5o04w38MGod+NRoQ38otq77Hx qdbQEc+MvsTwXVm1/cYgBhi7/kVMadHEbvj2BVWk7WZ7nivVo7JtTat9+1r8i8V8 nRc2XkJMMAo2pp3MS6REKMUGXJFywKBdIVsbWc6okQI67AsYY3hd/o0sHgQdImRt 0n46ZBKTg1Qqr9Qy94GLdke473pbWRzQ93Y0Wmtx57++fPa4dnKSd3MHNawpFmkA F8h7xy9frBgM5/LSTwHOHEc0ksSvXuEmEu1vhmx1yE/GIEMMag1kZdVIUzWQj4UF /2JiDWFtiCRw/9mwQ9oG1ArN/tlGHKa0dsKEP3cwCreD8/oCXbVEutgnjrfkqlI5 5aHHFGh94c/EfLy+UEvg1uT2UeKc4NADE3AJVxBqdCK3l8pF1gcZrzGLXyCZT7R9 JDQWWn9hPsIQsiU0k4FCVhQDEzlsd8dc/BWt/0T+7rM2sMKxOzafzFbDNmvqgUDs q+pAkexeZUYvyBVCiruKriAoACP6aAiEWT0TWz2L4TtXdF3xR6g= =NlTM -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) annotated tag release-3.4.0-RC3 deleted (was 70a9be135011)
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a change to annotated tag release-3.4.0-RC3 in repository https://gitbox.apache.org/repos/asf/hadoop.git *** WARNING: tag release-3.4.0-RC3 was deleted! *** tag was 70a9be135011 The revisions that were on this annotated tag are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) branch branch-3.4.0 updated: HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan.
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a commit to branch branch-3.4.0 in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/branch-3.4.0 by this push: new bd8b77f398f6 HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan. bd8b77f398f6 is described below commit bd8b77f398f626bb7791783192ee7a5dfaeec760 Author: slfan1989 <55643692+slfan1...@users.noreply.github.com> AuthorDate: Mon Mar 4 13:19:28 2024 +0800 HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan. Reviewed-by: He Xiaoqiao Signed-off-by: Shilun Fan --- hadoop-project/src/site/markdown/index.md.vm | 10 ++ 1 file changed, 10 insertions(+) diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm index 54e8055e633d..fa728f74463a 100644 --- a/hadoop-project/src/site/markdown/index.md.vm +++ b/hadoop-project/src/site/markdown/index.md.vm @@ -242,6 +242,16 @@ you want to remain exclusively *your cluster*. Finally, if you are using Hadoop as a service deployed/managed by someone else, do determine what security their products offer and make sure it meets your requirements. +Protobuf Compatibility +=== + +In HADOOP-18197, we upgraded the Protobuf in hadoop-thirdparty to version 3.21.12. +This version may have compatibility issues with certain versions of JDK8, +and you may encounter some errors (please refer to the discussion in HADOOP-18197 for specific details). + +To address this issue, we recommend upgrading the JDK version in your production environment to a higher version (> JDK8). +We will resolve this issue by upgrading hadoop-thirdparty's Protobuf to a higher version in a future release of 3.4.x. +Please note that we will discontinue support for JDK8 in future releases of 3.4.x. Getting Started === - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) branch branch-3.4 updated: HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan.
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 65a2bdeeead0 HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan. 65a2bdeeead0 is described below commit 65a2bdeeead0c4826588f2bb05b10bb307a2727f Author: slfan1989 <55643692+slfan1...@users.noreply.github.com> AuthorDate: Mon Mar 4 13:19:28 2024 +0800 HADOOP-19099. Add Protobuf Compatibility Notes (#6607) Contributed by Shilun Fan. Reviewed-by: He Xiaoqiao Signed-off-by: Shilun Fan --- hadoop-project/src/site/markdown/index.md.vm | 10 ++ 1 file changed, 10 insertions(+) diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm index 54e8055e633d..fa728f74463a 100644 --- a/hadoop-project/src/site/markdown/index.md.vm +++ b/hadoop-project/src/site/markdown/index.md.vm @@ -242,6 +242,16 @@ you want to remain exclusively *your cluster*. Finally, if you are using Hadoop as a service deployed/managed by someone else, do determine what security their products offer and make sure it meets your requirements. +Protobuf Compatibility +=== + +In HADOOP-18197, we upgraded the Protobuf in hadoop-thirdparty to version 3.21.12. +This version may have compatibility issues with certain versions of JDK8, +and you may encounter some errors (please refer to the discussion in HADOOP-18197 for specific details). + +To address this issue, we recommend upgrading the JDK version in your production environment to a higher version (> JDK8). +We will resolve this issue by upgrading hadoop-thirdparty's Protobuf to a higher version in a future release of 3.4.x. +Please note that we will discontinue support for JDK8 in future releases of 3.4.x. Getting Started === - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) annotated tag release-3.4.0-RC3 updated (5ed3a27df041 -> 70a9be135011)
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a change to annotated tag release-3.4.0-RC3 in repository https://gitbox.apache.org/repos/asf/hadoop.git *** WARNING: tag release-3.4.0-RC3 was modified! *** from 5ed3a27df041 (commit) to 70a9be135011 (tag) tagging 5ed3a27df041ebb57e4983792e28b13320cb96df (commit) replaces release-3.4.0-RC2 by Shilun Fan on Sun Mar 3 18:16:05 2024 +0800 - Log - Release candidate - 3.4.0-RC3 -BEGIN PGP SIGNATURE- iQIzBAABCAAdFiEECm40PGXwzjlsDKJKl4RW45ZNtwEFAmXkTeUACgkQl4RW45ZN twFz9w//c1yFtQ5bmCKbO0hDovBnwBFkZAR80d1MkLwBlTLolR3cLKlt+ZzM9j7h X538zoEwztJ/k9oRrhUgmjizaRq9T4DZzVe9a5g+8eavQybEBy23J53/aPT94iVb YSYyhI7I+35HhV3IllQwqIaFy84B4r8sLjTlmmPDjyChdEpeUJdbNFHVSdAkda71 8e5cxrB07mRBDGy79v+zCbzjl/amfWrfht3A91MZZi/FOJL2KC14zfNHOSZTpo0p UsjAb3nStrTDoXaRwJlAI4LJ2VD8iI9Qwx1jBGggLJmAFN2ixIrueGKCiefbDQZ9 Qt/A+KzCi7inCFdB98xBkbVaQGlymLZLFYqau51K/CttjswC1vsggNiIfiVS+JYg UwrNaY8FyK26E+JZ8lMK4Je1cmksZi79qEzGn5Cm/KtzAfl6lu4+CP4IyXlgkhsW ETu5aXCmrYAPJiy7beFiyBq3En+K0772WG6A/f2I7N7CBBepSP4I1PtIBLzgpkZU cCDONqVK+4BT5kw9UlvkVeNAfT4gdb7gVvXixVnxwDbtz4/eKbRVlOmURPOWY4/C /0z5cv3rYTOrEV8kL0Bd8Pb/J2Am4sPOKQPX100HwknOxcWAti4IyB84Tj9UKpqi JX9kXkztzbXMQR/UOeHDHFGp9ZfIExD61617QRvz5MAX4IAt3qM= =3Z4t -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) branch branch-3.4.0 updated: HADOOP-19084. Prune hadoop-common transitive dependencies (#6574)
This is an automated email from the ASF dual-hosted git repository.
slfan1989 pushed a commit to branch branch-3.4.0
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.4.0 by this push:
new 5ed3a27df041 HADOOP-19084. Prune hadoop-common transitive dependencies
(#6574)
5ed3a27df041 is described below
commit 5ed3a27df041ebb57e4983792e28b13320cb96df
Author: Steve Loughran
AuthorDate: Fri Feb 23 17:56:46 2024 +
HADOOP-19084. Prune hadoop-common transitive dependencies (#6574)
Exclude more artifacts which are dependencies of hadoop-* modules,
with the goal of keeping conflict out of downstream applications.
In particular we have pruned the dependencies of of:
-zookeeper
-other libraries referencing logging
This keeps slf4j-log4j12 and log4j12 off the classpath
of applications importing hadoop-common.
Somehow logback references do still surface; applications
pulling in hadoop-common directly or indirectly should
review their imports carefully.
Contributed by Steve Loughran
---
hadoop-project/pom.xml | 46 ++
.../hadoop-yarn-applications-mawo-core/pom.xml | 19 -
2 files changed, 29 insertions(+), 36 deletions(-)
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index bd93a7e392c7..0ed96d087bc6 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -126,7 +126,7 @@
1.9.0
2.14.0
3.12.0
-1.1.3
+1.2
3.6.1
3.9.0
1.10.0
@@ -1435,15 +1435,11 @@
io.netty
-netty-all
-
-
-io.netty
-netty-handler
+*
-io.netty
-netty-transport-native-epoll
+commons-io
+commons-io
commons-collections
@@ -1507,15 +1503,7 @@
io.netty
-netty-all
-
-
-io.netty
-netty-handler
-
-
-io.netty
-netty-transport-native-epoll
+*
org.eclipse.jetty
@@ -1596,6 +1584,12 @@
${leveldbjni.group}
leveldbjni-all
1.8
+
+
+com.fasterxml.jackson.core
+jackson-core
+
+
org.fusesource.hawtjni
@@ -1958,11 +1952,23 @@
org.ehcache
ehcache
${ehcache.version}
+
+
+ org.slf4j
+ slf4j-api
+
+
com.zaxxer
HikariCP
${hikari.version}
+
+
+ org.slf4j
+ slf4j-api
+
+
org.apache.derby
@@ -2024,6 +2030,12 @@
org.jsonschema2pojo
jsonschema2pojo-core
${jsonschema2pojo.version}
+
+
+commons-io
+commons-io
+
+
org.xerial.snappy
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/pom.xml
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/pom.xml
index ecdda6280f1c..f53cb2fff8ad 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/pom.xml
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/pom.xml
@@ -93,25 +93,6 @@
org.apache.zookeeper
zookeeper
-
-
-
- junit
- junit
-
-
- com.sun.jdmk
- jmxtools
-
-
- com.sun.jmx
- jmxri
-
-
- org.jboss.netty
- netty
-
-
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
(hadoop) branch branch-3.4.0 updated: HADOOP-18088. Replace log4j 1.x with reload4j. (#4052)
This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a commit to branch branch-3.4.0 in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/branch-3.4.0 by this push: new 253afde7b2d0 HADOOP-18088. Replace log4j 1.x with reload4j. (#4052) 253afde7b2d0 is described below commit 253afde7b2d00444145c242832ea1f6da73528b2 Author: Steve Loughran AuthorDate: Tue Feb 13 16:33:51 2024 + HADOOP-18088. Replace log4j 1.x with reload4j. (#4052) Co-authored-by: Wei-Chiu Chuang Includes HADOOP-18354. Upgrade reload4j to 1.22.2 due to XXE vulnerability (#4607). Log4j 1.2.17 has been replaced by reloadj 1.22.2 SLF4J is at 1.7.36 (cherry picked from commit 095dfcca306289e8f676de89d6a054a193593d5d) --- LICENSE-binary | 11 +-- .../resources/assemblies/hadoop-dynamometer.xml| 2 +- .../resources/assemblies/hadoop-hdfs-nfs-dist.xml | 2 +- .../resources/assemblies/hadoop-httpfs-dist.xml| 2 +- .../main/resources/assemblies/hadoop-kms-dist.xml | 2 +- .../resources/assemblies/hadoop-mapreduce-dist.xml | 2 +- .../main/resources/assemblies/hadoop-nfs-dist.xml | 2 +- .../src/main/resources/assemblies/hadoop-tools.xml | 2 +- .../main/resources/assemblies/hadoop-yarn-dist.xml | 2 +- .../hadoop-client-check-invariants/pom.xml | 4 +- .../hadoop-client-check-test-invariants/pom.xml| 4 +- .../hadoop-client-integration-tests/pom.xml| 9 +- .../hadoop-client-minicluster/pom.xml | 10 +- .../hadoop-client-runtime/pom.xml | 8 +- hadoop-client-modules/hadoop-client/pom.xml| 14 +-- hadoop-common-project/hadoop-auth-examples/pom.xml | 6 +- hadoop-common-project/hadoop-auth/pom.xml | 12 ++- hadoop-common-project/hadoop-common/pom.xml| 6 +- .../java/org/apache/hadoop/util/GenericsUtil.java | 2 +- .../java/org/apache/hadoop/util/TestClassUtil.java | 2 +- hadoop-common-project/hadoop-kms/pom.xml | 6 +- hadoop-common-project/hadoop-minikdc/pom.xml | 2 +- hadoop-common-project/hadoop-nfs/pom.xml | 6 +- hadoop-hdfs-project/hadoop-hdfs-client/pom.xml | 4 +- hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml | 6 +- hadoop-hdfs-project/hadoop-hdfs-nfs/pom.xml| 6 +- hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml| 6 +- hadoop-hdfs-project/hadoop-hdfs/pom.xml| 6 +- .../hadoop-mapreduce-client/pom.xml| 2 +- hadoop-project/pom.xml | 105 +++-- hadoop-tools/hadoop-azure/pom.xml | 4 +- .../pom.xml| 4 +- .../hadoop-yarn-services-core/pom.xml | 4 +- .../hadoop-yarn/hadoop-yarn-client/pom.xml | 4 +- .../hadoop-yarn/hadoop-yarn-common/pom.xml | 4 +- .../hadoop-yarn-server-resourcemanager/pom.xml | 4 +- .../pom.xml| 4 + 37 files changed, 186 insertions(+), 95 deletions(-) diff --git a/LICENSE-binary b/LICENSE-binary index c5ba9f938aef..c2cc745b4da3 100644 --- a/LICENSE-binary +++ b/LICENSE-binary @@ -210,6 +210,7 @@ hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/static/nvd3-1.8.5.* (css and js hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/checker/AbstractFuture.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/checker/TimeoutFuture.java +ch.qos.reload4j:reload4j:1.2.22 com.aliyun:aliyun-java-sdk-core:4.5.10 com.aliyun:aliyun-java-sdk-kms:2.11.0 com.aliyun:aliyun-java-sdk-ram:3.1.0 @@ -294,7 +295,6 @@ io.reactivex:rxjava-string:1.1.1 io.reactivex:rxnetty:0.4.20 io.swagger:swagger-annotations:1.5.4 javax.inject:javax.inject:1 -log4j:log4j:1.2.17 net.java.dev.jna:jna:5.2.0 net.minidev:accessors-smart:1.2 org.apache.avro:avro:1.9.2 @@ -489,11 +489,10 @@ org.checkerframework:checker-qual:2.5.2 org.codehaus.mojo:animal-sniffer-annotations:1.21 org.jruby.jcodings:jcodings:1.0.13 org.jruby.joni:joni:2.1.2 -org.slf4j:jul-to-slf4j:jar:1.7.25 -org.ojalgo:ojalgo:43.0:compile -org.slf4j:jul-to-slf4j:1.7.25 -org.slf4j:slf4j-api:1.7.25 -org.slf4j:slf4j-log4j12:1.7.25 +org.ojalgo:ojalgo:43.0 +org.slf4j:jul-to-slf4j:1.7.36 +org.slf4j:slf4j-api:1.7.36 +org.slf4j:slf4j-reload4j:1.7.36 CDDL 1.1 + GPLv2 with classpath exception diff --git a/hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml b/hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml index 448035262e12..b2ce562231c5 100644 --- a/hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml +++ b/hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml @@ -66,7 +66,7 @@ org.slf4j:slf4j-api -org.slf4j:slf4j-log4j12 +
