[hadoop] branch trunk updated (142df247eda -> eccd2d04924)
This is an automated email from the ASF dual-hosted git repository.
inigoiri pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
from 142df247eda YARN-11369. Commons.compress throws an
IllegalArgumentException with large uids after 1.21. Contributed by Benjamin
Teke
add eccd2d04924 YARN-11359. [Federation] Routing admin invocations
transparently to multiple RMs. (#5057)
No new revisions were added by this update.
Summary of changes:
.../federation/utils/FederationMethodWrapper.java} | 37 +--
.../hadoop/yarn/server/router/RouterMetrics.java | 34 ++-
.../yarn/server/router/RouterServerUtil.java | 46
.../clientrm/AbstractClientRequestInterceptor.java | 30 +--
.../rmadmin/AbstractRMAdminRequestInterceptor.java | 10 +-
.../rmadmin/FederationRMAdminInterceptor.java | 283 +
.../router/rmadmin/RMAdminProtocolMethod.java | 132 ++
.../router/rmadmin/BaseRouterRMAdminTest.java | 229 +++--
.../rmadmin/TestFederationRMAdminInterceptor.java | 121 +
.../TestableFederationRMAdminInterceptor.java | 99 +++
10 files changed, 844 insertions(+), 177 deletions(-)
copy
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/{hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/ClientMethod.java
=>
hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/federation/utils/FederationMethodWrapper.java}
(72%)
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/rmadmin/FederationRMAdminInterceptor.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/rmadmin/RMAdminProtocolMethod.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestFederationRMAdminInterceptor.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestableFederationRMAdminInterceptor.java
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch trunk updated: YARN-11369. Commons.compress throws an IllegalArgumentException with large uids after 1.21. Contributed by Benjamin Teke
This is an automated email from the ASF dual-hosted git repository.
snemeth pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 142df247eda YARN-11369. Commons.compress throws an
IllegalArgumentException with large uids after 1.21. Contributed by Benjamin
Teke
142df247eda is described below
commit 142df247edab25f0f1e829ea8559fb42a925af7b
Author: Szilard Nemeth
AuthorDate: Wed Nov 16 13:07:05 2022 +0100
YARN-11369. Commons.compress throws an IllegalArgumentException with large
uids after 1.21. Contributed by Benjamin Teke
---
.../main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java | 2 ++
1 file changed, 2 insertions(+)
diff --git
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java
index 862d68ebc0a..52b6dde3794 100644
---
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java
+++
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java
@@ -331,6 +331,8 @@ public class FrameworkUploader implements Runnable {
LOG.info("Compressing tarball");
try (TarArchiveOutputStream out = new TarArchiveOutputStream(
targetStream)) {
+ // Workaround for the compress issue present from 1.21: COMPRESS-587
+ out.setBigNumberMode(TarArchiveOutputStream.BIGNUMBER_STAR);
for (String fullPath : filteredInputFiles) {
LOG.info("Adding " + fullPath);
File file = new File(fullPath);
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch branch-3.3.5 updated: HADOOP-18484. Upgrade hsqldb to v2.7.1 to mitigate CVE-2022-41853 (#5114)
This is an automated email from the ASF dual-hosted git repository.
adoroszlai pushed a commit to branch branch-3.3.5
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.3.5 by this push:
new 2cc1896d447 HADOOP-18484. Upgrade hsqldb to v2.7.1 to mitigate
CVE-2022-41853 (#5114)
2cc1896d447 is described below
commit 2cc1896d44724f798f7a7806314c37bbdcd21401
Author: Ashutosh Gupta
AuthorDate: Wed Nov 16 10:42:43 2022 +
HADOOP-18484. Upgrade hsqldb to v2.7.1 to mitigate CVE-2022-41853 (#5114)
---
LICENSE-binary | 2 +-
.../hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml | 1 +
hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml | 1 +
hadoop-mapreduce-project/pom.xml | 1 +
hadoop-project/pom.xml | 3 ++-
.../hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/pom.xml | 1 +
6 files changed, 7 insertions(+), 2 deletions(-)
diff --git a/LICENSE-binary b/LICENSE-binary
index a12f21666b8..e8d8f4440b0 100644
--- a/LICENSE-binary
+++ b/LICENSE-binary
@@ -492,7 +492,7 @@ jakarta.xml.bind:jakarta.xml.bind-api:2.3.2
HSQL License
-org.hsqldb:hsqldb:2.3.4
+org.hsqldb:hsqldb:2.7.1
JDOM License
diff --git
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
index 3f147d12984..6ce234b001a 100644
---
a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
+++
b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
@@ -104,6 +104,7 @@
org.hsqldb
hsqldb
test
+ jdk8
diff --git a/hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml
b/hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml
index 1478cb1885d..93bbd2ecf6e 100644
--- a/hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml
+++ b/hadoop-mapreduce-project/hadoop-mapreduce-examples/pom.xml
@@ -106,6 +106,7 @@
org.hsqldb
hsqldb
provided
+ jdk8
org.apache.hadoop.thirdparty
diff --git a/hadoop-mapreduce-project/pom.xml b/hadoop-mapreduce-project/pom.xml
index 882a3eab8da..7c2bc2444b3 100644
--- a/hadoop-mapreduce-project/pom.xml
+++ b/hadoop-mapreduce-project/pom.xml
@@ -142,6 +142,7 @@
org.hsqldb
hsqldb
compile
+ jdk8
${leveldbjni.group}
diff --git a/hadoop-project/pom.xml b/hadoop-project/pom.xml
index fd1743d919c..0ceb935f5f6 100644
--- a/hadoop-project/pom.xml
+++ b/hadoop-project/pom.xml
@@ -187,7 +187,7 @@
1.0-beta-1
900
1.12.316
-2.3.4
+2.7.1
1.11.2
2.1
0.7
@@ -1475,6 +1475,7 @@
org.hsqldb
hsqldb
${hsqldb.version}
+jdk8
io.dropwizard.metrics
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/pom.xml
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/pom.xml
index b6fd161f0e8..932557806d6 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/pom.xml
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/pom.xml
@@ -129,6 +129,7 @@
org.hsqldb
hsqldb
test
+ jdk8
com.microsoft.sqlserver
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
