[hadoop] branch branch-3.2 updated: Make upstream aware of 3.2.4 release.
This is an automated email from the ASF dual-hosted git repository. iwasakims pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 7021024d083 Make upstream aware of 3.2.4 release. 7021024d083 is described below commit 7021024d083f4da142fd551d20229c6e1de3c468 Author: Masatake Iwasaki AuthorDate: Fri Jul 22 02:33:22 2022 + Make upstream aware of 3.2.4 release. --- hadoop-project-dist/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hadoop-project-dist/pom.xml b/hadoop-project-dist/pom.xml index 1aa243da600..948d5e0b3e0 100644 --- a/hadoop-project-dist/pom.xml +++ b/hadoop-project-dist/pom.xml @@ -135,7 +135,7 @@ false -3.2.2 +3.2.4 -unstable - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
svn commit: r55896 - /dev/hadoop/hadoop-3.2.4/ /release/hadoop/common/hadoop-3.2.4/
Author: iwasakims Date: Fri Jul 22 02:08:02 2022 New Revision: 55896 Log: Publishing the bits for release 3.2.4 Added: release/hadoop/common/hadoop-3.2.4/ - copied from r55895, dev/hadoop/hadoop-3.2.4/ Removed: dev/hadoop/hadoop-3.2.4/ - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
svn commit: r55895 [1/3] - /dev/hadoop/hadoop-3.2.4/
Author: iwasakims Date: Fri Jul 22 02:06:17 2022 New Revision: 55895 Log: Publishing the bits for release 3.2.4 Added: dev/hadoop/hadoop-3.2.4/ dev/hadoop/hadoop-3.2.4/CHANGELOG.md dev/hadoop/hadoop-3.2.4/CHANGELOG.md.asc dev/hadoop/hadoop-3.2.4/CHANGELOG.md.sha512 dev/hadoop/hadoop-3.2.4/RELEASENOTES.md dev/hadoop/hadoop-3.2.4/RELEASENOTES.md.asc dev/hadoop/hadoop-3.2.4/RELEASENOTES.md.sha512 dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.asc dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.sha512 dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz (with props) dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.asc dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.sha512 dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz (with props) dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz.asc dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz.sha512 dev/hadoop/hadoop-3.2.4/hadoop-3.2.4.tar.gz (with props) dev/hadoop/hadoop-3.2.4/hadoop-3.2.4.tar.gz.asc dev/hadoop/hadoop-3.2.4/hadoop-3.2.4.tar.gz.sha512 Added: dev/hadoop/hadoop-3.2.4/CHANGELOG.md == --- dev/hadoop/hadoop-3.2.4/CHANGELOG.md (added) +++ dev/hadoop/hadoop-3.2.4/CHANGELOG.md Fri Jul 22 02:06:17 2022 @@ -0,0 +1,213 @@ + + +# Apache Hadoop Changelog + +## Release 3.2.4 - 2022-07-12 + + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HDFS-16337](https://issues.apache.org/jira/browse/HDFS-16337) | Show start time of Datanode on Web | Minor | . | Tao Li | Tao Li | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HDFS-15075](https://issues.apache.org/jira/browse/HDFS-15075) | Remove process command timing from BPServiceActor | Major | . | Ãñigo Goiri | Xiaoqiao He | +| [HDFS-15150](https://issues.apache.org/jira/browse/HDFS-15150) | Introduce read write lock to Datanode | Major | datanode | Stephen O'Donnell | Stephen O'Donnell | +| [HDFS-16175](https://issues.apache.org/jira/browse/HDFS-16175) | Improve the configurable value of Server #PURGE\_INTERVAL\_NANOS | Major | ipc | JiangHua Zhu | JiangHua Zhu | +| [HDFS-16173](https://issues.apache.org/jira/browse/HDFS-16173) | Improve CopyCommands#Put#executor queue configurability | Major | fs | JiangHua Zhu | JiangHua Zhu | +| [HADOOP-17897](https://issues.apache.org/jira/browse/HADOOP-17897) | Allow nested blocks in switch case in checkstyle settings | Minor | build | Masatake Iwasaki | Masatake Iwasaki | +| [HADOOP-17857](https://issues.apache.org/jira/browse/HADOOP-17857) | Check real user ACLs in addition to proxied user ACLs | Major | . | Eric Payne | Eric Payne | +| [HDFS-14997](https://issues.apache.org/jira/browse/HDFS-14997) | BPServiceActor processes commands from NameNode asynchronously | Major | datanode | Xiaoqiao He | Xiaoqiao He | +| [HADOOP-17926](https://issues.apache.org/jira/browse/HADOOP-17926) | Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself. | Minor | documentation | Rintaro Ikeda | Rintaro Ikeda | +| [YARN-10935](https://issues.apache.org/jira/browse/YARN-10935) | AM Total Queue Limit goes below per-user AM Limit if parent is full. | Major | capacity scheduler, capacityscheduler | Eric Payne | Eric Payne | +| [HDFS-16241](https://issues.apache.org/jira/browse/HDFS-16241) | Standby close reconstruction thread | Major | . | zhanghuazong | zhanghuazong | +| [YARN-1115](https://issues.apache.org/jira/browse/YARN-1115) | Provide optional means for a scheduler to check real user ACLs | Major | capacity scheduler, scheduler | Eric Payne | | +| [HDFS-16279](https://issues.apache.org/jira/browse/HDFS-16279) | Print detail datanode info when process first storage report | Minor | . | Tao Li | Tao Li | +| [HDFS-16294](https://issues.apache.org/jira/browse/HDFS-16294) | Remove invalid DataNode#CONFIG\_PROPERTY\_SIMULATED | Major | datanode | JiangHua Zhu | JiangHua Zhu | +| [HDFS-16299](https://issues.apache.org/jira/browse/HDFS-16299) | Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics | Minor | . | Tao Li | Tao Li | +| [HDFS-16301](https://issues.apache.org/jira/browse/HDFS-16301) | Improve BenchmarkThroughput#SIZE naming standardization | Minor | benchmarks, test | JiangHua Zhu | JiangHua Zhu | +| [YARN-10997](https://issues.apache.org/jira/browse/YARN-10997) | Revisit allocation and reservation logging | Major | . | Andras Gyori | Andras Gyori | +| [HDFS-16315](https://issues.apache.org/jira/browse/HDFS-16315) | Add metrics related to Transfer and NativeCopy for DataNode | Major | . | Tao Li | Tao Li | +| [HADOOP-17998](https://issues.apache.org/jira/browse/HADOOP-17998) | Allow get command to run with multi threads.
svn commit: r55895 [3/3] - /dev/hadoop/hadoop-3.2.4/
Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.asc == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.asc (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.asc Fri Jul 22 02:06:17 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEECgj3B1tT0NiL5XpvNiQ+7OIGuw0FAmLNcOQACgkQNiQ+7OIG +uw1+iw//YU5qAON2Hihn22YVzVNsX2fU9voc3AGNCSohGdqDldy1266tKkNi+a7e +SnRylXq9bIkAm05MoLkcBwdWJ2jGjbjqvPAuJMryOg5Fs5BJqA+aBk6CEa9aZ4zW +b20MZKnk4DiWUOIJvq8eHIHSTvgQh3ryz2zf7CPMc1E1PW4kU6p2gfrJKoNVg42N +Iy1EBKfoB0V9M4WK65sGorNgNrtuKrlwJLJe9tpToJ9dH1cnLOqTXYB6sktoL3Ge +RmVf1azonMvc4rd/zgEfPvpzkjyPeO2Xz2lJQxyPb1uHzKlb6l/WT/ZZWqftewqr +os2kCBS1Sw28MJXbHmAC+kLT6nNrcHQ4RjntUb+MAHaWujyq73OHZJItEHBPp/Vd +3U9No4XxaJJ5tRCgKHSdHzglxKoZUDSLqBuonT3VSjCpMD2tFsOf2lPJBsfsTQbX +dtyY+OsI6wrixnLUI+NodBxb6clTAHuq83FSb6qVxUuYSJOFZCx1eU7fxnWWrZrb +3GP8LX0QDtiq6X/yeu8lG2KYRcL3697wt5C9Hlek9cwdi8O8a9+pz/dpB9Wy8sLn +tQds98BO73gADqVNaE/3VbxNd1kKUEzoHd2LolLbvpD9sTDcJ9J9RO3BhooL1RIL +ofLtU/UBinjfceh2Nfd6weneKrgEskSc6NEcWU6ThW+E23p4hws= +=l7Hh +-END PGP SIGNATURE- Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.sha512 == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.sha512 (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt.sha512 Fri Jul 22 02:06:17 2022 @@ -0,0 +1 @@ +SHA512 (hadoop-3.2.4-rat.txt) = 56bb54f66ca1d9fd4b7866d45aa63f062492b963f6233a9025f4d7d49a0fd644221a1ea73077ad44d84726027be247c181931c2a7c611dd6f1acf90fd464b885 Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz == Binary file - no diff available. Propchange: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz -- svn:mime-type = application/octet-stream Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.asc == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.asc (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.asc Fri Jul 22 02:06:17 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEECgj3B1tT0NiL5XpvNiQ+7OIGuw0FAmLNcOQACgkQNiQ+7OIG +uw0baRAAg1QzY8V+xGNCdrWr1oSb3JdOAw0rlhwjbRm1DJsCDyR2hz8/E5beuiDg +Rlpz/DinTsWwbyF/Z6yMeDXW2lt2dC+cg4hneFXXp+BywPS7uBemN6Gr9KSCjvZj +9x43Sq+oSmUOxC87f6Y9FVB8jHLPNpywZIkQgH2pfY40VMeoFW5BvtbKhwoFuHd0 +YjJdwYk55EsrIBBqSAJbLYtzxVvtJDiZksZeTyBd69jhk8mw0SRGdrIwY0D0oxeR +EpSQ9seew5f2T+U/IBDPFAHmt57EORfq2KDBJPqXZt1shAQCFQgSDiD0teXfkUOm +BDmrH8E97oTJoeREXiQP1kkOiKoeyvy2v3EGDJXdKRweWx8DSybDQabaStthWw6f +wUTYkaye8ESpjJnbfS2BkfOD+e/ck84oC6zQxLESF0bkF3HB9rNZ7kPXfuliedxe +ulc/uiebBemcp3wxTyCD+85+KmZBDQ1pKHHgrOxjv+FNnEDpDQKCX5W8c/F+DD+q +t6NXc+ijbddMpoJlMorVQzwjfEVIK5gD78e9Uq5uNNggpJPse1H1oWIVIJhDsO8/ ++rLcDax9sBDDzPf3SVJJ04XEiuBs7tABNkxu3GgbKlP2OYadv5LX4Hw6DktoIjjA +X7TQS3JyeZvhc4H1fi1SQ6nU2m1iy/bzcqjSJIN/ijp2KQfmwGk= +=oiMn +-END PGP SIGNATURE- Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.sha512 == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.sha512 (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-site.tar.gz.sha512 Fri Jul 22 02:06:17 2022 @@ -0,0 +1 @@ +SHA512 (hadoop-3.2.4-site.tar.gz) = 0cd865d380521e860ea0f45f3a663af8bca1edb14ac7ffb44f52f2410002e254fb57c039ccc55d7fff837490d95fc116c1f35464c635705ec33c3117d67f5749 Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz == Binary file - no diff available. Propchange: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz -- svn:mime-type = application/octet-stream Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz.asc == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz.asc (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-src.tar.gz.asc Fri Jul 22 02:06:17 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEECgj3B1tT0NiL5XpvNiQ+7OIGuw0FAmLNcOUACgkQNiQ+7OIG +uw1f+Q/9GWX21/huYE8swSXPLsBkUBEQMnzXs905QfoUHS2fMIOH9SL4UEyok8By +c3W4bE3mzlaG+FTpXClIUMXK0JeNd2rhIoUb8xP7+igMnhGM8KhwZw5HtdTVEYLs +D2g52GNIaRNkV92fTt2iQCQqrZpZnF7vSrwZXe+3KmQvqOuRp59M1HTaV2OEj0D1 +qpmAutvmpsb+eOa+EKWZvua2xONlsPFIhGFlgqFeIxbftjsTQj2w9FZtX3bT5nWb +S6uC3fmw9WOdD+vysM+d413EWeDvbZCMm6HBjaj3tmERo3V+NOCZ9CVESutJjRX6 +y4dXqnyFA1C6zFvpzmH/Sf4eQIEdtsxU2gdR06qq7EdyNSSzNhpl1b+LiI8FdW7b +YhNa11HEUtsSUryJEayeZB/qCIMHXSnp8mhiRBl+h4p5m7wXhBKSsiA97+fT0ypf +fHUxP00hN/gYx+umc7VfrBLtplHVcsjaZMb2ivkI6jeDMfw4VV1kQzPl2Ok7HUeQ +O8HSZsEg5DUs/ewAky8gBc6TFvng71ft5FPW0m0Pkvm14SfVPcI+wQhgXdb5OSku +G/2Nxnx9fRGERLDm7hfqq4STiwsSEueJWw8s0EKXsezpkbxqs5n8nnGQHqipSb4
svn commit: r55895 [2/3] - /dev/hadoop/hadoop-3.2.4/
Added: dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt == --- dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt (added) +++ dev/hadoop/hadoop-3.2.4/hadoop-3.2.4-rat.txt Fri Jul 22 02:06:17 2022 @@ -0,0 +1,15167 @@ + +* +Summary +--- +Generated at: 2022-07-12T11:50:36+00:00 + +Notes: 0 +Binaries: 0 +Archives: 0 +Standards: 1 + +Apache Licensed: 1 +Generated Documents: 0 + +JavaDocs are generated, thus a license header is optional. +Generated files do not require license headers. + +0 Unknown Licenses + +* + Files with Apache License headers will be marked AL + Binary files (which do not require any license headers) will be marked B + Compressed archives will be marked A + Notices, licenses etc. will be marked N + AL/build/source/hadoop-minicluster/pom.xml + +* + +* +Summary +--- +Generated at: 2022-07-12T11:50:35+00:00 + +Notes: 1 +Binaries: 0 +Archives: 0 +Standards: 126 + +Apache Licensed: 126 +Generated Documents: 0 + +JavaDocs are generated, thus a license header is optional. +Generated files do not require license headers. + +0 Unknown Licenses + +* + Files with Apache License headers will be marked AL + Binary files (which do not require any license headers) will be marked B + Compressed archives will be marked A + Notices, licenses etc. will be marked N + N /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/README.txt + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/dev-support/findbugsExcludeFile.xml + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestHTestCase.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestDirHelper.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestHdfs.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/SysPropsForTestsLoader.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestDir.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HTestCase.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestJetty.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestHFSTestCase.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HFSTestCase.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestHdfsHelper.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestException.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestExceptionHelper.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/TestJettyHelper.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/KerberosTestUtils.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFWithWebhdfsFileSystem.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFWithSWebhdfsFileSystem.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSWithHttpFSFileSystem.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystemLocalFileSystem.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServerNoACLs.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServerNoXAttrs.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServerWebServer.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/HttpFSKerberosAuthenticationHandlerForTesting.java + AL /build/source/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/h
[hadoop] branch trunk updated: HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. (#4375)
This is an automated email from the ASF dual-hosted git repository.
inigoiri pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 2f6916a3139 HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf
moudle. (#4375)
2f6916a3139 is described below
commit 2f6916a3139d648a2551eb666fce44fb002da02b
Author: slfan1989 <55643692+slfan1...@users.noreply.github.com>
AuthorDate: Fri Jul 22 09:42:55 2022 +0800
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. (#4375)
---
.../server/federation/router/PeriodicService.java | 25 +++
.../federation/router/RouterHeartbeatService.java | 7 +-
.../server/federation/router/RouterRpcServer.java | 2 +-
.../server/federation/FederationTestUtils.java | 84 +-
.../server/federation/MiniRouterDFSCluster.java| 16 ++---
.../hdfs/server/federation/MockNamenode.java | 15 ++--
.../TestRouterRefreshFairnessPolicyController.java | 10 ++-
.../resolver/order/TestLocalResolver.java | 9 +--
.../federation/router/TestConnectionManager.java | 2 +-
.../router/TestRouterClientRejectOverload.java | 50 ++---
.../federation/router/TestRouterFaultTolerant.java | 2 +-
.../server/federation/router/TestRouterQuota.java | 26 +++
.../router/TestRouterRPCClientRetries.java | 9 +--
13 files changed, 100 insertions(+), 157 deletions(-)
diff --git
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/PeriodicService.java
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/PeriodicService.java
index b690b8685c0..0883ba3a3db 100644
---
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/PeriodicService.java
+++
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/PeriodicService.java
@@ -167,21 +167,18 @@ public abstract class PeriodicService extends
AbstractService {
stopPeriodic();
// Create the runnable service
-Runnable updateRunnable = new Runnable() {
- @Override
- public void run() {
-LOG.debug("Running {} update task", serviceName);
-try {
- if (!isRunning) {
-return;
- }
- periodicInvoke();
- runCount++;
- lastRun = Time.now();
-} catch (Exception ex) {
- errorCount++;
- LOG.warn(serviceName + " service threw an exception", ex);
+Runnable updateRunnable = () -> {
+ LOG.debug("Running {} update task", serviceName);
+ try {
+if (!isRunning) {
+ return;
}
+periodicInvoke();
+runCount++;
+lastRun = Time.now();
+ } catch (Exception ex) {
+errorCount++;
+LOG.warn("{} service threw an exception", serviceName, ex);
}
};
diff --git
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterHeartbeatService.java
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterHeartbeatService.java
index 1316cf71849..19d7442acb6 100644
---
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterHeartbeatService.java
+++
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterHeartbeatService.java
@@ -63,12 +63,7 @@ public class RouterHeartbeatService extends PeriodicService {
* Trigger the update of the Router state asynchronously.
*/
protected void updateStateAsync() {
-Thread thread = new Thread(new Runnable() {
- @Override
- public void run() {
-updateStateStore();
- }
-}, "Router Heartbeat Async");
+Thread thread = new Thread(this::updateStateStore, "Router Heartbeat
Async");
thread.setDaemon(true);
thread.start();
}
diff --git
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java
index 980d64a45d1..423e0ba8e48 100644
---
a/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java
+++
b/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java
@@ -405,7 +405,7 @@ public class RouterRpcServer extends AbstractService
implements ClientProtocol,
.asMap()
.keySet()
.parallelStream()
-.forEach((key) -> this.dnCache.refresh(key)),
+.forEach(this.dnCache::refresh),
0,
dnCacheExpire, TimeUnit.MILLISECONDS);
[hadoop] annotated tag rel/release-3.2.4 updated (7e5d9983b38 -> c15b8723830)
This is an automated email from the ASF dual-hosted git repository. iwasakims pushed a change to annotated tag rel/release-3.2.4 in repository https://gitbox.apache.org/repos/asf/hadoop.git *** WARNING: tag rel/release-3.2.4 was modified! *** from 7e5d9983b38 (commit) to c15b8723830 (tag) tagging 7e5d9983b388e372fe640f21f048f2f2ae6e9eba (commit) by Masatake Iwasaki on Fri Jul 22 01:35:28 2022 + - Log - Hadoop 3.2.4 release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEECgj3B1tT0NiL5XpvNiQ+7OIGuw0FAmLZ/uAACgkQNiQ+7OIG uw11Dw/7Bp6Bq4rxe9JW0C2K+6T19fq8195bn464GlXZKAbesfSbeq/8iqlFp9Ey +N1EjWMde6C/sBzsO3VK4gl9h5Q5wlBSevVxYo1h07ZuBBFwtvscSMYmNzSkhDLz 1/sx94JMskozUFCv7D65nffVbECE0aOCioiaQJyE1n1H2nSQUzLX0Aj8LjOLvKU/ 9LmtJcvyJZT8Zxw/S+R6ak0Yxl2CaZLgiE4j+SUwLpzYALBVRAshvJhKC5YW1m0B O4Z72pG9Qk63iL+ZKIj6lEOgntbNb0RjiBIsp8P95GfcCgtYITj48cr/h61zwbpj yliKCARwpsofmT3NHexfRPzdhZlV37synynWOPKYoxRn77A7cQKXk14UVIhJbwke osJjsECEakgCHDCRBBD8zVY5Vu7DgdYEv7agoo3Q15Ui5Zkn5YWdYU8rjMPklp1b FmSf5M/NMSLE44vRKJEzo0G4/woSLg+aiuFmvsajI8SlN52ANeARHR8oSncc0eWN GEfQht10ayvU31N6wn0RHH8hNomn+h/+Tb2joRBHHakwqK8RwALeS5zED2CUcmFZ hpMLdpQKrokF3q22tRY19LZAIAbeIWJn/f75OKDCTkhtLAcPW1Petkh88rSJwS1D rw3sCqDybD6qd6M3R7a2eictmk+QPptLCKahD0IZ55uvP3537C4= =AUXy -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch trunk updated (838020ce3b5 -> 08a940d5dd1)
This is an automated email from the ASF dual-hosted git repository. inigoiri pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git from 838020ce3b5 YARN-11160. Support getResourceProfiles, getResourceProfile API's for Federation (#4540) add 08a940d5dd1 HDFS-16640. RBF: Show datanode IP list when click DN histogram in Router (#4488) No new revisions were added by this update. Summary of changes: .../src/main/webapps/router/federationhealth.html | 1 + .../src/main/webapps/hdfs/dfshealth.html | 1 + .../hadoop-hdfs/src/main/webapps/hdfs/dfshealth.js | 42 .../src/main/webapps/static/histogram-hostip.js| 58 ++ 4 files changed, 60 insertions(+), 42 deletions(-) create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/static/histogram-hostip.js - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch trunk updated: YARN-11160. Support getResourceProfiles, getResourceProfile API's for Federation (#4540)
This is an automated email from the ASF dual-hosted git repository.
inigoiri pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 838020ce3b5 YARN-11160. Support getResourceProfiles,
getResourceProfile API's for Federation (#4540)
838020ce3b5 is described below
commit 838020ce3b56922c942823cd835cd91c9e480590
Author: slfan1989 <55643692+slfan1...@users.noreply.github.com>
AuthorDate: Fri Jul 22 02:57:24 2022 +0800
YARN-11160. Support getResourceProfiles, getResourceProfile API's for
Federation (#4540)
---
.../hadoop/yarn/util/resource/ResourceUtils.java | 17 +++---
.../hadoop/yarn/server/router/RouterMetrics.java | 65
.../clientrm/FederationClientInterceptor.java | 41 -
.../router/clientrm/RouterYarnClientUtils.java | 51
.../yarn/server/router/TestRouterMetrics.java | 65
.../clientrm/TestFederationClientInterceptor.java | 66 +++-
.../router/clientrm/TestRouterYarnClientUtils.java | 71 ++
.../test/resources/profiles/sample-profiles-1.json | 24
.../src/test/resources/yarn-site.xml | 8 +++
9 files changed, 397 insertions(+), 11 deletions(-)
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/util/resource/ResourceUtils.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/util/resource/ResourceUtils.java
index d4d14d3b3dd..1433c24e9e1 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/util/resource/ResourceUtils.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/util/resource/ResourceUtils.java
@@ -115,8 +115,7 @@ public class ResourceUtils {
* Supporting 'memory', 'memory-mb', 'vcores' also as invalid resource
* names, in addition to 'MEMORY' for historical reasons
*/
-String[] keys = { "memory", ResourceInformation.MEMORY_URI,
-ResourceInformation.VCORES_URI };
+String[] keys = {"memory", ResourceInformation.MEMORY_URI,
ResourceInformation.VCORES_URI};
for(String key : keys) {
if (resourceInformationMap.containsKey(key)) {
LOG.warn("Attempt to define resource '" + key + "', but it is not
allowed.");
@@ -234,7 +233,8 @@ public class ResourceUtils {
}
/**
- * Get maximum allocation from config, *THIS WILL NOT UPDATE INTERNAL DATA*
+ * Get maximum allocation from config, *THIS WILL NOT UPDATE INTERNAL DATA.
+ *
* @param conf config
* @return maximum allocation
*/
@@ -379,7 +379,7 @@ public class ResourceUtils {
/**
* Get the resource types to be supported by the system.
- * @return A map of the resource name to a ResouceInformation object
+ * @return A map of the resource name to a ResourceInformation object
* which contains details such as the unit.
*/
public static Map getResourceTypes() {
@@ -473,10 +473,10 @@ public class ResourceUtils {
LOG.debug("Found {}, adding to configuration", resourceFile);
conf.addResource(ris);
} catch (FileNotFoundException fe) {
- LOG.info("Unable to find '" + resourceFile + "'.");
+ LOG.info("Unable to find '{}'.", resourceFile);
} catch (IOException | YarnException ex) {
- LOG.error("Exception trying to read resource types configuration '"
- + resourceFile + "'.", ex);
+ LOG.error("Exception trying to read resource types configuration '{}'.",
+ resourceFile, ex);
throw new YarnRuntimeException(ex);
}
}
@@ -668,7 +668,7 @@ public class ResourceUtils {
/**
* Reinitialize all resource types from external source (in case of client,
* server will send the updated list and local resourceutils cache will be
- * updated as per server's list of resources)
+ * updated as per server's list of resources).
*
* @param resourceTypeInfo
* List of resource types
@@ -857,6 +857,7 @@ public class ResourceUtils {
units = "Gi";
} else if (units.isEmpty()) {
// do nothing;
+LOG.debug("units is empty.");
} else {
throw new IllegalArgumentException("Acceptable units are M/G or
empty");
}
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/RouterMetrics.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/RouterMetrics.java
index e6e20e2af8c..42a22600d2b 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/RouterMetrics.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-r
svn commit: r55890 - in /dev/hadoop: hadoop-3.3.4-0/ hadoop-3.3.4-RC0/
Author: stevel Date: Thu Jul 21 18:03:17 2022 New Revision: 55890 Log: stage 3.3.4 RC0 Added: dev/hadoop/hadoop-3.3.4-RC0/ - copied from r55889, dev/hadoop/hadoop-3.3.4-0/ Removed: dev/hadoop/hadoop-3.3.4-0/ - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] annotated tag release-3.3.4-RC0 created (now 254802049b1)
This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to annotated tag release-3.3.4-RC0 in repository https://gitbox.apache.org/repos/asf/hadoop.git at 254802049b1 (tag) tagging c679bc76d26e3356699ac648db86794df60ad505 (commit) replaces rel/release-3.3.3 by Steve Loughran on Thu Jul 21 19:00:24 2022 +0100 - Log - Release candidate 3.3.4-RC0 -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEOCN+5CUFAoUHfbV60iz4RtuxYqAFAmLZlDgACgkQ0iz4Rtux YqCgRQ//YeA+9XdRkVtnTv24A7m3d6cj7MOrsD/s2pzZsKv6+F84Zs8+SrHA+DqO UfLHdr1Pv0vULpj3r7dCVp4C6mUxQLflg5KN0wry/Y8CRY9Smb5ZKmeQQRiGYL65 Uq5/yOUdXi9IFk9HJ1WWdfFUu6ZrmlK+SXz9O90k/+Oy8R7DBKlaip1CuD+a5/S7 sqCPAm+81okKHPuZlBJiD7B1QFoAqcXx8JN0firJrR0RBn3fpoX1MNV6vSDXvW2S 4RHGcy7AGg6J3IGjbZPSM8t2HV8S7conEfpo5H0NOD+Mdf73GNQTCSGao6+DoVea Zr4k4SfPwCPe65Ud4B7pXDWJjEHtS41tF/uQvJF0vEA0m9WvziBNQY8kcE5Tn/kh CCN+RosA/oFySISRwPvkn0JVLNGlcqX5r1YrjPJd/yacfPe9UA9IeAQ8v/MPxoij XTuXWjmPFUTmRMzWNKghnLXPNIegT6qmZh1qSueWMt7juxzx2RsdMJmH9Y7+IhV2 BbIoAva8qQcH1oGE1ysgA0DnSVNgZuwo2X236HUrLAiG1peZcXPefDZki6n1V3SA LpNmq5Er+A9aZ1/XYzdPagEKqF6Xq7jUu1LAf6WSvIm5jSvMv674gaNjx+NQ0c3e c5jSl20mITrJlLtbz57k0vSf+oZycWg96wyTABmRrgv1iOsKEM4= =EFMO -END PGP SIGNATURE- --- No new revisions were added by this update. - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
svn commit: r55883 [3/3] - /dev/hadoop/hadoop-3.3.4-0/
Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.asc == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.asc (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.asc Thu Jul 21 13:45:28 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEOCN+5CUFAoUHfbV60iz4RtuxYqAFAmLXG24ACgkQ0iz4Rtux +YqA0gxAAjzHO8MJZCDPniCyRaQDl9wNjW6AQeuFgSdCKGxJ3QMFqfmsrJfcfoQGj +dWyVNdtUbMMIt/SChQkbopqoDODcZkodjFLZEJZeOc6sr56YfvfxOtwvrrtAJZjG +8Myum/jWh3RyxU9r+Y5vWpOO2MpPYDWofbDocQypQt5adPyy5vUU+nh5axc/aq04 +SF4yWzZ3Wc9dI6iTuR6d2ckePbMr1qsBKqjBGGsujrKdAa/z9VrcMKHA3kyDWivA +LYTdRGQYZjcQgEBTQdyECNFiqKT4cno/9vjTbINdjRiwTzoPf5mQWNUjmqTQ0GZY +uek4Ep8vt7gpKYyHKc2mKjMJttsTfe0FJfnxIJ+o/8SirbosOs/OSCv23hbiALHD +WY/C2jF1nVgXADvuadnGMi8ojzs+oVP/WGX+9JQr+pL19R7MS9U8QJNDSSN3jLhP +DmRvp01EExAhVAaDiaKoQtEvZ57OIDHUs40A1jSTOj6WRZnc/hLeTv/OBgmRxO/z +yrtylK/yP51Z2voiHJmXXlhmZrf+//lZBtjYbyM6gj5aHrOgo6aqGyfaaDJcdNlD +9H+kFzKj7U1LDFsCNQQru7vG9jqEyOFmBRLrKHjMKb04ot8CV4YU7fuKkKql2D2I +hI92FO9VVTPG/RwdXsSlDnd8IeNJUnxoOLXytsOvNI4PeFMc/7E= +=WVkh +-END PGP SIGNATURE- Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.sha512 == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.sha512 (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.sha512 Thu Jul 21 13:45:28 2022 @@ -0,0 +1 @@ +SHA512 (hadoop-3.3.4-rat.txt) = 7fc89cb02bfbd1a11822e5296724fef5d9c3a497fd1ecc1b943b014a072ff09340be72ba73aecf7999800a1f4975663cbf84b3870ff3f9ac1376f3b854d9d5e7 Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz == Binary file - no diff available. Propchange: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz -- svn:mime-type = application/octet-stream Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.asc == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.asc (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.asc Thu Jul 21 13:45:28 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEOCN+5CUFAoUHfbV60iz4RtuxYqAFAmLXG24ACgkQ0iz4Rtux +YqAMgQ//UAxYjpIKs4V20oR8dOrnBUVb+fXkKrao5T4XY7aAq/Fz1aMafjOfXhln +CiC2sKpPuktQWucMGvNIEq0ThBnYFaRuY5iyAfMP8aln51t2w6jOv/iCfMg5Bc84 +eSwJZrU6Wm2XTj88CERT8d/ZiojawwuQQnXrHUlhXbe9ktLJGVI5XM03AdtfCgk4 +v+oQvdZXKb8YV8jLLeJm2t/y9XFN/n2AmfkqpSrlNq0iEsnEUpp2n23wYmYSxyBj +YmOydDZoh4N3jF1xvJfm24lylS9Iu4V4mQgLfyrfcYCAHMiNr3KuODK9dqrn9Y0u +w+nQKdopbRztTZeNuigUHYVPg6RAc9+X8NKQjzsiMlL0L+gvxCCTScOtXY6TAOF6 +Wsp9V/1+LZnqjvEa1BOOIAnko+Tbt4TN4B71FXDOUcW2MxeH9urtbH+S2hJlSw9C +Xajgqsc8iDCR3ca1qySxAG/rb9x1imOEGH5qoK2c9aPvORzXxsujlLcAvccIP149 +atEV4bfc7eXCXzGK/JPQYB9LM6Cy9C7kZ7K05nJL5t1mRO0moKeJYssV5LBzGEEg +69hlvewd3PA0LujpaznDHdN97d4dxn2ZmiINqOXO2iPSA8mLEsf/jj3YLKEEwk0N +s/mr/NZlieWaGVp23mtCZ0R0cHp1CVodUMF4SC+JTjjC7kaRfk8= +=jx+D +-END PGP SIGNATURE- Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.sha512 == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.sha512 (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.sha512 Thu Jul 21 13:45:28 2022 @@ -0,0 +1 @@ +SHA512 (hadoop-3.3.4-site.tar.gz) = 2f41ca6f9604eb734821d4e6a7ff7b250cb26036b7a1ed01f1d9a2ba1290e798284c98af0f78a355138347750cf22acd8504d4355d3ce65dcfcb088dbcbb3b46 Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz == Binary file - no diff available. Propchange: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz -- svn:mime-type = application/octet-stream Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz.asc == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz.asc (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz.asc Thu Jul 21 13:45:28 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEOCN+5CUFAoUHfbV60iz4RtuxYqAFAmLXG28ACgkQ0iz4Rtux +YqCu8xAAqPYYgorHiKpdT7F2I4d+DSTP1fyDv1rpvtTmYN/4g8TdMYFaTz+KDFie +2b6+xNz+0NIbnutVMHJmfPXjsp3RG3/dq72kCULLV9PaRCqPLLETyYjy4pmeJcYX +33iM7OO00mnB2wtuOz6z989iTJLWrAUyADemAbBSCqlTbPMwQQL9yUEGnK2msE9v +eiGKWjX2Ml1S6cCBDMEMMVHAM/MMCJ7oi+EFhhYjREyghw+bL7h1u+A6rTOzU7Ah +Zn33DbYb5yJSFTz3cRwxGOpDpzQd3aKo1rkw+0AzbC0DTObzv09/ygFaE1TnPig7 +d7yWBmB25CxkRcnsaR/RsDvVwUzTeKyK5vhcZO8URWbl6uBYjqk9XvEYKTEEr0PX +0R7ZvMlIG3XcDOcyixYUd1neclXI7kyYGZWvJGO4enW1ZC6qPqU7y2sriNxJQACc +zc6P+0EUG8Gej6EhkU0ZOEOd5vd7l1DtnjPZCFPyZQLRKqm5IhPCwgexCgZRqa7a +iU9xjcBdArzfJxJYaYXcBbQl/sMwC0voE4bEVQK3Ij2/dgh0kMmw7A8OHSZcYMsR +aMBx7BZYHQZrOnFWIrJ0v2i
svn commit: r55883 [2/3] - /dev/hadoop/hadoop-3.3.4-0/
Added: dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt == --- dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt (added) +++ dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt Thu Jul 21 13:45:28 2022 @@ -0,0 +1,16657 @@ + +* +Summary +--- +Generated at: 2022-07-19T18:59:55+00:00 + +Notes: 0 +Binaries: 0 +Archives: 0 +Standards: 3 + +Apache Licensed: 3 +Generated Documents: 0 + +JavaDocs are generated, thus a license header is optional. +Generated files do not require license headers. + +0 Unknown Licenses + +* + Files with Apache License headers will be marked AL + Binary files (which do not require any license headers) will be marked B + Compressed archives will be marked A + Notices, licenses etc. will be marked N + AL/build/source/hadoop-tools/hadoop-kafka/pom.xml + AL /build/source/hadoop-tools/hadoop-kafka/src/main/java/org/apache/hadoop/metrics2/sink/KafkaSink.java + AL /build/source/hadoop-tools/hadoop-kafka/src/test/java/org/apache/hadoop/metrics2/impl/TestKafkaMetrics.java + +* + +* +Summary +--- +Generated at: 2022-07-19T18:59:55+00:00 + +Notes: 0 +Binaries: 0 +Archives: 0 +Standards: 94 + +Apache Licensed: 94 +Generated Documents: 0 + +JavaDocs are generated, thus a license header is optional. +Generated files do not require license headers. + +0 Unknown Licenses + +* + Files with Apache License headers will be marked AL + Binary files (which do not require any license headers) will be marked B + Compressed archives will be marked A + Notices, licenses etc. will be marked N + AL/build/source/hadoop-tools/hadoop-openstack/pom.xml + AL /build/source/hadoop-tools/hadoop-openstack/dev-support/findbugs-exclude.xml + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/ExceptionDiags.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/HttpBodyContent.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/RestClientBindings.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/SwiftProtocolConstants.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/CopyRequest.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/SwiftRestClient.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/HttpInputStreamWithRelease.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/DurationStats.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/HttpResponseUtils.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/SwiftTestUtils.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/DurationStatsTable.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/SwiftUtils.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/SwiftObjectPath.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/Duration.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/JSONUtil.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftInvalidResponseException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftBadRequestException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftUnsupportedFeatureException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftConnectionException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftConnectionClosedException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftThrottledRequestException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftJsonMarshallingException.java + AL /build/source/hadoop-tools/hadoop-openstack/src/m
svn commit: r55883 [1/3] - /dev/hadoop/hadoop-3.3.4-0/
Author: stevel Date: Thu Jul 21 13:45:28 2022 New Revision: 55883 Log: stage 3.3.4 RC0 Added: dev/hadoop/hadoop-3.3.4-0/ dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.asc dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.sha512 dev/hadoop/hadoop-3.3.4-0/RELEASENOTES.md dev/hadoop/hadoop-3.3.4-0/RELEASENOTES.md.asc dev/hadoop/hadoop-3.3.4-0/RELEASENOTES.md.sha512 dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.asc dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-rat.txt.sha512 dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz (with props) dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.asc dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-site.tar.gz.sha512 dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz (with props) dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz.asc dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4-src.tar.gz.sha512 dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4.tar.gz (with props) dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4.tar.gz.asc dev/hadoop/hadoop-3.3.4-0/hadoop-3.3.4.tar.gz.sha512 Added: dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md == --- dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md (added) +++ dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md Thu Jul 21 13:45:28 2022 @@ -0,0 +1,53 @@ + + +# Apache Hadoop Changelog + +## Release 3.3.4 - 2022-07-19 + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HADOOP-18044](https://issues.apache.org/jira/browse/HADOOP-18044) | Hadoop - Upgrade to JQuery 3.6.0 | Major | . | Yuan Luo | Yuan Luo | +| [YARN-11195](https://issues.apache.org/jira/browse/YARN-11195) | Document how to configure NUMA in YARN | Major | documentation | Prabhu Joseph | Samrat Deb | +| [HADOOP-18332](https://issues.apache.org/jira/browse/HADOOP-18332) | remove rs-api dependency by downgrading jackson to 2.12.7 | Major | build | PJ Fanning | PJ Fanning | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HADOOP-18085](https://issues.apache.org/jira/browse/HADOOP-18085) | S3 SDK Upgrade causes AccessPoint ARN endpoint mistranslation | Major | fs/s3, test | Bogdan Stolojan | Bogdan Stolojan | +| [YARN-11092](https://issues.apache.org/jira/browse/YARN-11092) | Upgrade jquery ui to 1.13.1 | Major | . | D M Murali Krishna Reddy | groot | +| [HDFS-16453](https://issues.apache.org/jira/browse/HDFS-16453) | Upgrade okhttp from 2.7.5 to 4.9.3 | Major | hdfs-client | Ivan Viaznikov | groot | +| [YARN-10974](https://issues.apache.org/jira/browse/YARN-10974) | CS UI: queue filter and openQueues param do not work as expected | Major | capacity scheduler | Chengbing Liu | Chengbing Liu | +| [HADOOP-18237](https://issues.apache.org/jira/browse/HADOOP-18237) | Upgrade Apache Xerces Java to 2.12.2 | Major | build | groot | groot | +| [HADOOP-18074](https://issues.apache.org/jira/browse/HADOOP-18074) | Partial/Incomplete groups list can be returned in LDAP groups lookup | Major | security | Philippe Lanoe | Larry McCay | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|: |: | :--- |: |: |: | +| [HADOOP-18068](https://issues.apache.org/jira/browse/HADOOP-18068) | upgrade AWS SDK to 1.12.132 | Major | build, fs/s3 | Steve Loughran | Steve Loughran | +| [HADOOP-18307](https://issues.apache.org/jira/browse/HADOOP-18307) | remove hadoop-cos as a dependency of hadoop-cloud-storage | Major | bulid, fs | Steve Loughran | Steve Loughran | + + Added: dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.asc == --- dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.asc (added) +++ dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.asc Thu Jul 21 13:45:28 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEEOCN+5CUFAoUHfbV60iz4RtuxYqAFAmLXG24ACgkQ0iz4Rtux +YqDcwQ//dVFhsBIRS1dijW1gS6VuSKDy+cNGbzF/RmZyQ8KBCWuSHlDS/2R2cImc +zDyKVxhtu6KcR04bfCXCfswKkNl4OZvnumIn8c48zyPPRIslHtPZpilxkngs9m9V +ZNJyQL27DhX0N70Fbwv8xznZNayN5Dv7jZu+yrA9H35Wy7mErejCYAOKQMqfYNkl +VCnCzN96q3Pqo16TIzgQYdBkwqOZEQeDB8mVKQnamjuwaxxHOx37JfcgnHcVwql8 +27b6SaizZS5bulSD47vLuzuGk6e5/IurF/QEQ+yzlPBMpS9ROS5Zv31nk8FXvaM5 +G79oEr8LD6HYjHBmuQMJ3dR8YxoRe4Ny9uP7nb9e3kdVjSD0/6aKn8nfCRM2sDlz +nKXlWOtZlGZ5ph49hyJzIQ6uvplHjkNwe9PfhJZBEnhrkfGu7Du5j9e+XDudbbpZ +rmXnljlMq1ptl5+ZJ34SYk33TjUyrtCE5umGvx+t4Vnr1OGYiS4MNW1/YUXsbjnQ +5QtiOCir0jRheXqurmxbFwcJeItYPs4g3StqJi4aEp4AnAHPC4O7fCTZ6qOOp5Uu +a1tPWxGUsIgUhg2/K5Hnjw5DU+GqUQqZVy2NuUtil8Tn9kwNS23lcALFnXQ2Ccca +/jTW2gGVZUIpEJfD6z2pDig9xN1hoMGCF6MLclUDRnMisYyCZGI= +=323D +-END PGP SIGNATURE- Added: dev/hadoop/hadoop-3.3.4-0/CHANGELOG.md.sha512 ==
[hadoop] branch trunk updated: YARN-11211. QueueMetrics leaks Configuration objects when validation API is called multiple times. Contributed by Andras Gyori
This is an automated email from the ASF dual-hosted git repository.
snemeth pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new f4b635c4dcb YARN-11211. QueueMetrics leaks Configuration objects when
validation API is called multiple times. Contributed by Andras Gyori
f4b635c4dcb is described below
commit f4b635c4dcb44fb180605d2c540b52eef7b8bde0
Author: Szilard Nemeth
AuthorDate: Thu Jul 21 14:20:34 2022 +0200
YARN-11211. QueueMetrics leaks Configuration objects when validation API is
called multiple times. Contributed by Andras Gyori
---
.../scheduler/PartitionQueueMetrics.java| 2 +-
.../server/resourcemanager/scheduler/QueueMetrics.java | 17 ++---
.../scheduler/capacity/CSQueueMetrics.java | 7 ++-
.../capacity/CapacitySchedulerConfigValidator.java | 3 +++
4 files changed, 24 insertions(+), 5 deletions(-)
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/PartitionQueueMetrics.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/PartitionQueueMetrics.java
index 02eaa7bd9b7..150abdf51d0 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/PartitionQueueMetrics.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/PartitionQueueMetrics.java
@@ -78,7 +78,7 @@ public class PartitionQueueMetrics extends QueueMetrics {
metrics = new PartitionQueueMetrics(this.metricsSystem, this.queueName,
null, false, this.conf, this.partition);
users.put(userName, metrics);
- metricsSystem.register(
+ registerMetrics(
pSourceName(partitionJMXStr).append(qSourceName(queueName))
.append(",user=").append(userName).toString(),
"Metrics for user '" + userName + "' in queue '" + queueName + "'",
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
index d41cbed0b10..0bfee4d3350 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/QueueMetrics.java
@@ -289,7 +289,7 @@ public class QueueMetrics implements MetricsSource {
metrics =
new QueueMetrics(metricsSystem, queueName, null, false, conf);
users.put(userName, metrics);
- metricsSystem.register(
+ registerMetrics(
sourceName(queueName).append(",user=").append(userName).toString(),
"Metrics for user '"+ userName +"' in queue '"+ queueName +"'",
metrics.tag(QUEUE_INFO, queueName).tag(USER_INFO, userName));
@@ -334,7 +334,7 @@ public class QueueMetrics implements MetricsSource {
QueueMetrics queueMetrics =
new PartitionQueueMetrics(metricsSystem, this.queueName, parentQueue,
this.enableUserMetrics, this.conf, partition);
- metricsSystem.register(
+ registerMetrics(
pSourceName(partitionJMXStr).append(qSourceName(this.queueName))
.toString(),
"Metrics for queue: " + this.queueName,
@@ -378,7 +378,7 @@ public class QueueMetrics implements MetricsSource {
// Register with the MetricsSystems
if (metricsSystem != null) {
-metricsSystem.register(pSourceName(partitionJMXStr).toString(),
+registerMetrics(pSourceName(partitionJMXStr).toString(),
"Metrics for partition: " + partitionJMXStr,
(PartitionQueueMetrics) metrics.tag(PARTITION_INFO,
partitionJMXStr));
@@ -1359,4 +1359,15 @@ public class QueueMetrics implements MetricsSource {
}
}
}
+
+ protected void registerMetrics(String sourceName, String desc, QueueMetrics
metrics) {
+MetricsSource source = metricsSystem.getSource(sourceName);
+// Unregister metrics if a source is already present
+if (source != null) {
+ LOG.info("Unregistering source " + sourceName);
+ metricsSystem.unregisterSource(sourceName);
+}
+
+metricsSystem.register(sourceName, desc, metrics);
+ }
[hadoop] branch trunk updated (d07256a96dd -> bac2219e3cb)
This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git from d07256a96dd HDFS-16667. Use malloc for buffer allocation in uriparser2 (#4576) add bac2219e3cb HADOOP-18330. S3AFileSystem removes Path when calling createS3Client (#4572) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/fs/s3a/S3AFileSystem.java| 1 + .../org/apache/hadoop/fs/s3a/S3ClientFactory.java | 27 ++ .../hadoop/fs/s3a/ITestS3AEndpointRegion.java | 1 + .../ITestSessionDelegationInFileystem.java | 1 + 4 files changed, 30 insertions(+) - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
