This is an automated email from the ASF dual-hosted git repository.
hexiaoqiao pushed a change to branch branch-3.2.2
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from df8b54b HADOOP-17329. mvn site commands fails due to
MetricsSystemImpl changes. Contributed by Xiaoqiao He.
new e52355d HDFS-15627. Log delete audits before collecting blocks.
new 148382e YARN-10450. Add cpu and memory utilization per node and
cluster-wide metrics. Contributed by Jim Brennan.
new b1b09b4 HADOOP-17309. Javadoc warnings and errors are ignored in the
precommit jobs. (#2391)
new 280bd08 HDFS-15639. [JDK 11] Fix Javadoc errors in
hadoop-hdfs-client. (#2394)
new f0b8980 HDFS-15618. Improve datanode shutdown latency. Contributed by
Ahmed Hussein.
new 188f0c3 HDFS-15622. Deleted blocks linger in the replications queue.
Contributed by Ahmed Hussein.
new 553e27e HADOOP-17306. RawLocalFileSystem's lastModifiedTime() looses
milli seconds in JDK < 10.b09 (#2387)
new 1851512 HDFS-15459. TestBlockTokenWithDFSStriped fails
intermittently. Contributed by Ahmed Hussein.
new 0fd4190 HDFS-15644. Failed volumes can cause DNs to stop block
reporting. Contributed by Ahmed Hussein.
new 2601856 HADOOP-17119. Jetty upgrade to 9.4.x causes MR app fail with
IOException. Contributed by Bilwa S T.
new e7d8e7f HDFS-15641. DataNode could meet deadlock if invoke
refreshNameNode. Contributed by Hongbing Wang.
new 8469c38 HDFS-15461. TestDFSClientRetries testGetFileChecksum fails
(#2404)
new 8f5e735 HDFS-9776. testMultipleAppendsDuringCatchupTailing is flaky
(#2410)
new f0deb04 YARN-10467. ContainerIdPBImpl objects can be leaked in
RMNodeImpl.completedContainers. Contributed by Haibo Chen
new fb5b610 HADOOP-17330. Backport HADOOP-16005 NativeAzureFileSystem
does not support setXAttr to branch-3.2. Contributed by Sally Zuo.
new 9033e13 YARN-10471. Prevent logs for any container from becoming
larger than a configurable size. Contributed by Eric Payne
new fe53f58 YARN-10472. Backport YARN-10314. YarnClient throws
NoClassDefFoundError for WebSocketException with only shaded client jars (#2412)
The 17 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hadoop-client-minicluster/pom.xml | 10 +-
.../hadoop-client-runtime/pom.xml | 9 +-
.../org/apache/hadoop/fs/AbstractFileSystem.java | 3 +-
.../main/java/org/apache/hadoop/fs/FileSystem.java | 3 +-
.../org/apache/hadoop/fs/RawLocalFileSystem.java | 11 +-
.../java/org/apache/hadoop/http/HttpServer2.java | 6 +-
.../hadoop/fs/TestRawLocalFileSystemContract.java | 25 +++
.../src/main/java/org/apache/hadoop/fs/Hdfs.java | 3 +-
.../apache/hadoop/hdfs/DistributedFileSystem.java | 3 +-
.../java/org/apache/hadoop/hdfs/DFSConfigKeys.java | 10 ++
.../blockmanagement/LowRedundancyBlocks.java | 30 +++-
.../hdfs/server/datanode/BPOfferService.java | 2 +
.../hdfs/server/datanode/BPServiceActor.java | 2 +-
.../hadoop/hdfs/server/datanode/BlockScanner.java | 33 +++-
.../hadoop/hdfs/server/datanode/DataNode.java | 4 +-
.../hadoop/hdfs/server/datanode/VolumeScanner.java | 3 +
.../datanode/VolumeScannerCBInjector.java} | 30 ++--
.../datanode/fsdataset/impl/FsDatasetImpl.java | 28 ++--
.../hadoop/hdfs/server/namenode/FSNamesystem.java | 2 +-
.../src/main/resources/hdfs-default.xml | 9 ++
.../org/apache/hadoop/hdfs/MiniDFSCluster.java | 28 +++-
.../apache/hadoop/hdfs/TestDFSClientRetries.java | 12 +-
.../TestBlockTokenWithDFSStriped.java | 2 +-
.../TestLowRedundancyBlockQueues.java | 47 +++++-
.../blockmanagement/TestReplicationPolicy.java | 17 +-
.../hdfs/server/datanode/TestBlockScanner.java | 142 +++++++++++++++++
.../hdfs/server/datanode/TestRefreshNamenodes.java | 34 ++++
.../hdfs/server/namenode/ha/TestHAAppend.java | 3 +-
hadoop-project/pom.xml | 1 +
.../fs/azure/AzureNativeFileSystemStore.java | 67 ++++++--
.../hadoop/fs/azure/NativeAzureFileSystem.java | 71 +++++++++
.../hadoop/fs/azure/NativeFileSystemStore.java | 4 +
.../hadoop/fs/azurebfs/AzureBlobFileSystem.java | 79 ++++++++++
.../fs/azurebfs/AzureBlobFileSystemStore.java | 22 ++-
.../fs/azure/NativeAzureFileSystemBaseTest.java | 62 ++++++++
.../ITestAzureBlobFileSystemAttributes.java | 104 +++++++++++++
.../yarn/api/records/ContainerExitStatus.java | 5 +
.../apache/hadoop/yarn/conf/YarnConfiguration.java | 19 +++
.../src/main/resources/yarn-default.xml | 28 ++++
.../monitor/ContainersMonitorImpl.java | 108 ++++++++++++-
.../monitor/TestContainersMonitor.java | 173 +++++++++++++++++++++
.../server/resourcemanager/ClusterMetrics.java | 27 ++++
.../rmapp/attempt/RMAppAttemptImpl.java | 28 +++-
.../server/resourcemanager/rmnode/RMNodeImpl.java | 42 ++++-
.../scheduler/SchedulerNodeReport.java | 11 ++
.../webapp/MetricsOverviewTable.java | 4 +
.../server/resourcemanager/webapp/NodesPage.java | 11 +-
.../webapp/dao/ClusterMetricsInfo.java | 26 ++++
.../resourcemanager/webapp/dao/NodeInfo.java | 36 +++++
.../rmapp/attempt/TestRMAppAttemptTransitions.java | 115 ++++++++++++++
.../resourcemanager/webapp/TestNodesPage.java | 4 +-
.../resourcemanager/webapp/TestRMWebServices.java | 2 +-
.../webapp/TestRMWebServicesNodes.java | 2 +-
.../src/site/markdown/NodeManager.md | 18 ++-
54 files changed, 1488 insertions(+), 92 deletions(-)
copy
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/{qjournal/server/JournalFaultInjector.java
=> server/datanode/VolumeScannerCBInjector.java} (59%)
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemAttributes.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
