This is an automated email from the ASF dual-hosted git repository. zhangduo pushed a change to branch HDFS-13572 in repository https://gitbox.apache.org/repos/asf/hadoop.git.
discard edd741d HDFS-13643. Implement basic async rpc client add 041e7a7 HDFS-14598. Findbugs warning caused by HDFS-12487. Contributed by He Xiaoqiao. add 366f3de HADOOP-16390. escape javadoc in S3AUtils public methods add 48d7f00 HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma. add ab0b180 HDFS-12345 Add Dynamometer to hadoop-tools, a tool for scale testing the HDFS NameNode with real metadata and workloads. Contributed by Erik Krogen. add 049bb42 HDDS-1723. Create new OzoneManagerLock class. (#1006) add 4b50981 HDDS-1709. TestScmSafeNode is flaky. Contributed by Elek, Marton. add a79bdf7 HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. (#1014) add 062eb60 YARN-9477. Implement VE discovery using libudev. Contributed by Peter Bacsko. add 0a37ccf HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist (#1013) add 1ac967a YARN-6055. ContainersMonitorImpl need be adjusted when NM resource changed. Contributed by Inigo Goiri. add 4848280 HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. (#956) add be80334 YARN-9639. DecommissioningNodesWatcher cause memory leak. Contributed by Bilwa S T. add 041e0c0 HDFS-14036. RBF: Add hdfs-rbf-default.xml to HdfsConfiguration by default. Contributed by Takanobu Asanuma. add 4a21224 HDFS-14599. HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty. Contributed by He Xiaoqiao. add cbae241 YARN-9623. Auto adjust max queue length of app activities to make sure activities on all nodes can be covered. Contributed by Tao Yang. add 5e7caf1 YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023 add f09c31a Revert "YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023" add 9fd3c70 HDDS-1639. Restructure documentation pages for better understanding add f02b0e1 YARN-9581. Add support for get multiple RM webapp URLs. Contributed by Prabhu Joseph add 49c5e8a HDDS-1672. Improve locking in OzoneManager. (#1016) add 29465bf YARN-9560. Restructure DockerLinuxContainerRuntime to extend OCIContainerRuntime. Contributed by Eric Badger, Jim Brennan, Craig Condit add da56899 HDDS-1733. Fix Ozone documentation (#1031) add d203045 HDFS-14618. Incorrect synchronization of ArrayList field (ArrayList is thread-unsafe). Contributed by Paul Ward. add 1e727cf HDDS-1730. Implement File CreateDirectory Request to use Cache and Do… (#1026) add 9df6275 HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. (#846) add 1f75660 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) add b1dafc3 YARN-9661:Fix typo in LocalityMulticastAMRMProxyPolicy.java and AbstractConfigurableFederationPolicy.java (#1042) add f8d62a9 HDDS-1258. Fix error propagation for SCM protocol add db674a0 HDDS-1685. Recon: Add support for "start" query param to containers and containers/{id} endpoints. add d8bac50 HDFS-14610. HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. (#1015) add 2f4b37b HDDS-1667. Docker compose file may referring to incorrect docker image name. Contributed by Eric Yang. add 570eee3 YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. Contributed by hunshenshi. new f324188 HDFS-13643. Implement basic async rpc client This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (edd741d) \ N -- N -- N refs/heads/HDFS-13572 (f324188) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: dev-support/bin/dist-layout-stitching | 1 + .../assemblies/hadoop-dynamometer-blockgen.xml | 35 + .../assemblies/hadoop-dynamometer-infra.xml | 35 + .../assemblies/hadoop-dynamometer-workload.xml | 35 + .../resources/assemblies/hadoop-dynamometer.xml | 73 ++ .../src/main/resources/assemblies/hadoop-tools.xml | 24 +- hadoop-dist/pom.xml | 1 + .../apache/hadoop/hdds/scm/XceiverClientRatis.java | 72 +- .../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 7 +- .../hadoop/hdds/scm/exceptions/SCMException.java | 6 +- .../hadoop/hdds/scm/exceptions/package-info.java | 4 +- ...lockLocationProtocolClientSideTranslatorPB.java | 94 +- .../org/apache/hadoop/ozone/OzoneConfigKeys.java | 6 + .../java/org/apache/hadoop/ozone/OzoneConsts.java | 6 + .../org/apache/hadoop/ozone/lock/LockManager.java | 5 +- ...lockLocationProtocolServerSideTranslatorPB.java | 155 ++- .../java/org/apache/hadoop/utils/db/RDBTable.java | 6 +- .../java/org/apache/hadoop/utils/db/Table.java | 8 + .../org/apache/hadoop/utils/db/TypedTable.java | 5 + .../src/main/proto/ScmBlockLocationProtocol.proto | 36 +- .../common/src/main/resources/ozone-default.xml | 8 + .../exceptions/TestSCMExceptionResultCodes.java | 52 + .../org/apache/hadoop/ozone/audit/DummyAction.java | 1 - .../org/apache/hadoop/utils/db/TestRDBStore.java | 36 + .../server/ratis/ContainerStateMachine.java | 28 +- .../transport/server/ratis/XceiverServerRatis.java | 51 +- hadoop-hdds/docs/config.yaml | 26 +- hadoop-hdds/docs/content/Concepts.md | 108 -- hadoop-hdds/docs/content/Hdds.md | 65 -- hadoop-hdds/docs/content/OzoneManager.md | 77 -- .../docs/content/OzoneSecurityArchitecture.md | 110 -- hadoop-hdds/docs/content/RealCluster.md | 74 -- hadoop-hdds/docs/content/SetupSecureOzone.md | 98 -- hadoop-hdds/docs/content/_index.md | 28 +- hadoop-hdds/docs/content/beyond/Containers.md | 218 ++++ .../{Dozone.md => beyond/DockerCheatSheet.md} | 46 +- .../docs/content/{ => beyond}/RunningWithHDFS.md | 17 +- .../content/{CommandShell.md => beyond/Tools.md} | 62 +- .../docs/content/{genconf.md => beyond/_index.md} | 20 +- .../docs/content/concept/ContainerMetadata.png | Bin 0 -> 98493 bytes hadoop-hdds/docs/content/concept/Datanodes.md | 75 ++ .../docs/content/concept/FunctionalOzone.png | Bin 0 -> 55334 bytes hadoop-hdds/docs/content/concept/Hdds.md | 52 + hadoop-hdds/docs/content/concept/Overview.md | 81 ++ hadoop-hdds/docs/content/concept/OzoneBlock.png | Bin 0 -> 4650 bytes hadoop-hdds/docs/content/concept/OzoneManager.md | 87 ++ .../docs/content/{genconf.md => concept/_index.md} | 21 +- .../docs/content/concept/ozoneBlockDiagram.png | Bin 0 -> 45218 bytes .../docs/content/{ => interface}/JavaApi.md | 12 +- .../docs/content/{ => interface}/OzoneFS.md | 30 +- hadoop-hdds/docs/content/{ => interface}/S3.md | 9 +- .../content/{genconf.md => interface/_index.md} | 13 +- .../docs/content/{ => recipe}/Prometheus.md | 11 +- .../docs/content/{ => recipe}/SparkOzoneFSK8S.md | 12 +- .../docs/content/{genconf.md => recipe/_index.md} | 16 +- .../recipe}/prometheus-key-allocate.png | Bin .../docs/{static => content/recipe}/prometheus.png | Bin .../docs/content/security/SecuityWithRanger.md | 43 + hadoop-hdds/docs/content/security/SecureOzone.md | 177 +++ .../docs/content/security/SecuringDatanodes.md | 70 ++ hadoop-hdds/docs/content/security/SecuringS3.md | 61 ++ hadoop-hdds/docs/content/security/SecuringTDE.md | 66 ++ hadoop-hdds/docs/content/security/SecurityAcls.md | 85 ++ hadoop-hdds/docs/content/security/_index.md | 36 + .../docs/content/{ => shell}/BucketCommands.md | 6 +- hadoop-hdds/docs/content/shell/Format.md | 69 ++ .../docs/content/{ => shell}/KeyCommands.md | 11 +- .../docs/content/{ => shell}/VolumeCommands.md | 6 +- .../docs/content/{genconf.md => shell/_index.md} | 12 +- .../{BuildingSources.md => start/FromSource.md} | 27 +- hadoop-hdds/docs/content/start/Kubernetes.md | 52 + hadoop-hdds/docs/content/start/Minikube.md | 69 ++ .../docs/content/{Settings.md => start/OnPrem.md} | 73 +- .../docs/content/{ => start}/RunningViaDocker.md | 29 +- .../docs/content/start/StartFromDockerHub.md | 111 ++ hadoop-hdds/docs/content/start/_index.md | 88 ++ hadoop-hdds/docs/content/start/docker.png | Bin 0 -> 7002 bytes hadoop-hdds/docs/content/start/hadoop.png | Bin 0 -> 4923 bytes hadoop-hdds/docs/content/start/k8s.png | Bin 0 -> 6270 bytes hadoop-hdds/docs/content/start/minikube.png | Bin 0 -> 5764 bytes .../docs/content/{ => tools}/AuditParser.md | 4 +- hadoop-hdds/docs/content/{ => tools}/Freon.md | 4 +- .../docs/content/{genconf.md => tools/Genconf.md} | 4 +- hadoop-hdds/docs/content/{ => tools}/SCMCLI.md | 4 +- hadoop-hdds/docs/content/tools/TestTools.md | 228 ++++ .../docs/content/{genconf.md => tools/Tools.md} | 13 +- .../{ozone-logo.png => ozone-logo-small.png} | Bin hadoop-hdds/docs/static/ozone-usage.png | Bin 0 -> 108376 bytes .../themes/ozonedoc/layouts/_default/section.html | 60 ++ .../themes/ozonedoc/layouts/_default/single.html | 47 +- .../docs/themes/ozonedoc/layouts/index.html | 2 +- .../themes/ozonedoc/layouts/partials/header.html | 4 +- .../themes/ozonedoc/layouts/partials/sidebar.html | 13 +- .../ozonedoc/layouts/shortcodes/buttonlink.html} | 16 +- .../{_default/single.html => shortcodes/card.html} | 36 +- .../ozonedoc/layouts/shortcodes/jumbotron.html} | 19 +- .../ozonedoc/layouts/shortcodes/requirements.html} | 18 +- .../docs/themes/ozonedoc/static/css/ozonedoc.css | 17 + hadoop-hdds/pom.xml | 2 +- .../org/apache/hadoop/hdfs/HdfsConfiguration.java | 1 + .../federation/router/RouterClientProtocol.java | 2 +- .../fs/contract/router/RouterHDFSContract.java | 1 - .../contract/router/web/RouterWebHDFSContract.java | 1 - .../server/federation/MiniRouterDFSCluster.java | 11 +- .../server/blockmanagement/DatanodeDescriptor.java | 7 +- .../PendingReconstructionBlocks.java | 4 +- .../hadoop/hdfs/server/datanode/DiskBalancer.java | 31 +- .../hdfs/server/diskbalancer/TestDiskBalancer.java | 11 +- .../org/apache/hadoop/ozone/audit/OMAction.java | 1 - .../apache/hadoop/ozone/om/OMMetadataManager.java | 12 + .../apache/hadoop/ozone/om/OzoneManagerLock.java | 269 ----- .../hadoop/ozone/om/S3SecretManagerImpl.java | 9 +- .../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 17 +- .../hadoop/ozone/om/helpers/OmKeyLocationInfo.java | 25 + .../hadoop/ozone/om/lock/OzoneManagerLock.java | 378 +++++++ .../hadoop/ozone/om/lock/OzoneManagerLockUtil.java | 75 ++ .../apache/hadoop/ozone/om/lock}/package-info.java | 7 +- ...OzoneManagerProtocolClientSideTranslatorPB.java | 13 +- .../src/main/proto/OzoneManagerProtocol.proto | 7 + .../hadoop/ozone/om/lock/TestOzoneManagerLock.java | 348 ++++++ .../apache/hadoop/ozone/om/lock}/package-info.java | 12 +- hadoop-ozone/dist/pom.xml | 4 - .../src/test/compose/docker-compose.yaml | 8 +- .../hadoop/ozone/MiniOzoneHAClusterImpl.java | 2 +- .../apache/hadoop/ozone/om/TestOzoneManager.java | 63 ++ .../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 4 +- .../apache/hadoop/ozone/om/TestScmSafeMode.java | 18 +- .../apache/hadoop/ozone/om/BucketManagerImpl.java | 47 +- .../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 112 +- .../hadoop/ozone/om/OmMetadataManagerImpl.java | 71 +- .../org/apache/hadoop/ozone/om/OzoneManager.java | 98 +- .../apache/hadoop/ozone/om/PrefixManagerImpl.java | 21 +- .../apache/hadoop/ozone/om/S3BucketManager.java | 6 + .../hadoop/ozone/om/S3BucketManagerImpl.java | 21 +- .../java/org/apache/hadoop/ozone/om/ScmClient.java | 6 +- .../apache/hadoop/ozone/om/VolumeManagerImpl.java | 88 +- .../ozone/om/ratis/OzoneManagerDoubleBuffer.java | 7 + .../ozone/om/ratis/OzoneManagerRatisClient.java | 59 +- .../ozone/om/ratis/OzoneManagerRatisServer.java | 8 +- .../ozone/om/ratis/OzoneManagerStateMachine.java | 114 -- .../om/ratis/utils/OzoneManagerRatisUtils.java | 18 + .../hadoop/ozone/om/request/OMClientRequest.java | 2 +- .../hadoop/ozone/om/request/RequestAuditor.java | 37 +- .../om/request/bucket/OMBucketCreateRequest.java | 17 +- .../om/request/bucket/OMBucketDeleteRequest.java | 8 +- .../request/bucket/OMBucketSetPropertyRequest.java | 8 +- .../om/request/file/OMDirectoryCreateRequest.java | 282 +++++ .../ozone/om/request/file}/package-info.java | 14 +- .../om/request/key/OMAllocateBlockRequest.java | 248 +++++ .../ozone/om/request/key/OMKeyCommitRequest.java | 192 ++++ .../ozone/om/request/key/OMKeyCreateRequest.java | 378 +++++++ .../ozone/om/request/key/OMKeyDeleteRequest.java | 166 +++ .../ozone/om/request/key/OMKeyRenameRequest.java | 205 ++++ .../hadoop/ozone/om/request/key/OMKeyRequest.java | 205 ++++ .../hadoop/ozone/om/request/key}/package-info.java | 14 +- .../om/request/volume/OMVolumeCreateRequest.java | 18 +- .../om/request/volume/OMVolumeDeleteRequest.java | 44 +- .../om/request/volume/OMVolumeSetOwnerRequest.java | 29 +- .../om/request/volume/OMVolumeSetQuotaRequest.java | 6 +- .../response/file/OMDirectoryCreateResponse.java | 67 ++ .../ozone/om/response/file}/package-info.java | 14 +- .../om/response/key/OMAllocateBlockResponse.java | 59 + .../ozone/om/response/key/OMKeyCommitResponse.java | 66 ++ .../ozone/om/response/key/OMKeyCreateResponse.java | 61 ++ .../ozone/om/response/key/OMKeyDeleteResponse.java | 78 ++ .../ozone/om/response/key/OMKeyRenameResponse.java | 67 ++ .../ozone/om/response/key}/package-info.java | 14 +- .../OzoneManagerHARequestHandlerImpl.java | 6 + ...OzoneManagerProtocolServerSideTranslatorPB.java | 60 +- .../hadoop/ozone/om/TestOzoneManagerLock.java | 193 ---- .../om/ratis/TestOzoneManagerStateMachine.java | 292 ----- .../ozone/om/request/TestOMRequestUtils.java | 69 ++ .../request/bucket/TestOMBucketCreateRequest.java | 1 + .../request/file/TestOMDirectoryCreateRequest.java | 327 ++++++ .../ozone/om/request/file}/package-info.java | 14 +- .../om/request/key/TestOMAllocateBlockRequest.java | 241 +++++ .../om/request/key/TestOMKeyCommitRequest.java | 300 ++++++ .../om/request/key/TestOMKeyCreateRequest.java | 325 ++++++ .../om/request/key/TestOMKeyDeleteRequest.java | 166 +++ .../om/request/key/TestOMKeyRenameRequest.java | 225 ++++ .../ozone/om/request/key/TestOMKeyRequest.java | 151 +++ .../hadoop/ozone/om/request/key}/package-info.java | 14 +- .../file/TestOMDirectoryCreateResponse.java | 123 +++ .../ozone/om/response/file}/package-info.java | 14 +- .../response/key/TestOMAllocateBlockResponse.java | 93 ++ .../om/response/key/TestOMKeyCommitResponse.java | 108 ++ .../om/response/key/TestOMKeyCreateResponse.java | 92 ++ .../om/response/key/TestOMKeyDeleteResponse.java | 163 +++ .../om/response/key/TestOMKeyRenameResponse.java | 148 +++ .../ozone/om/response/key/TestOMKeyResponse.java | 75 ++ .../ozone/om/response/key}/package-info.java | 14 +- .../apache/hadoop/ozone/recon/ReconConstants.java | 4 + .../ozone/recon/api/ContainerKeyService.java | 34 +- .../recon/spi/ContainerDBServiceProvider.java | 23 +- .../spi/impl/ContainerDBServiceProviderImpl.java | 90 +- .../ozone/recon/api/TestContainerKeyService.java | 119 +- .../impl/TestContainerDBServiceProviderImpl.java | 108 ++ hadoop-ozone/pom.xml | 9 +- .../GenerateOzoneRequiredConfigurations.java | 16 +- .../TestGenerateOzoneRequiredConfigurations.java | 16 + hadoop-project/pom.xml | 8 +- hadoop-project/src/site/site.xml | 1 + .../java/org/apache/hadoop/fs/s3a/S3AUtils.java | 4 +- .../hadoop-dynamometer-blockgen/pom.xml | 131 +++ .../src/main/bash/generate-block-lists.sh | 38 + .../dynamometer/blockgenerator/BlockInfo.java | 136 +++ .../blockgenerator/GenerateBlockImagesDriver.java | 140 +++ .../GenerateDNBlockInfosReducer.java | 99 ++ .../dynamometer/blockgenerator/XMLParser.java | 154 +++ .../blockgenerator/XMLParserMapper.java | 81 ++ .../dynamometer/blockgenerator}/package-info.java | 13 +- .../dynamometer/blockgenerator/TestBlockGen.java | 89 ++ .../dynamometer/blockgenerator/TestXMLParser.java | 70 ++ .../test/resources/fsimage_0000000000000061740.xml | 553 ++++++++++ .../hadoop-dynamometer-dist/pom.xml | 128 +++ .../hadoop-dynamometer-infra/pom.xml | 201 ++++ .../src/main/bash/create-slim-hadoop-tar.sh | 53 + .../src/main/bash/parse-metrics.sh | 84 ++ .../src/main/bash/start-dynamometer-cluster.sh | 41 + .../src/main/bash/upload-fsimage.sh | 84 ++ .../apache/hadoop/tools/dynamometer/AMOptions.java | 316 ++++++ .../dynamometer/AllowAllImpersonationProvider.java | 24 +- .../tools/dynamometer/ApplicationMaster.java | 885 +++++++++++++++ .../BlockPlacementPolicyAlwaysSatisfied.java | 53 + .../apache/hadoop/tools/dynamometer/Client.java | 1132 ++++++++++++++++++++ .../hadoop/tools/dynamometer/DynoConstants.java | 130 +++ .../hadoop/tools/dynamometer/DynoInfraUtils.java | 584 ++++++++++ .../hadoop/tools/dynamometer/DynoResource.java | 72 ++ .../tools/dynamometer/SimulatedDataNodes.java | 182 ++++ .../hadoop/tools/dynamometer}/package-info.java | 16 +- .../src/main/resources/start-component.sh | 344 ++++++ .../tools/dynamometer/TestDynamometerInfra.java | 542 ++++++++++ .../tools/dynamometer/TestDynoInfraUtils.java | 66 ++ .../src/test/resources/blocks/dn0-a-0-r-00000 | 34 + .../src/test/resources/blocks/dn1-a-0-r-00001 | 33 + .../src/test/resources/blocks/dn2-a-0-r-00002 | 33 + .../test/resources/conf/etc/hadoop/core-site.xml | 20 + .../test/resources/conf/etc/hadoop/hdfs-site.xml | 20 + .../resources/conf/etc/hadoop/log4j.properties | 40 +- .../src/test/resources/hadoop_3_1/VERSION | 7 + .../hadoop_3_1/fsimage_0000000000000061740 | Bin 0 -> 13795 bytes .../hadoop_3_1/fsimage_0000000000000061740.md5 | 1 + .../src/test/resources/yarn-site.xml | 19 + .../hadoop-dynamometer-workload/pom.xml | 146 +++ .../src/main/bash/parse-start-timestamp.sh | 52 + .../src/main/bash/start-workload.sh | 42 + .../workloadgenerator/CreateFileMapper.java | 146 +++ .../workloadgenerator/VirtualInputFormat.java | 57 + .../workloadgenerator/VirtualInputSplit.java | 37 +- .../workloadgenerator/VirtualRecordReader.java | 78 ++ .../workloadgenerator/WorkloadDriver.java | 208 ++++ .../workloadgenerator/WorkloadMapper.java | 59 + .../audit/AuditCommandParser.java | 57 + .../audit/AuditLogDirectParser.java | 145 +++ .../audit/AuditLogHiveTableParser.java | 70 ++ .../audit/AuditReplayCommand.java | 163 +++ .../workloadgenerator/audit/AuditReplayMapper.java | 290 +++++ .../workloadgenerator/audit/AuditReplayThread.java | 310 ++++++ .../audit/NoSplitTextInputFormat.java | 47 + .../workloadgenerator/audit}/package-info.java | 14 +- .../workloadgenerator}/package-info.java | 15 +- .../workloadgenerator/TestWorkloadGenerator.java | 136 +++ .../audit/TestAuditLogDirectParser.java | 143 +++ .../src/test/resources/audit_trace_direct/audit0 | 6 + .../src/test/resources/audit_trace_hive/audit0 | 6 + hadoop-tools/{ => hadoop-dynamometer}/pom.xml | 33 +- hadoop-tools/pom.xml | 1 + .../hadoop-yarn/dev-support/findbugs-exclude.xml | 6 + .../apache/hadoop/yarn/conf/YarnConfiguration.java | 2 +- .../hadoop/yarn/webapp/util/WebAppUtils.java | 12 +- .../src/main/resources/yarn-default.xml | 2 +- .../hadoop-yarn/hadoop-yarn-csi/pom.xml | 2 - .../AbstractConfigurableFederationPolicy.java | 2 +- .../LocalityMulticastAMRMProxyPolicy.java | 6 +- .../hadoop-yarn-server-nodemanager/pom.xml | 4 + .../server/nodemanager/LinuxContainerExecutor.java | 5 +- .../server/nodemanager/NodeStatusUpdaterImpl.java | 5 + .../yarn/server/nodemanager/ResourceView.java | 8 + .../amrmproxy/FederationInterceptor.java | 5 + .../launcher/ContainerCleanup.java | 4 +- .../resources/gpu/GpuResourceHandlerImpl.java | 4 +- .../linux/runtime/DockerLinuxContainerRuntime.java | 351 +----- .../linux/runtime/OCIContainerRuntime.java | 374 +++++++ .../monitor/ContainersMonitor.java | 6 + .../monitor/ContainersMonitorImpl.java | 49 +- .../resourceplugin/com/nec/NECVEPlugin.java | 56 +- .../resourceplugin/com/nec/UdevUtil.java | 100 ++ .../resourceplugin/com/nec/VEDeviceDiscoverer.java | 143 +++ .../deviceframework/DeviceResourceHandlerImpl.java | 4 +- .../server/nodemanager/TestNodeStatusUpdater.java | 103 ++ .../amrmproxy/TestFederationInterceptor.java | 1 + .../linux/runtime/TestDockerContainerRuntime.java | 41 +- .../resourceplugin/com/nec/TestNECVEPlugin.java | 58 +- .../com/nec/TestVEDeviceDiscoverer.java | 283 +++++ .../DecommissioningNodesWatcher.java | 5 + .../resourcemanager/ResourceTrackerService.java | 1 + .../scheduler/activities/ActivitiesManager.java | 52 +- .../scheduler/capacity/CapacityScheduler.java | 8 + .../activities/TestActivitiesManager.java | 63 ++ 299 files changed, 19508 insertions(+), 2868 deletions(-) create mode 100644 hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-blockgen.xml create mode 100644 hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-infra.xml create mode 100644 hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer-workload.xml create mode 100644 hadoop-assemblies/src/main/resources/assemblies/hadoop-dynamometer.xml create mode 100644 hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/scm/exceptions/TestSCMExceptionResultCodes.java delete mode 100644 hadoop-hdds/docs/content/Concepts.md delete mode 100644 hadoop-hdds/docs/content/Hdds.md delete mode 100644 hadoop-hdds/docs/content/OzoneManager.md delete mode 100644 hadoop-hdds/docs/content/OzoneSecurityArchitecture.md delete mode 100644 hadoop-hdds/docs/content/RealCluster.md delete mode 100644 hadoop-hdds/docs/content/SetupSecureOzone.md create mode 100644 hadoop-hdds/docs/content/beyond/Containers.md rename hadoop-hdds/docs/content/{Dozone.md => beyond/DockerCheatSheet.md} (60%) rename hadoop-hdds/docs/content/{ => beyond}/RunningWithHDFS.md (83%) rename hadoop-hdds/docs/content/{CommandShell.md => beyond/Tools.md} (55%) copy hadoop-hdds/docs/content/{genconf.md => beyond/_index.md} (69%) create mode 100644 hadoop-hdds/docs/content/concept/ContainerMetadata.png create mode 100644 hadoop-hdds/docs/content/concept/Datanodes.md create mode 100644 hadoop-hdds/docs/content/concept/FunctionalOzone.png create mode 100644 hadoop-hdds/docs/content/concept/Hdds.md create mode 100644 hadoop-hdds/docs/content/concept/Overview.md create mode 100644 hadoop-hdds/docs/content/concept/OzoneBlock.png create mode 100644 hadoop-hdds/docs/content/concept/OzoneManager.md copy hadoop-hdds/docs/content/{genconf.md => concept/_index.md} (67%) create mode 100644 hadoop-hdds/docs/content/concept/ozoneBlockDiagram.png rename hadoop-hdds/docs/content/{ => interface}/JavaApi.md (95%) rename hadoop-hdds/docs/content/{ => interface}/OzoneFS.md (90%) rename hadoop-hdds/docs/content/{ => interface}/S3.md (95%) copy hadoop-hdds/docs/content/{genconf.md => interface/_index.md} (77%) rename hadoop-hdds/docs/content/{ => recipe}/Prometheus.md (91%) rename hadoop-hdds/docs/content/{ => recipe}/SparkOzoneFSK8S.md (98%) copy hadoop-hdds/docs/content/{genconf.md => recipe/_index.md} (76%) rename hadoop-hdds/docs/{static => content/recipe}/prometheus-key-allocate.png (100%) rename hadoop-hdds/docs/{static => content/recipe}/prometheus.png (100%) create mode 100644 hadoop-hdds/docs/content/security/SecuityWithRanger.md create mode 100644 hadoop-hdds/docs/content/security/SecureOzone.md create mode 100644 hadoop-hdds/docs/content/security/SecuringDatanodes.md create mode 100644 hadoop-hdds/docs/content/security/SecuringS3.md create mode 100644 hadoop-hdds/docs/content/security/SecuringTDE.md create mode 100644 hadoop-hdds/docs/content/security/SecurityAcls.md create mode 100644 hadoop-hdds/docs/content/security/_index.md rename hadoop-hdds/docs/content/{ => shell}/BucketCommands.md (98%) create mode 100644 hadoop-hdds/docs/content/shell/Format.md rename hadoop-hdds/docs/content/{ => shell}/KeyCommands.md (98%) rename hadoop-hdds/docs/content/{ => shell}/VolumeCommands.md (98%) copy hadoop-hdds/docs/content/{genconf.md => shell/_index.md} (77%) rename hadoop-hdds/docs/content/{BuildingSources.md => start/FromSource.md} (81%) create mode 100644 hadoop-hdds/docs/content/start/Kubernetes.md create mode 100644 hadoop-hdds/docs/content/start/Minikube.md rename hadoop-hdds/docs/content/{Settings.md => start/OnPrem.md} (73%) rename hadoop-hdds/docs/content/{ => start}/RunningViaDocker.md (76%) create mode 100644 hadoop-hdds/docs/content/start/StartFromDockerHub.md create mode 100644 hadoop-hdds/docs/content/start/_index.md create mode 100644 hadoop-hdds/docs/content/start/docker.png create mode 100644 hadoop-hdds/docs/content/start/hadoop.png create mode 100644 hadoop-hdds/docs/content/start/k8s.png create mode 100644 hadoop-hdds/docs/content/start/minikube.png rename hadoop-hdds/docs/content/{ => tools}/AuditParser.md (98%) rename hadoop-hdds/docs/content/{ => tools}/Freon.md (98%) copy hadoop-hdds/docs/content/{genconf.md => tools/Genconf.md} (96%) rename hadoop-hdds/docs/content/{ => tools}/SCMCLI.md (97%) create mode 100644 hadoop-hdds/docs/content/tools/TestTools.md copy hadoop-hdds/docs/content/{genconf.md => tools/Tools.md} (75%) rename hadoop-hdds/docs/static/{ozone-logo.png => ozone-logo-small.png} (100%) create mode 100644 hadoop-hdds/docs/static/ozone-usage.png create mode 100644 hadoop-hdds/docs/themes/ozonedoc/layouts/_default/section.html copy hadoop-hdds/docs/{content/genconf.md => themes/ozonedoc/layouts/shortcodes/buttonlink.html} (75%) copy hadoop-hdds/docs/themes/ozonedoc/layouts/{_default/single.html => shortcodes/card.html} (55%) copy hadoop-hdds/docs/{content/genconf.md => themes/ozonedoc/layouts/shortcodes/jumbotron.html} (75%) rename hadoop-hdds/docs/{content/genconf.md => themes/ozonedoc/layouts/shortcodes/requirements.html} (75%) delete mode 100644 hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/OzoneManagerLock.java create mode 100644 hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLock.java create mode 100644 hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock/OzoneManagerLockUtil.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/lock}/package-info.java (89%) create mode 100644 hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/lock/TestOzoneManagerLock.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/lock}/package-info.java (83%) create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMAllocateBlockRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCreateRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRenameRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/file/OMDirectoryCreateResponse.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/file}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMAllocateBlockResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyCommitResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyCreateResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyDeleteResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyRenameResponse.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key}/package-info.java (75%) delete mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerLock.java delete mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/ratis/TestOzoneManagerStateMachine.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMDirectoryCreateRequest.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMAllocateBlockRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyCommitRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyCreateRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyDeleteRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyRenameRequest.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key/TestOMKeyRequest.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/key}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/file/TestOMDirectoryCreateResponse.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/file}/package-info.java (75%) create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMAllocateBlockResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyCommitResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyCreateResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyDeleteResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyRenameResponse.java create mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key/TestOMKeyResponse.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/response/key}/package-info.java (75%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/pom.xml create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/bash/generate-block-lists.sh create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/BlockInfo.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/GenerateBlockImagesDriver.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/GenerateDNBlockInfosReducer.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/XMLParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator/XMLParserMapper.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/main/java/org/apache/hadoop/tools/dynamometer/blockgenerator}/package-info.java (72%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/java/org/apache/hadoop/tools/dynamometer/blockgenerator/TestBlockGen.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/java/org/apache/hadoop/tools/dynamometer/blockgenerator/TestXMLParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-blockgen/src/test/resources/fsimage_0000000000000061740.xml create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-dist/pom.xml create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/pom.xml create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/create-slim-hadoop-tar.sh create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/parse-metrics.sh create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/start-dynamometer-cluster.sh create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/bash/upload-fsimage.sh create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/AMOptions.java copy hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions/package-info.java => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/AllowAllImpersonationProvider.java (57%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/ApplicationMaster.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/BlockPlacementPolicyAlwaysSatisfied.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/Client.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoConstants.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoInfraUtils.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/DynoResource.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/SimulatedDataNodes.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer}/package-info.java (61%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/resources/start-component.sh create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/java/org/apache/hadoop/tools/dynamometer/TestDynamometerInfra.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/java/org/apache/hadoop/tools/dynamometer/TestDynoInfraUtils.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn0-a-0-r-00000 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn1-a-0-r-00001 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/blocks/dn2-a-0-r-00002 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/core-site.xml create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/hdfs-site.xml copy hadoop-hdds/docs/config.yaml => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/conf/etc/hadoop/log4j.properties (57%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/VERSION create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/fsimage_0000000000000061740 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/hadoop_3_1/fsimage_0000000000000061740.md5 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/test/resources/yarn-site.xml create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/pom.xml create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/bash/parse-start-timestamp.sh create mode 100755 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/bash/start-workload.sh create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/CreateFileMapper.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualInputFormat.java copy hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions/package-info.java => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualInputSplit.java (51%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/VirtualRecordReader.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/WorkloadDriver.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/WorkloadMapper.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditCommandParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditLogDirectParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditLogHiveTableParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayCommand.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayMapper.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/AuditReplayThread.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/NoSplitTextInputFormat.java copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit}/package-info.java (67%) copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/exceptions => hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/main/java/org/apache/hadoop/tools/dynamometer/workloadgenerator}/package-info.java (66%) create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/TestWorkloadGenerator.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/java/org/apache/hadoop/tools/dynamometer/workloadgenerator/audit/TestAuditLogDirectParser.java create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/resources/audit_trace_direct/audit0 create mode 100644 hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-workload/src/test/resources/audit_trace_hive/audit0 copy hadoop-tools/{ => hadoop-dynamometer}/pom.xml (60%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/OCIContainerRuntime.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/UdevUtil.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/VEDeviceDiscoverer.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/TestVEDeviceDiscoverer.java --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org