This is an automated email from the ASF dual-hosted git repository.
szetszwo pushed a change to branch HDDS-4454
in repository https://gitbox.apache.org/repos/asf/ozone.git
discard c84da64fbc HDDS-6955. [Ozone-streaming] Add explicit stream flag in
ozone shell (#3559)
discard 04ebe89843 HDDS-6867. [Ozone-Streaming] PutKeyHandler should not use
streaming to put EC key. (#3516)
discard 4c064f42aa HDDS-6842. [Ozone-Streaming] Reduce the number of watch
requests in StreamCommitWatcher. (#3492)
discard f850883767 HDDS-6592. [Ozone-Streaming] Fix
ContainerStateMachine#applyTransaction assert error (#3315)
discard a2501c3de3 HDDS-5666. Add option to createKey via streaming api in
Freon (#2574)
discard 1dddbec252 HDDS-6500. [Ozone-Streaming] Buffer the PutBlockRequest at
the end of the stream. (#3229)
discard 0a432aa0eb HDDS-6137. [Ozone-Streaming] Refactor KeyDataStreamOutput.
(#3195)
discard 22e77a7b3d HDDS-5798. [Ozone-Streaming] Setup TlsConf parameters.
(#3207)
discard caa3b30a1e HDDS-6388. [Ozone-Streaming] Streaming write support both
pipeline model and star model (#3145)
discard c1bc998af6 HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)
discard de690f6c25 HDDS-6229. [Ozone-Streaming] Data Channel abstraction on
datanode (#3023)
discard 9d24f58704 HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE
(#3060)
discard 576c359114 HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support
FlushDelay. (#3002)
discard f59d30da45 HDDS-6298. Add XceiverServerRatis stream config (#3070)
discard 54361e5a4d HDDS-6138.[Ozone-Streaming] Define a limit on the size of
the retry bufferList. (#2946)
discard fdd7b64156 HDDS-6281. Update ratis version to 2.3.0-94db58b-SNAPSHOT
version (#3059)
discard 151ee53cd7 HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)
discard 6bd6cc7f2d HDDS-6139. [Ozone-Streaming] Fix incorrect computation of
totalAckDataLength. (#2978)
discard 1ecb774a39 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
discard 750c5f475a HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
discard 3b9141e18d HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
discard 4194bd6ce0 HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
discard 9a16e41e1f HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
discard 65ec5817e2 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
discard bb4eef2f7c HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
discard 311b366526 HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
discard ca7a926165 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
discard 508fda8744 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
discard 79507fe72f HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
discard 10b14300d2 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
discard b7b16c6977 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
discard 74c5f0f5fc HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
discard 6b51811d1f HDDS-5599. [Ozone-Streaming]drop BufferPool and
ChunkBuffer to avoid buffer copying (#2557)
discard 18db09d7d4 HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
discard 0a4bbf5c7b HDDS-5480. [Ozone-Streaming] Client and server should
support stream setup. (#2452)
discard 444b7b3840 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
discard 425bc95539 HDDS-5452. Add link method to ContainerStateMachine for
Ratis streaming (#2422)
discard b3495e8d39 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add 15fcb733c7 HDDS-7209. Bump Jersey2 to 2.34 (#3745)
add 64ec833e2b HDDS-7192. EC: ReplicationManager - create handlers to
perform various container checks (#3743)
add 9ad75b2300 HDDS-7114. CHAINED and STAND_ALONE replication-type should
be removed from help message (#3672)
add 286dffa8fa HDDS-7193. S3gateway Grpc Ranger Authorizer NPE Unhandled
Exception (#3749)
add 3130b03846 HDDS-7144. Recon: Make only hostname fixed in Datanodes
page. (#3736)
add 1dd5315704 HDDS-7225. Add Ratis tests for HealthCheck handlers of
Replication Manager (#3757)
add 1cf5678224 HDDS-7207. Fixed typo "layload" in om-echo command
description as payload (#3756)
add 1107fe711c HDDS-7221. EC: ReplicationManager - Encapsulate the under
and over rep queues into a queue object (#3758)
add 9d3bd02215 HDDS-7185. Encode asterisk for parsing signature (#3726)
add d9b92e7a33 HDDS-7203. LookupKey Latency breakdown (#3742)
add 1a6b4d2d6f HDDS-7239. EC: Add a Handler for CLOSING containers in
Replication Manager (#3769)
add 6c1a5ee07e HDDS-7240. List all volume operation should go through ACL
check as well in order to trigger audit logging (#3770)
add 04efea814a HDDS-7251. Replace Log4j 1.x with Reload4j (#3773)
add f6f89a021c HDDS-7075. Implement FileSystem listStatusIterator to
support file list paging (#3711)
add c7038e08a8 HDDS-7039. EC: Handle the placement policy check in
ECUnderReplicationHandler (#3645)
add a8df5c530b HDDS-7145. Recon: Show last OM DB sync time on Overview
page (#3765)
add 69695eabb7 HDDS-6492. Add metric for failed container moves (#3751)
add d22e42a2ac HDDS-7160. Recon: Make Container and Bucket stats clickable
in Overviews page (#3775)
add cb886035ac HDDS-7257. Bump snakeyaml to 1.32 (#3776)
add 55efab1b3e HDDS-6863. Add Group-Id & Ratis-Roles Information for OM UI
(#3520)
add 718f7309a8 HDDS-7222. Recon Inactive pipelines not shown. (#3753)
add efb3a80f73 HDDS-7232. Introduce container-level lock while handling
container report events by SCM and Recon (#3766)
add c96a342448 HDDS-7263. Add a handler for Quasi Closed containers to RM
(#3785)
add 1ff97328b7 HDDS-7206. Change the placement policy interface to allow
existing nodes to be specified for Rack Scatter Policy. (#3744)
add cdd0fb4ce1 HDDS-7229. Introduce container location cache in ScmClient
(#3771)
add 8dbbb4eb5f HDDS-7268. EC: Fix tests for HealthCheck handlers of RM
that use Replica Indexes for Ratis Containers (#3793)
add d029910e75 HDDS-7283. Set coreSize equal to maxSize for
threadPoolExecutor (#3792)
add 649d713817 HDDS-7235. EOFException occurs when executing TPC-DS using
o3fs (#3764)
add 3b6ae4f761 HDDS-7285. Fix concurrency issue in
DeleteBlocksCommandHandler (#3796)
add 23a0f743bc HDDS-7219. Remove not applicable info from ozone bucket
list for links (#3777)
add 1585f660c1 HDDS-7250. Add HttpServer metrics (#3772)
add 0aabe8abb6 HDDS-7282. Add EstimatedKeyCount metrics for SCM DB (#3791)
add 4e364001ac HDDS-7211. Remove dead code from KeyManagerImpl (#3747)
add 0edb2ecfe4 HDDS-7217. OM logs wrong bucket layout (#3750)
add 2737d3d065 HDDS-7208. Erasure coding and encryption are not flagged on
FileStatus (#3768)
add e0ea7df9e5 HDDS-7259. Fix uncounted blocksDeleted in
BlockDeletingService (#3779)
add 099422c5db HDDS-7293. Bump jackson2 to 2.13.4 (#3808)
add 625e84f95e HDDS-7286. Clean up ContainerManager (#3797)
add e7f4c05d09 HDDS-7294. Move ozone manager background services to a
separate package (#3805)
add 69d4dbd95a HDDS-7302. Fix inaccurate container block count caused by
missing block (#3814)
add 17753bc93c HDDS-7287. Send deleteBlocksRequest with correct retry
count (#3799)
add b808deb8c8 HDDS-6664. Implements getUri in TrashOzoneFileSystem (#3795)
add 32df39e8c8 HDDS-7299. Migrate simple tests in hdds-container-service
to JUnit5 (#3813)
add 834ef98018 HDDS-7230. Implement GetKeyInfo API (#3780)
add f0040c294b HDDS-7304. EC: EC Decode can fail when byteBuffer from
elastic pool is larger than chunksize (#3817)
add afb47176b7 HDDS-7271. Ozone Integration test shows memory leak
(graceful shutdown cleanup) (#3787)
add bb46766e23 Revert "HDDS-7271. Ozone Integration test shows memory leak
(graceful shutdown cleanup) (#3787)"
add 74deb5959a HDDS-7236. Enable Recon SCM DB bootstrap by default. (#3823)
add 0a5fc405e5 HDDS-6440. Handle custom metadata (x-amz-meta) during
put-object through S3 API. (#3728)
add e529ed4586 HDDS-7088. OM incorrectly detects SCM Ratis Group ID when
OM and SCM are colocated with same Ratis storage directory. (#3809)
add 54af0dacb0 HDDS-7313. Update github actions for Node16 (#3825)
add 15217fe59a HDDS-7271. Ozone Integration test shows memory leak
(graceful shutdown cleanup) (#3826)
add a905b4bbb6 HDDS-6946. Bump Hadoop to 3.3.4 (#3557)
add 2bfb6d9ec5 HDDS-7315 SCM order of close of dbstore and other services
(#3830)
add b18fb595e4 HDDS-7308 Removed cluster2 from serviceIds (#3819)
add 4515fe20c2 HDDS-7291. Fixing exception handling in case of non
positive replica index (#3806)
add 58f0749b52 HDDS-7270. Fix bug in checking healthy replica placement
policy check in EC underReplication handler (#3828)
add 6e2de99324 HDDS-7308. Fix config example syntax highlight in OM HA
(#3833)
add 330b2e308d HDDS-7322. Remove unused dependencies hsqldb and jettison
(#3834)
add 46e58a6350 HDDS-7300. Race condition between full data scan and block
deletion (#3811)
add 02341d77f3 HDDS-7269. Remove fair lock configuration for container
state management flows. (#3815)
add 35eedb6b36 HDDS-7303. EC: ECBlockReconstructedStripeInputStream should
set initialized only at the end of init() (#3816)
add c45b31a4f4 HDDS-7330. Cleanup of BucketManagerImpl (#3838)
add c0de6bcdeb HDDS-7261. Add container location cache metrics. (#3829)
add 554eb9eb54 HDDS-7337. Replace set-output in Github Actions workflow
(#3839)
add 9d05818a87 HDDS-7343. Do not log exception on file not found in
getFileStatus() (#3849)
add 2dc800dc80 HDDS-7214. Continuous start & stop can have hanging threads
in stopping (#3782)
add f7ba4ba588 HDDS-7340. Bump jackson-databind to 2.13.4.2 (#3845)
add 02c266d3fe HDDS-6893. EC: ReplicationManager - move the empty
container handling into RM from Legacy (#3831)
add 11f4686ce8 HDDS-7254. Document that moving SCM from non-HA to HA is
currently unsupported. (#3846)
add 03e670b865 HDDS-7149. Update ratis version to 2.4.0 and thirdparty
version to 1.0.2. (#3855)
add a6316c8320 HDDS-7352. OM log flooded by AWSV4AuthValidator (#3857)
add 237a9a1594 HDDS-7058. EC: ReplicationManager - Implement ratis
container replication check handler (#3802)
add 977ab59e11 HDDS-7341. EC: Close pipelines with unregistered nodes
(#3850)
add d5dc65eaa0 HDDS-7305. Fix Hadoop imports (#3822)
add d32e96c835 HDDS-7351. Use jackson-bom to ensure consistent Jackson
version (#3856)
add e45f9b8333 HDDS-7199. Implement new mix workload Read/Write Freon
command which meets specific test requirements (#3754)
add ff6d15f5df HDDS-7354. SchemaV3 blockData not deleted in table (#3860)
add 3fd7cd0896 Revert "HDDS-7199. Implement new mix workload Read/Write
Freon command which meets specific test requirements (#3754)"
add 1fa6d02e8a HDDS-6930. SCM,OM,RECON should not print ERROR and exit
with code 1 on successful shutdown (#3848)
add df48ca4fe3 HDDS-7356. Update SCM-HA.zh.md to match the English version
(#3861)
add 31560fcdfe HDDS-7355. non-primordial scm fail to get signed cert from
primordial SCM when converting an unsecure cluster to secure (#3859)
add f9b74a25cf HDDS-6210. EC: Add EC metrics (#3851)
add 5c2a39365a HDDS-7369. Fix wrong order of command arguments in
Nonrolling-Upgrade.md (#3866)
add 13a6d0178e HDDS-7141. Recon: Improve Disk Usage Page (#3789)
add ae59f8ae5f HDDS-7248. Recon: Expand the container status page to show
all unhealthy container states (#3837)
add ecdfc20756 HDDS-7199. Implement new mix workload Read/Write Freon
command (#3872)
add fdc57a93cb HDDS-7403. README Security Improvement (#3879)
add df0d1e81e3 HDDS-7368. [Multi-Tenant] Add Volume Existence check in
preExecute for OMTenantCreateRequest (#3869)
new e15e987a41 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
new 5626566ba7 HDDS-5452. Add link method to ContainerStateMachine for
Ratis streaming (#2422)
new 01beaf8f43 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
new 0568725ac9 HDDS-5480. [Ozone-Streaming] Client and server should
support stream setup. (#2452)
new 0952195d73 HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
new ae462a6747 HDDS-5599. [Ozone-Streaming]drop BufferPool and
ChunkBuffer to avoid buffer copying (#2557)
new 81b9f3d7c1 HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
new b2133a5bad HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
new 279168014c HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
new b1f06e8480 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
new 5b73b5148f HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
new 11fb9bf708 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
new 7cbb3fa89c HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
new 3cf08778de HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
new 8cbadbcaf6 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
new 8de50af361 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
new f3a245157a HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
new eb441a8e82 HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
new 7e61b1f642 HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
new ac981a7722 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
new 25c3495e58 HDDS-6139. [Ozone-Streaming] Fix incorrect computation of
totalAckDataLength. (#2978)
new 33c0260ab5 HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)
new b3ec54827f HDDS-6281. Update ratis version to 2.3.0-94db58b-SNAPSHOT
version (#3059)
new 693eea7ae6 HDDS-6138.[Ozone-Streaming] Define a limit on the size of
the retry bufferList. (#2946)
new 1a31d6beef HDDS-6298. Add XceiverServerRatis stream config (#3070)
new 434d1fc57d HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support
FlushDelay. (#3002)
new cca5e3b020 HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE
(#3060)
new 3dde9e27b9 HDDS-6229. [Ozone-Streaming] Data Channel abstraction on
datanode (#3023)
new b2ec47d5d3 HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)
new 8bbe943d23 HDDS-6388. [Ozone-Streaming] Streaming write support both
pipeline model and star model (#3145)
new 8e6be787c9 HDDS-5798. [Ozone-Streaming] Setup TlsConf parameters.
(#3207)
new 99b414df25 HDDS-6137. [Ozone-Streaming] Refactor KeyDataStreamOutput.
(#3195)
new f2d574ce3e HDDS-6500. [Ozone-Streaming] Buffer the PutBlockRequest at
the end of the stream. (#3229)
new 4a5b68370b HDDS-5666. Add option to createKey via streaming api in
Freon (#2574)
new 7805efb012 HDDS-6592. [Ozone-Streaming] Fix
ContainerStateMachine#applyTransaction assert error (#3315)
new a5980ce1a4 HDDS-6842. [Ozone-Streaming] Reduce the number of watch
requests in StreamCommitWatcher. (#3492)
new 29a8c157fd HDDS-6867. [Ozone-Streaming] PutKeyHandler should not use
streaming to put EC key. (#3516)
new 653a120236 HDDS-6955. [Ozone-streaming] Add explicit stream flag in
ozone shell (#3559)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c84da64fbc)
\
N -- N -- N refs/heads/HDDS-4454 (653a120236)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 38 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/close-pending.yaml | 2 +-
.github/workflows/comments.yaml | 2 +-
.github/workflows/post-commit.yml | 73 +-
README.md | 2 +-
dev-support/ci/lib/_initialization.sh | 4 +-
hadoop-hdds/client/pom.xml | 2 +-
.../hadoop/hdds/scm/XceiverClientMetrics.java | 10 +
.../hadoop/hdds/scm/storage/BlockInputStream.java | 2 +-
.../hadoop/hdds/scm/storage/ChunkInputStream.java | 2 +-
.../hadoop/ozone/client/io/ECBlockInputStream.java | 2 +-
.../ozone/client/io/ECBlockInputStreamProxy.java | 7 +
.../client/io/ECBlockReconstructedInputStream.java | 2 +-
.../io/ECBlockReconstructedStripeInputStream.java | 13 +-
.../hdds/scm/storage/TestChunkInputStream.java | 9 +-
.../ozone/client/io/TestECBlockInputStream.java | 3 +-
.../TestECBlockReconstructedStripeInputStream.java | 20 +
hadoop-hdds/common/pom.xml | 8 +-
.../hadoop/hdds/client/RatisReplicationConfig.java | 2 +-
.../hadoop/hdds/protocol/DatanodeDetails.java | 11 +
.../apache/hadoop/hdds/scm/PlacementPolicy.java | 18 +-
.../protocol/StorageContainerLocationProtocol.java | 2 +-
.../java/org/apache/hadoop/ozone/OzoneConsts.java | 3 +
.../java/org/apache/hadoop/util/CacheMetrics.java | 103 ++
.../org/apache/hadoop/util/CheckedRunnable.java | 25 +-
.../org/apache/hadoop/util/CheckedSupplier.java | 29 +
.../java/org/apache/hadoop/util/MetricUtil.java | 52 +
.../common/src/main/resources/ozone-default.xml | 27 +-
hadoop-hdds/container-service/pom.xml | 7 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 1 +
.../container/common/report/ReportPublisher.java | 6 +-
.../common/statemachine/DatanodeStateMachine.java | 8 +-
.../common/statemachine/EndpointStateMachine.java | 1 +
.../commandhandler/DeleteBlocksCommandHandler.java | 33 +-
.../DeleteContainerCommandHandler.java | 11 +-
.../ECReconstructionCoordinator.java | 15 +-
.../ec/reconstruction/ECReconstructionMetrics.java | 80 ++
.../container/keyvalue/KeyValueContainer.java | 4 +-
.../container/keyvalue/KeyValueContainerCheck.java | 108 +-
.../background/BlockDeletingService.java | 70 +-
.../protocol/commands/DeleteContainerCommand.java | 6 +
.../metadata/TestDatanodeCRLStoreImpl.java | 24 +-
.../hadoop/ozone/TestHddsDatanodeService.java | 16 +-
.../hadoop/ozone/TestHddsSecureDatanodeInit.java | 96 +-
.../container/common/TestBlockDeletingService.java | 137 ++-
.../common/TestContainerLayoutVersion.java | 4 +-
.../common/TestDatanodeLayOutVersion.java | 10 +-
.../container/common/TestDatanodeStateMachine.java | 52 +-
.../common/helpers/TestContainerUtils.java | 4 +-
.../container/common/report/TestReportManager.java | 2 +-
.../common/report/TestReportPublisher.java | 39 +-
.../statemachine/TestDatanodeConfiguration.java | 4 +-
.../common/statemachine/TestStateContext.java | 22 +-
.../states/datanode/TestRunningDatanodeState.java | 8 +-
.../states/endpoint/TestHeartbeatEndpointTask.java | 74 +-
.../volume/TestCapacityVolumeChoosingPolicy.java | 31 +-
.../volume/TestRoundRobinVolumeChoosingPolicy.java | 35 +-
.../TestECReconstructionSupervisor.java | 9 +-
.../keyvalue/TestKeyValueContainerCheck.java | 4 +-
.../TestKeyValueHandlerWithUnhealthyContainer.java | 15 +-
.../container/keyvalue/helpers/TestChunkUtils.java | 20 +-
.../keyvalue/impl/AbstractTestChunkManager.java | 20 +-
.../keyvalue/impl/CommonChunkManagerTestCases.java | 10 +-
.../keyvalue/impl/TestChunkManagerDummyImpl.java | 4 +-
.../keyvalue/impl/TestFilePerBlockStrategy.java | 6 +-
.../keyvalue/impl/TestFilePerChunkStrategy.java | 8 +-
.../TestContainerScannerConfiguration.java | 8 +-
.../ozoneimpl/TestContainerScannerMetrics.java | 21 +-
.../ReplicationSupervisorScheduling.java | 8 +-
.../replication/TestGrpcOutputStream.java | 16 +-
.../replication/TestMeasuredReplicator.java | 36 +-
.../replication/TestReplicationConfig.java | 4 +-
.../replication/TestSimpleContainerDownloader.java | 19 +-
.../stream/TestDirstreamClientHandler.java | 34 +-
.../container/stream/TestStreamingServer.java | 18 +-
.../TestReconstructionECContainersCommands.java | 27 +-
.../docs/content/feature/Nonrolling-Upgrade.md | 6 +-
hadoop-hdds/docs/content/feature/OM-HA.md | 4 +-
hadoop-hdds/docs/content/feature/OM-HA.zh.md | 4 +-
hadoop-hdds/docs/content/feature/SCM-HA.md | 7 +
hadoop-hdds/docs/content/feature/SCM-HA.zh.md | 73 +-
hadoop-hdds/framework/pom.xml | 24 +-
...inerLocationProtocolClientSideTranslatorPB.java | 2 +-
.../hadoop/hdds/server/http/HttpServer2.java | 3 +
.../hdds/server/http/HttpServer2Metrics.java | 94 ++
.../hdds/server/http/RatisDropwizardExports.java | 14 +
.../server/http/TestHttpServer2MetricsTest.java | 94 ++
hadoop-hdds/hadoop-dependency-client/pom.xml | 18 +-
hadoop-hdds/hadoop-dependency-server/pom.xml | 28 +
hadoop-hdds/server-scm/pom.xml | 10 +
.../hadoop/hdds/scm/SCMCommonPlacementPolicy.java | 51 +-
.../hadoop/hdds/scm/block/DeletedBlockLogImpl.java | 14 +-
.../hdds/scm/block/SCMBlockDeletingService.java | 2 +-
.../hdds/scm/container/ContainerManager.java | 14 +-
.../hdds/scm/container/ContainerManagerImpl.java | 27 +-
.../hdds/scm/container/ContainerReportHandler.java | 7 +-
.../scm/container/ContainerStateManagerImpl.java | 174 +--
.../IncrementalContainerReportHandler.java | 5 +-
.../scm/container/balancer/ContainerBalancer.java | 1159 ++------------------
.../balancer/ContainerBalancerMetrics.java | 29 +
...nerBalancer.java => ContainerBalancerTask.java} | 638 +++--------
.../algorithms/SCMContainerPlacementCapacity.java | 12 +-
.../algorithms/SCMContainerPlacementRackAware.java | 14 +-
.../SCMContainerPlacementRackScatter.java | 264 +++--
.../algorithms/SCMContainerPlacementRandom.java | 13 +-
.../replication/ContainerCheckRequest.java | 120 ++
.../replication/ContainerHealthCheck.java | 35 -
.../replication/ContainerHealthResult.java | 78 +-
.../replication/ECContainerHealthCheck.java | 86 --
.../replication/ECOverReplicationHandler.java | 22 +-
.../replication/ECUnderReplicationHandler.java | 136 ++-
.../replication/LegacyReplicationManager.java | 1 -
.../RatisContainerReplicaCount.java | 87 +-
.../container/replication/ReplicationManager.java | 221 ++--
.../container/replication/ReplicationQueue.java | 73 ++
.../replication/health/AbstractCheck.java | 71 ++
.../ClosedWithMismatchedReplicasHandler.java | 89 ++
.../health/ClosingContainerHandler.java | 62 ++
.../health/ECReplicationCheckHandler.java | 134 +++
.../replication/health/EmptyContainerHandler.java | 141 +++
.../container/replication/health/HealthCheck.java | 56 +
.../replication/health/OpenContainerHandler.java | 81 ++
.../health/QuasiClosedContainerHandler.java | 131 +++
.../health/RatisReplicationCheckHandler.java | 201 ++++
.../container/replication/health/package-info.java | 10 +-
.../container/report/ContainerReportValidator.java | 104 ++
.../hdds/scm/container/report/package-info.java | 8 +-
.../scm/container/states/ContainerAttribute.java | 14 +-
.../hadoop/hdds/scm/ha/BackgroundSCMService.java | 2 +-
.../apache/hadoop/hdds/scm/ha/SCMStateMachine.java | 7 +-
.../hdds/scm/metadata/SCMMetadataStoreImpl.java | 51 +-
.../hdds/scm/metadata/SCMMetadataStoreMetrics.java | 116 ++
.../hdds/scm/pipeline/PipelineManagerImpl.java | 42 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 10 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 2 +-
.../hdds/scm/server/StorageContainerManager.java | 31 +-
.../org/apache/hadoop/hdds/scm/HddsTestUtils.java | 76 +-
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 19 +-
.../scm/container/TestContainerManagerImpl.java | 12 +-
.../scm/container/TestContainerReportHandler.java | 59 +
.../TestIncrementalContainerReportHandler.java | 124 ++-
.../container/balancer/TestContainerBalancer.java | 953 ++--------------
...alancer.java => TestContainerBalancerTask.java} | 218 ++--
.../algorithms/TestContainerPlacementFactory.java | 4 +-
.../TestSCMContainerPlacementRackScatter.java | 76 +-
.../container/replication/ReplicationTestUtil.java | 89 +-
.../replication/TestECOverReplicationHandler.java | 5 +-
.../replication/TestECUnderReplicationHandler.java | 40 +-
.../TestRatisContainerReplicaCount.java | 58 +-
.../replication/TestReplicationManager.java | 102 +-
.../TestClosedWithMismatchedReplicasHandler.java | 217 ++++
.../health/TestClosingContainerHandler.java | 208 ++++
.../TestECReplicationCheckHandler.java} | 199 +++-
.../health/TestEmptyContainerHandler.java | 233 ++++
.../health/TestOpenContainerHandler.java | 168 +++
.../health/TestQuasiClosedContainerHandler.java | 238 ++++
.../health/TestRatisReplicationCheckHandler.java | 560 ++++++++++
.../container/replication/health/package-info.java | 11 +-
.../report/TestContainerReportValidator.java | 77 ++
.../hdds/scm/container/report/package-info.java | 15 +-
.../scm/metadata/TestSCMMetadataStoreImpl.java | 77 ++
.../hdds/scm/node/TestDatanodeAdminMonitor.java | 2 +-
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 41 +-
hadoop-hdds/test-utils/pom.xml | 4 +-
hadoop-hdds/tools/pom.xml | 6 +-
hadoop-ozone/client/pom.xml | 6 +-
.../org/apache/hadoop/ozone/client/OzoneKey.java | 32 +-
.../hadoop/ozone/client/OzoneKeyDetails.java | 11 +-
.../client/checksum/BaseFileChecksumHelper.java | 2 +-
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 9 +-
hadoop-ozone/common/pom.xml | 12 +-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 39 +
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 11 +
.../ozone/om/helpers/KeyInfoWithVolumeContext.java | 110 ++
.../apache/hadoop/ozone/om/helpers/OmKeyArgs.java | 55 +-
.../ozone/om/protocol/OzoneManagerProtocol.java | 13 +
...OzoneManagerProtocolClientSideTranslatorPB.java | 32 +-
hadoop-ozone/csi/pom.xml | 6 +-
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 5 +-
hadoop-ozone/dist/src/main/license/bin/NOTICE.txt | 2 +-
hadoop-ozone/dist/src/main/license/jar-report.txt | 6 +-
.../dist/src/main/smoketest/ec/basic.robot | 6 +-
.../src/main/smoketest/freon/read-write-key.robot | 53 +
.../dist/src/main/smoketest/s3/commonawslib.robot | 5 +
.../dist/src/main/smoketest/s3/objectputget.robot | 26 +
hadoop-ozone/integration-test/pom.xml | 94 +-
.../ozone/TestDirectoryDeletingServiceWithFSO.java | 4 +-
.../hadoop/fs/ozone/TestOzoneFSInputStream.java | 80 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 298 ++++-
.../hadoop/fs/ozone/TestRootedDDSWithFSO.java | 2 +-
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 218 ++++
.../TestContainerStateManagerIntegration.java | 2 +-
.../hdds/scm/storage/TestContainerCommandsEC.java | 17 +-
.../java/org/apache/hadoop/ozone/TestDataUtil.java | 10 +
.../ozone/TestStorageContainerManagerHelper.java | 1 -
.../apache/hadoop/ozone/client/rpc/TestBCSID.java | 1 -
.../rpc/TestCloseContainerHandlingByClient.java | 7 -
.../rpc/TestContainerStateMachineFailures.java | 1 -
.../client/rpc/TestFailureHandlingByClient.java | 5 -
.../rpc/TestFailureHandlingByClientFlushDelay.java | 1 -
.../rpc/TestMultiBlockWritesWithDnFailures.java | 2 -
.../client/rpc/TestOzoneAtRestEncryption.java | 1 -
.../client/rpc/TestOzoneRpcClientAbstract.java | 5 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 2 +-
.../hadoop/ozone/client/rpc/TestReadRetries.java | 2 +-
.../ozone/client/rpc/TestSecureOzoneRpcClient.java | 1 -
.../client/rpc/TestValidateBCSIDOnRestart.java | 2 +-
.../commandhandler/TestBlockDeletion.java | 8 +-
.../TestCloseContainerByPipeline.java | 6 +-
.../commandhandler/TestCloseContainerHandler.java | 1 -
.../commandhandler/TestDeleteContainerHandler.java | 1 -
.../ozone/dn/ratis/TestDnRatisLogParser.java | 1 -
.../hadoop/ozone/dn/scanner/TestDataScanner.java | 1 -
.../ozone/om/TestContainerReportWithKeys.java | 1 -
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 11 +-
.../org/apache/hadoop/ozone/om/TestKeyPurging.java | 1 +
.../hadoop/ozone/om/TestOMEpochForNonRatis.java | 2 +-
.../hadoop/ozone/om/TestOmBlockVersioning.java | 2 -
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 61 +-
.../ozone/om/TestOzoneManagerHAKeyDeletion.java | 1 +
.../ozone/om/multitenant/RangerUserRequest.java | 3 +-
.../TestRangerBGSyncService.java | 7 +-
.../hadoop/ozone/recon/TestReconAsPassiveScm.java | 4 +-
.../apache/hadoop/ozone/recon/TestReconTasks.java | 4 +-
.../ozone/scm/TestSCMInstallSnapshotWithHA.java | 5 +-
.../ozone/scm/TestStorageContainerManagerHA.java | 2 +-
.../TestSCMPipelineBytesWrittenMetrics.java | 2 +-
.../hadoop/ozone/shell/TestOzoneShellHA.java | 21 +-
.../hadoop/ozone/shell/TestOzoneTenantShell.java | 2 +-
.../src/test/resources/testSequenceFile | Bin 0 -> 96 bytes
.../src/main/proto/OmClientProtocol.proto | 16 +
.../apache/hadoop/ozone/om/BucketManagerImpl.java | 103 +-
.../org/apache/hadoop/ozone/om/KeyManager.java | 11 +
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 805 +++-----------
.../java/org/apache/hadoop/ozone/om/OMMXBean.java | 2 +
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 33 +
.../hadoop/ozone/om/OMMultiTenantManager.java | 2 +-
.../hadoop/ozone/om/OMMultiTenantManagerImpl.java | 2 +-
.../hadoop/ozone/om/OMPerformanceMetrics.java | 143 +++
.../org/apache/hadoop/ozone/om/OzoneManager.java | 144 ++-
.../hadoop/ozone/om/OzonePrefixPathImpl.java | 2 -
.../java/org/apache/hadoop/ozone/om/ScmClient.java | 89 +-
.../hadoop/ozone/om/TrashOzoneFileSystem.java | 4 +-
.../ozone/om/ratis/OzoneManagerRatisServer.java | 13 +
.../ozone/om/ratis/OzoneManagerStateMachine.java | 8 +-
.../om/request/bucket/OMBucketCreateRequest.java | 13 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 6 +
.../ozone/om/request/key/OMKeyCreateRequest.java | 3 +
.../request/s3/tenant/OMTenantCreateRequest.java | 11 +
.../om/{ => service}/DirectoryDeletingService.java | 3 +-
.../ozone/om/{ => service}/KeyDeletingService.java | 6 +-
.../OMRangerBGSyncService.java | 8 +-
.../om/{ => service}/OpenKeyCleanupService.java | 5 +-
.../hadoop/ozone/om/service/package-info.java} | 9 +-
.../protocolPB/OzoneManagerRequestHandler.java | 29 +-
.../hadoop/ozone/security/AWSV4AuthValidator.java | 4 +-
.../webapps/ozoneManager/om-overview.html | 20 +
.../resources/webapps/ozoneManager/ozoneManager.js | 30 +
.../org/apache/hadoop/ozone/om/OmTestManagers.java | 2 +-
.../apache/hadoop/ozone/om/TestKeyManagerUnit.java | 179 ++-
.../org/apache/hadoop/ozone/om/TestScmClient.java | 191 ++++
.../ozone/om/request/key/TestOMKeyRequest.java | 5 +-
.../om/{ => service}/TestKeyDeletingService.java | 6 +-
.../{ => service}/TestOpenKeyCleanupService.java | 6 +-
hadoop-ozone/ozonefs-common/pom.xml | 5 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 6 +-
.../hadoop/fs/ozone/BasicOzoneFileSystem.java | 169 ++-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 20 +-
.../fs/ozone/BasicRootedOzoneFileSystem.java | 128 ++-
.../apache/hadoop/fs/ozone/FileStatusAdapter.java | 17 +-
.../apache/hadoop/fs/ozone/OzoneClientUtils.java | 13 +-
hadoop-ozone/ozonefs-hadoop2/pom.xml | 6 +-
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 20 +-
hadoop-ozone/ozonefs-hadoop3/pom.xml | 6 +-
hadoop-ozone/ozonefs-shaded/pom.xml | 4 +
hadoop-ozone/ozonefs/pom.xml | 5 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 2 +-
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 1 +
.../ozone/recon/scm/ReconContainerManager.java | 27 +-
.../scm/ReconStorageContainerManagerFacade.java | 2 +-
.../webapps/recon/ozone-recon-web/api/db.json | 372 ++++++-
.../webapps/recon/ozone-recon-web/api/routes.json | 9 +-
.../components/autoReloadPanel/autoReloadPanel.tsx | 44 +-
.../src/components/navBar/navBar.tsx | 5 +
.../webapps/recon/ozone-recon-web/src/routes.tsx | 8 +
.../src/views/datanodes/datanodes.tsx | 29 +-
.../src/views/diskUsage/diskUsage.less | 36 +-
.../src/views/diskUsage/diskUsage.tsx | 68 +-
.../views/missingContainers/missingContainers.tsx | 227 ++--
.../src/views/overview/overview.tsx | 35 +-
.../src/views/pipelines/pipelines.less | 2 +-
.../src/views/pipelines/pipelines.tsx | 4 +-
.../ozone/recon/fsck/TestContainerHealthTask.java | 3 +-
hadoop-ozone/s3gateway/pom.xml | 42 -
.../hadoop/ozone/s3/endpoint/EndpointBase.java | 72 +-
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 21 +-
.../ozone/s3/signature/StringToSignProducer.java | 1 +
.../org/apache/hadoop/ozone/s3/util/S3Consts.java | 2 +
.../hadoop/ozone/s3/endpoint/TestEndpointBase.java | 106 ++
.../apache/hadoop/ozone/debug/ChunkKeyHandler.java | 1 -
.../java/org/apache/hadoop/ozone/freon/Freon.java | 2 +
.../ozone/freon/FreonReplicationOptions.java | 2 +-
.../hadoop/ozone/freon/KeyGeneratorUtil.java | 50 +
.../hadoop/ozone/freon/OmRPCLoadGenerator.java | 2 +-
.../ozone/freon/OzoneClientKeyReadWriteOps.java | 245 +++++
.../hadoop/ozone/freon/RangeKeysGenerator.java | 164 +++
.../hadoop/ozone/shell/ReplicationOptions.java | 18 +-
.../ozone/shell/ShellReplicationOptions.java | 3 +-
.../ozone/shell/bucket/InfoBucketHandler.java | 2 +-
.../ozone/shell/bucket/ListBucketHandler.java | 17 +-
pom.xml | 96 +-
310 files changed, 10711 insertions(+), 5212 deletions(-)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/util/CacheMetrics.java
copy
hadoop-ozone/ozonefs-hadoop2/src/main/java/org/apache/hadoop/fs/ozone/OzoneFileSystem.java
=>
hadoop-hdds/common/src/main/java/org/apache/hadoop/util/CheckedRunnable.java
(52%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/util/CheckedSupplier.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/util/MetricUtil.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/ec/reconstruction/ECReconstructionMetrics.java
create mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/http/HttpServer2Metrics.java
create mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/server/http/TestHttpServer2MetricsTest.java
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/{ContainerBalancer.java
=> ContainerBalancerTask.java} (66%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ContainerCheckRequest.java
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ContainerHealthCheck.java
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ECContainerHealthCheck.java
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/{ =>
replication}/RatisContainerReplicaCount.java (76%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ReplicationQueue.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/AbstractCheck.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/ClosedWithMismatchedReplicasHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/ClosingContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/ECReplicationCheckHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/EmptyContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/HealthCheck.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/OpenContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/QuasiClosedContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/RatisReplicationCheckHandler.java
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/pipelines/pipelines.less
=>
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/package-info.java
(86%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/report/ContainerReportValidator.java
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/pipelines/pipelines.less
=>
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/report/package-info.java
(93%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/metadata/SCMMetadataStoreMetrics.java
copy
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/balancer/{TestContainerBalancer.java
=> TestContainerBalancerTask.java} (87%)
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestClosedWithMismatchedReplicasHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestClosingContainerHandler.java
rename
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/{TestECContainerHealthCheck.java
=> health/TestECReplicationCheckHandler.java} (53%)
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestEmptyContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestOpenContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestQuasiClosedContainerHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/TestRatisReplicationCheckHandler.java
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/pipelines/pipelines.less
=>
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/package-info.java
(85%)
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/report/TestContainerReportValidator.java
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/pipelines/pipelines.less
=>
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/report/package-info.java
(77%)
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/metadata/TestSCMMetadataStoreImpl.java
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/KeyInfoWithVolumeContext.java
create mode 100644
hadoop-ozone/dist/src/main/smoketest/freon/read-write-key.robot
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{multitenant
=> service}/TestRangerBGSyncService.java (98%)
create mode 100644
hadoop-ozone/integration-test/src/test/resources/testSequenceFile
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OMPerformanceMetrics.java
rename hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{
=> service}/DirectoryDeletingService.java (99%)
rename hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{
=> service}/KeyDeletingService.java (98%)
rename
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{multitenant
=> service}/OMRangerBGSyncService.java (98%)
rename hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{
=> service}/OpenKeyCleanupService.java (97%)
copy
hadoop-ozone/{ozonefs-hadoop2/src/main/java/org/apache/hadoop/fs/ozone/OzoneFileSystem.java
=>
ozone-manager/src/main/java/org/apache/hadoop/ozone/om/service/package-info.java}
(82%)
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/TestScmClient.java
rename hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/{
=> service}/TestKeyDeletingService.java (98%)
rename hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/{
=> service}/TestOpenKeyCleanupService.java (97%)
create mode 100644
hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/s3/endpoint/TestEndpointBase.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/KeyGeneratorUtil.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/OzoneClientKeyReadWriteOps.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/RangeKeysGenerator.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
