This is an automated email from the ASF dual-hosted git repository.
rakeshr pushed a change to branch HDDS-2939
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit 49ab31f HDDS-4835. [FSO]S3Multipart: Implement UploadAbortRequest
(#1997)
omit b5d8756 HDDS-4490.[FSO]RenameAndDelete : make ofs#rename and
ofs#delete an atomic operation. (#1965)
omit bac2cf4 HDDS-4683. [FSO]ListKeys: do lookup in dir and file tables
(#1954)
omit a45e943 HDDS-4513.[FSO]OzoneContract unit test case fixes (#1945)
omit b671366 HDDS-4813. [FSO]S3Multipart: Implement UploadCompleteRequest
(#1923)
omit c2aa0fd HDDS-4742. Make trash work with FS Optimised Buckets. (#1915)
omit 7b9d98a HDDS-4781. [FSO]S3MultiPart: Implement create and commit
upload part file (#1897)
omit 8cfe3f6 HDDS-4805. [FSO]Fix findbugs issues after HDDS-2195 (#1906)
omit 7104517 HDDS-4771. [FSO]S3MultiPart: Implement
InitiateMultiPartUpload (#1877)
omit b988209 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
omit 922a1c8 HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
omit c4ae3ef HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
omit 99d928e HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
omit 54cffea HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
omit 3045ec6 HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
omit 6c4e86e HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
omit 08e10d2 HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
omit 82ebae0 HDDS-4358: Delete : make delete an atomic operation (#1607)
omit 32b9d10 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
omit 5f6f71d HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
omit dee30db HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
omit 6e01ff4 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
add b07162b HDDS-4864. Add acceptance tests to certify Ozone with boto3
python client. (#1976)
add f8f1b5f HDDS-4741. Modularize upgrade test (#1928)
add f1e72e8 HDDS-4885. ozone admin datanode list filter by UUID broken
(#1977)
add 7d065bf HDDS-4887. Useless message about node schema location (#1979)
add 0bdbadd HDDS-4873. Re-replication failure throws NPE (#1986)
add fb94573 HDDS-4910. ofs add PosixRootedOzoneFileSystem to support fuse
cp. (#1994)
add 70b22f7 HDDS-4898. ACL is not inherited on multiupload object (#1991)
add 0d45302 HDDS-4898. ACL is not inherited on multiupload object - fix
checkstyle
add 3859f9f HDDS-4440. [PROPOSAL] Use per-request authentication and
persistent connections between S3g and OM (#1562)
add ad7fe13 HDDS-4918. Fix spelling (#2003)
add 45eee3f HDDS-4919. Fix spelling (#2004)
new f613826 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
new 0d55285 HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
new a3a8510 HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
new df4cc53 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
new 5888a46 HDDS-4358: Delete : make delete an atomic operation (#1607)
new 1c62dfb HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
new 93cef78 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
new 4248adb HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
new 0edc68c HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
new 9015011 HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
new ba6eee0 HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
new fb5ef61 HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
new da0a501 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
new 331b85e HDDS-4771. [FSO]S3MultiPart: Implement
InitiateMultiPartUpload (#1877)
new c2d2879 HDDS-4805. [FSO]Fix findbugs issues after HDDS-2195 (#1906)
new 97849c4 HDDS-4781. [FSO]S3MultiPart: Implement create and commit
upload part file (#1897)
new bddb738 HDDS-4742. Make trash work with FS Optimised Buckets. (#1915)
new 52cc112 HDDS-4813. [FSO]S3Multipart: Implement UploadCompleteRequest
(#1923)
new 3e6bb38 HDDS-4513.[FSO]OzoneContract unit test case fixes (#1945)
new 008125439 HDDS-4683. [FSO]ListKeys: do lookup in dir and file tables
(#1954)
new 275641b HDDS-4490.[FSO]RenameAndDelete : make ofs#rename and
ofs#delete an atomic operation. (#1965)
new c4236b6 HDDS-4835. [FSO]S3Multipart: Implement UploadAbortRequest
(#1997)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (49ab31f)
\
N -- N -- N refs/heads/HDDS-2939 (c4236b6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 22 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hadoop/hdds/scm/storage/BlockInputStream.java | 2 +-
.../hadoop/hdds/scm/storage/ChunkInputStream.java | 2 +-
hadoop-hdds/common/src/main/conf/hadoop-policy.xml | 4 +-
.../java/org/apache/hadoop/hdds/HddsUtils.java | 2 +-
.../hadoop/hdds/conf/OzoneConfiguration.java | 2 +-
.../apache/hadoop/hdds/scm/XceiverClientSpi.java | 2 +-
.../hadoop/hdds/scm/net/NodeSchemaLoader.java | 8 +-
.../security/exception/SCMSecurityException.java | 2 +-
.../apache/hadoop/hdds/tracing/TracingUtil.java | 2 +-
.../ozone/common/OzoneChecksumException.java | 2 +-
.../common/src/main/resources/ozone-default.xml | 2 +-
.../hadoop/hdds/conf/SimpleConfiguration.java | 2 +-
.../hadoop/hdds/conf/ConfigurationExample.java | 2 +-
.../ozone/container/common/impl/ContainerData.java | 2 +-
.../common/statemachine/EndpointStateMachine.java | 2 +-
.../common/states/datanode/package-info.java | 2 +-
.../replication/DownloadAndImportReplicator.java | 35 +--
.../container/common/TestDatanodeStateMachine.java | 2 +-
hadoop-hdds/docs/content/design/decommissioning.md | 2 +-
.../content/design/ozone-enhancement-proposals.md | 4 +-
hadoop-hdds/docs/content/design/s3-performance.md | 236 ++++++++++++++++++
.../docs/content/design/volume-management.md | 6 +-
hadoop-hdds/docs/content/recipe/BotoClient.md | 189 +++++++++++++++
hadoop-hdds/docs/content/start/Kubernetes.md | 2 +-
.../docs/content/start/StartFromDockerHub.md | 2 +-
.../docs/static/design/s3-performance-new.png | Bin 0 -> 33688 bytes
.../docs/static/design/s3-performance-old.png | Bin 0 -> 34927 bytes
.../hadoop/hdds/conf/DatanodeRatisGrpcConfig.java | 2 +-
.../hadoop/hdds/server/http/BaseHttpServer.java | 2 +-
.../hadoop/hdds/server/http/HttpServer2.java | 2 +-
.../apache/hadoop/hdds/utils/db/TableIterator.java | 2 +-
hadoop-hdds/hadoop-dependency-client/README.md | 2 +-
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 6 +-
.../hdds/scm/container/SimpleMockNodeManager.java | 2 +-
.../hdds/scm/cli/ContainerOperationClient.java | 2 +-
.../hdds/scm/cli/datanode/ListInfoSubcommand.java | 2 +-
.../hadoop/ozone/om/lock/OzoneManagerLock.java | 2 +-
hadoop-ozone/dist/pom.xml | 2 +-
.../dist/src/main/compose/ozone-mr/test.sh | 2 +-
hadoop-ozone/dist/src/main/compose/restart/test.sh | 13 +-
hadoop-ozone/dist/src/main/compose/test-all.sh | 2 +-
hadoop-ozone/dist/src/main/compose/testlib.sh | 71 +++++-
.../{versions/ozone-0.5.0.sh => 0.5.0/test.sh} | 9 +-
.../{versions/ozone-1.0.0.sh => 1.0.0/test.sh} | 9 +-
hadoop-ozone/dist/src/main/compose/upgrade/test.sh | 72 ++----
.../dist/src/main/compose/upgrade/testlib.sh | 80 +++++++
.../test.sh => upgrade/upgrade_to_current.sh} | 51 ++--
.../test.sh => upgrade/upgrade_to_release.sh} | 53 ++---
.../src/main/compose/upgrade/versions/README.md | 15 --
.../{ozone-om-ha/startOM.sh => versions/0.5.0.sh} | 20 +-
.../{ozone-om-ha/startOM.sh => versions/1.0.0.sh} | 20 +-
.../{ozone-om-ha/startOM.sh => versions/1.1.0.sh} | 20 +-
.../dist/src/main/compose/versions/README.md | 23 ++
hadoop-ozone/dist/src/main/compose/xcompat/test.sh | 9 +-
.../dist/src/main/k8s/examples/test-all.sh | 2 +-
.../LICENSE-org.codehaus.woodstox-stax2-api.txt | 2 +-
.../src/main/smoketest/admincli/datanode.robot | 9 +
.../smoketest/s3/{bucketlist.robot => boto3.robot} | 13 +-
.../dist/src/main/smoketest/s3/boto_client.py | 264 +++++++++++++++++++++
.../dist/src/shell/upgrade/{1.0.0.sh => v1.sh} | 2 +-
.../upgrade/{1.0.0 => v1}/01-migrate-scm-db.sh | 0
.../apache/hadoop/ozone/MiniOzoneChaosCluster.java | 4 +-
.../hadoop/ozone/MiniOzoneLoadGenerator.java | 4 +-
.../hadoop/ozone/loadgenerators/LoadExecutors.java | 2 +-
.../ozone/insight/TestConfigurationSubCommand.java | 2 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 28 ++-
.../container/ozoneimpl/TestOzoneContainer.java | 2 +-
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 2 +-
.../src/main/proto/OmClientProtocol.proto | 2 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 2 +-
.../S3InitiateMultipartUploadRequest.java | 8 +-
.../S3MultipartUploadCompleteRequest.java | 2 +-
.../OzoneDelegationTokenSecretManager.java | 2 +-
...System.java => PosixRootedOzoneFileSystem.java} | 14 +-
.../ozone/recon/fsck/TestContainerHealthTask.java | 2 +-
.../hadoop/ozone/s3/OzoneClientProducer.java | 2 +-
.../apache/hadoop/ozone/s3/util/ContinueToken.java | 6 +-
.../FileSystem/failure_injector_fs.cc | 2 +-
.../Service/cpp/failure_injector_svc_server.cc | 6 +-
79 files changed, 1123 insertions(+), 274 deletions(-)
create mode 100644 hadoop-hdds/docs/content/design/s3-performance.md
create mode 100644 hadoop-hdds/docs/content/recipe/BotoClient.md
create mode 100644 hadoop-hdds/docs/static/design/s3-performance-new.png
create mode 100644 hadoop-hdds/docs/static/design/s3-performance-old.png
rename hadoop-ozone/dist/src/main/compose/upgrade/{versions/ozone-0.5.0.sh =>
0.5.0/test.sh} (79%)
mode change 100644 => 100755
rename hadoop-ozone/dist/src/main/compose/upgrade/{versions/ozone-1.0.0.sh =>
1.0.0/test.sh} (79%)
mode change 100644 => 100755
mode change 100644 => 100755 hadoop-ozone/dist/src/main/compose/upgrade/test.sh
create mode 100755 hadoop-ozone/dist/src/main/compose/upgrade/testlib.sh
copy hadoop-ozone/dist/src/main/compose/{ozone/test.sh =>
upgrade/upgrade_to_current.sh} (54%)
copy hadoop-ozone/dist/src/main/compose/{ozone/test.sh =>
upgrade/upgrade_to_release.sh} (53%)
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/versions/README.md
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha/startOM.sh =>
versions/0.5.0.sh} (75%)
mode change 100755 => 100644
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha/startOM.sh =>
versions/1.0.0.sh} (75%)
mode change 100755 => 100644
copy hadoop-ozone/dist/src/main/compose/{ozone-om-ha/startOM.sh =>
versions/1.1.0.sh} (75%)
mode change 100755 => 100644
create mode 100644 hadoop-ozone/dist/src/main/compose/versions/README.md
copy hadoop-ozone/dist/src/main/smoketest/s3/{bucketlist.robot => boto3.robot}
(77%)
create mode 100755 hadoop-ozone/dist/src/main/smoketest/s3/boto_client.py
rename hadoop-ozone/dist/src/shell/upgrade/{1.0.0.sh => v1.sh} (85%)
rename hadoop-ozone/dist/src/shell/upgrade/{1.0.0 => v1}/01-migrate-scm-db.sh
(100%)
copy
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/{PosixOzoneFileSystem.java
=> PosixRootedOzoneFileSystem.java} (80%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
