This is an automated email from the ASF dual-hosted git repository.
msingh pushed a change to branch HDDS-3630
in repository https://gitbox.apache.org/repos/asf/ozone.git.
from 71b0471 HDDS-6337. [FSO] Disable recursive access check flag for
directories with no children. (#3134)
add f153236 HDDS-5863. Error message having null fields on volume
creation (#2752)
add 5c76856 HDDS-5885. OM Auth Validate for read requests and handle non
ratis enabled code. (#2779)
add 5f0a588 HDDS-5908. MPU getKey can fail, if completeMPU result is
still in cache. (#2787)
add e427b71 HDDS-5883 Change S3G client to set S3 Auth per req (#2775)
add 73a081a HDDS-5864. Retry when DN connection issue during
getBlock/ReadChunk call during Ozone key Read (#2746)
add 83f8b04 HDDS-5736. Update navbar from Hadoop to Ozone on doc page
(#2792)
add 47cb26a HDDS-3983 Ozone RocksDB Iterator wrapper should not expose
key() and value() API. (#2402)
add 565972c Support more detailed error log when handleFlush in Ozone
client (#2795)
add 1cf43ac HDDS-5931. Broken link in dist/README (#2799)
add 9cea16d HDDS-5933. Ozone Filesystem shaded jars include unnecessary
dependencies (#2798)
add eb7136d HDDS-3369. Cleanup old write-path of volume in OM. (#2780)
add c088cd1 HDDS-5925. Fix SecuringOzoneHTTP doc (#2796)
add ac86851 HDDS-5943. Shutdown ResultHandlerExecutorService for
StorageVolumeChecker. (#2806)
add aa7e083 HDDS-5944. Fix typo in OzoneManagerServiceProviderImpl.java
(#2807)
add 6ebb316 HDDS-5945. bump rocksdb version to 6.25.3 (#2809)
add 4c2181f HDDS-5935. Bump Spring to 5.2.18 (#2801)
add f3b482a HDDS-5922. ignore deletetransaction when container is not
found (#2793)
add c63479c HDDS-5839. Make sure buckets created from OFS are in
FILE_SYSTEM_OPTIMIZED layout (#2730)
add 96e2d7f HDDS-5947. Remove unused mina-core and sshd-core dependencies
(#2811)
add 252fee4 HDDS-5910 Add additional verification for S3 Auth. (#2817)
add 9d9e780 HDDS-5956. Speed up
TestOzoneRpcClientAbstract#testZReadKeyWithUnhealthyContainerReplica (#2820)
add 0eedab9 HDDS-5929. Make FSO and OBS bucket layouts independent of
normalization config flag (#2819)
add ba3ac30 HDDS-5960. Change option name to bucketlayout instead of type
(#2825)
add 4558e40 HDDS-5970. Remove OMKeyRequest#getBucketLayout overridden
method in subclasses (#2830)
add 9384bd7 HDDS-5820. Intermittent failure in
TestPipelinePlacementPolicy#testPickLowestLoadAnchor (#2757)
add d0e9140 HDDS-5958. Refine container scrub log message. (#2823)
add 45c1899 HDDS-5937. Inaccurate bucket info returned from bucket list
command in Shell (#2832)
add c2db377 HDDS-5872. Do not failover on some RpcExceptions (#2772)
add 71f47d4 HDDS-5981. Refactor usage of bucket type. (#2836)
add 026d878 HDDS-5982. Remove isBucketFSOptimized flag. (#2838)
add 346b55d HDDS-5906. Fix DBScanner to support Datanode DB (#2781)
add 1b7072c HDDS-5983. Prefix Parser tool should only work for FSO
buckets. (#2839)
add 5ef59b4 HDDS-5957. Bump proto-backwards-compatibility from 1.0.5 to
1.0.7 (#2821)
add b4a785c HDDS-5891. OFS mkdir -p does not work as expected for bucket
creation when volume exists due to volume create ACL check (#2814)
add 6ea9916 HDDS-5964. [S3-TDE] Range Reads not working on encrypted
buckets (#2827)
add 83e5aa3 HDDS-5848. Introduce more replication metrics (#2758)
add 4348d1d HDDS-5980. Get on a key which is created/overwrite through
MPU on a TDE bucket, the data does not match with uploaded data. (#2844)
add 78e725c HDDS-5969. TestRootedOzoneFileSystem parameterized test is
not initialized properly (#2843)
add 281f3b0 HDDS-5870. Make Datanode usageinfo command output more
readable (#2816)
add 07b54e2 HDDS-5534. Verify config is updated on all OMs before
proceeding with Bootstrap (#2491)
add 722fd59 HDDS-5898 S3G in secure mode checks OM version. (#2822)
add 52e619c HDDS-5517. Support multiple container moves from a source
datanode in one balance iteration (#2808)
add 6372776 HDDS-5976. add raftlog IOException notifier for SCM HA (#2840)
add bc6029e [FSO] Allow existing/old buckets with any layout during OM
startup (#2571)
add ffe53e7 HDDS-6019. Fix s3g create key error in cluster with
replication one. (#2855)
add f780851 HDDS-6003. Update Ozone master branch version after 1.2.0
release (#2863)
add 4f56b1a HDDS-6043. Buckets created via link command do not mirror
layout of s… (#2867)
add 7afd64f HDDS-5897. Support configuration for including/excluding
datanodes for balancing (#2786)
add 97d900e HDDS-5989. Binary content printed for failed chunk write
(#2846)
add 1e76ffc HDDS-6011. Freon datanode chunk generator fails with NPE in
secure cluster (#2853)
add 5472ea4 HDDS-5497. Save log from init containers (#2547)
add 8b4d4a9 HDDS-5804. SCMContainerPlacementCapacity to choose lower
utilized node (#2784)
add 4e91226 HDDS-5917. S3 acceptance test failure due to too wide
assertion (#2789)
add 5b0604d HDDS-5702. SCM remote benchmark tool. (#2600)
add 2341c7c HDDS-5936. Duplicate Test Ozone Shell invocation (#2803)
add 1892230 HDDS-6054. Fix resource leak due to OzoneManager.createOm
(#2876)
add ec77f6c HDDS-6000. Freon datanode chunk validator fails checksum
validation (#2850)
add 090672d HDDS-6055. Refactor isFileSystemOptimized usage in
OzoneManagerUtils (#2877)
add b69a3d1 HDDS-5959. Handles bucket layout validation logic in ofs/o3fs
client. (#2837)
add b8e1e8f HDDS-5999. Freon datanode chunk validator does not find
pipeline from param (#2879)
add 3012cd1 HDDS-6014. Add proto.lock files from ozone-1.2 release branch
to master (#2865)
add ef1f3d3 HDDS-5962. Limit grpc threads in XceiverServerGrpc. (#2824)
add d6e0e47 HDDS-5997 Centralize string based replication config
validation via ReplicationConfigValidator (#2871)
add 8ef63ec HDDS-6058. Bump aws-java-sdk to latest 1.12 (#2881)
add 66c581d HDDS-6041. [FSO] Revisit robot test cases related to
prefix/simple me… (#2885)
add ab3b731 HDDS-6061. Peer datanode cannot add group for pipeline in
secure env (#2882)
add e86119f HDDS-5965. Recon should be able to distinguish between
containers that have no replicas and those have all replicas as UNHEALTHY.
(#2874)
add 9c4bb72 HDDS-5973. Changed sequence of steps during pipeline close.
(#2847)
add df0489a HDDS-5903. Add Support for Bucket Owner Acls (#2826)
add 3097d2b HDDS-6059. Change Cannot close container log message from
WARN to DEBUG (#2890)
add ea53dc1 HDDS-3227. Ensure eviction of stateMachineData from cache
only when both followers catch up (#2704)
add 46c95ba HDDS-6067. Improve Debugging around unhealthy container state
on Datanode. (#2888)
add 937a3d0 HDDS-6071. ResourceLimitCache leaks permits (#2895)
add 176ef94 HDDS-5385. [FSO] Remove ozone.om.metadata.layout config in OM
(#2887)
add ab8cc32 HDDS-6073. Document: Fix images alignment in the doc pages
(#2898)
add d972c7b HDDS-6069: Fix XmlRootElement for CopyObjectResponse (#2891)
add 41f6844 HDDS-6046. Multi-threaded validator for freon
RandomKeyGenerator. (#2869)
add 8532e08 HDDS-6078. Move BucketManagerImpl#resolveLinkBucketLayout
into utilit… (#2902)
add 831b195 HDDS-5974. Remove OMClientResponse#getBucketLayout override
in subclasses - part1 (#2894)
add 173f46a HDDS-6085. Update log4j to 2.15 (#2906)
add 5dd1144 HDDS-6066. Cleanup OmService injection. (#2896)
add 0bc100a HDDS-6090. Collect output.log from acceptance tests (#2908)
add 8587de7 HDDS-6096. S3 copy object fails for source key with special
char (#2912)
add dfcc69c HDDS-6018 Closing state to quasiclosed (#2854)
add 09b06eb HDDS-6104. Update log4j version to 2.16.0 version. (#2920)
add 4d1b5da HDDS-6053. Fix too short container scrubber data scan
interval. (#2875)
add e1bef2c HDDS-6080. Simplify the logic in
SimpleContainerDownloader.getContainerDataFromReplicas (#2903)
add 47cd204 HDDS-6107. Exclude hugo lock file from source tarball (#2923)
add c4579ec HDDS-6089. Remove OMClientResponse#getBucketLayout override
in subclasses - part2 (#2915)
add b75ec9d HDDS-6072. Fix increased integration test execution time
(#2900)
add 56d0ebb HDDS-6105. remove db cache size config (#2922)
add af4730a HDDS-5912. Add description of hdds.datanode.dir in Getting
Started (#2783)
add 3fa3f36 HDDS-6110. Add hugo lock file to gitignore (#2928)
add 4770eab HDDS-5795. [FSO] Add unit test case with mpu open key during
abort. (#2931)
add fe7f5b4 HDDS-5490. Remove (Decommission) an OM node from HA ring
(#2886)
add 8ceb6cb HDDS-6124. Update log4j version to 2.17.0 version (#2933)
add 69e8617 HDDS-6125. Support Hugo 0.91.0. (#2934)
add e01b471 HDDS-5602. make it configurable to choose the nearest one as
the target in the candidates according to networkTopology (#2756)
add 26a9cdb HDDS-6101. use FileUtils.moveDirectory instead of Files.move
when installing snapshot (#2918)
add 6cd9211 HDDS-5975. Serve url-encoded key and prefix name for
ListObjectResponse (#2834)
add 9dc63a3 HDDS-5807. [FSO] Merge HDDS-4653 changes to support TDE for
MPU Keys in FSO bucket layout. (#2941)
add 97143b8 HDDS-6129. OM has thread unsafe issues that can cause OM
shutdown. (#2938)
add b570d0a HDDS-6070. ContainerBalancerConfig doesn't read config from
ozone-site.xml (#2893)
add 4ed3ef8 HDDS-6121. DatanodeAdminMonitor should log detailed
information for a limited number of containers (#2932)
add 9103aa0 HDDS-5993. Disable flaky
TestRandomKeyGenerator#cleanObjectsTest
add a5cc886 HDDS-5319 Intermittent failure in
TestSCMUpdateServiceGrpcServer (#2558)
add d6cbb15 HDDS-6143. Update log4j version to 2.17.1 (#2952)
add b5c5853 HDDS-6142. Remove unused dependency: jdom (#2951)
add cb59f01 HDDS-6119. Reset the property name to configure the datanode
kerberos keytab (#2949)
add e6179c1 HDDS-6118. Documentation missing settings to secure S3g with
Kerberos (#2950)
add 144e982 HDDS-6108. Add slf4j and log4j.properties for tests in
hadoop-ozone/client (#2925)
add b7496c9 HDDS-6146. TestDefaultCAServer#testIntermediaryCA failure
(#2955)
add 4d3f8ba HDDS-6103. Avoid refresh pipeline for key override in
Key/File Create. (#2926)
add 644ef95 HDDS-6145. Include docker-compose output in acceptance test
output.log (#2958)
add 30cb5e7 HDDS-6123. Disable system exit in integration tests (#2959)
add 1ea978a HDDS-6149. Remove unused keytabs (#2960)
add 243cc3f HDDS-6094. Some unit tests are skipped due to using JUnit4
runner (#2909)
add 61f1c70 HDDS-6075. OzoneConfiguration constructor overrides input
configuration keys. (#2921)
add ca25193 HDDS-4177. SCM Container DB bootstrap on Recon startup (#2942)
add 9644f83c HDDS-6086. Compute MD5MD5CRC file checksum using chunk
checksums from DataNodes (#2919)
add a31b79a HDDS-6148. Validate ContainerBalancerConfiguration before
start ContainerBalancer (#2957)
add c8f6ad0 HDDS-6161. SCM StateMachine failing to reinitialize doesn't
terminate the process. (#2971)
add a348980 HDDS-6134. Move replication-specific config to
ReplicationServer (#2943)
add 5200eab HDDS-4010. S3G startup fails when multiple service ids are
configured. (#2976)
add a7aac99 HDDS-6170. Add metrics to replication manager to track
container health states (#2975)
add bcfb64a HDDS-3231. Cleanup KeyManagerImpl (#2961)
add ac99b47 HDDS-5927. Improve defaults in ContainerBalancerConfiguration
(#2892)
add e1f9f21 HDDS-6157. More consistent synchronization in InputStreams
(#2965)
add d09cdd4 HDDS-4743. [FSO] Add FSO variant of ITestOzoneContractDistcp.
(#2980)
add 195737d HDDS-6114. Intermittent error due to Failed to init RocksDB
(#2947)
add 5447f58 HDDS-6175. Use s3Auth during proxy during decrypt in
RpcClient. (#2981)
add 3eb7235 HDDS-5740. Enable ratis by default for SCM. (#2637)
add 46f305d HDDS-6183. Intermittent failure in
TestKeyDeletingService.checkIfDeleteServiceWithFailingSCM. (#2991)
add 1dd1d0b HDDS-4190. Intermittent failure in
TestOMVolumeSetOwnerRequest and TestOMVolumeSetQuotaRequest. (#2982)
add 9785941 HDDS-6120. Compute block checksum using chunk checksums
(#2930)
add cde7cb7 HDDS-6147. Add ability in OM to get limited delta updates
(#2956)
add fc3015b HDDS-6195. Remove unused jmh-core dependency. (#2997)
add 0c071ba HDDS-6167. Update ozone-runner version to 20211202-1 (#2969)
add b8d97eb HDDS-6171. Create an API to change Bucket Owner (#2988)
add a99ec03 HDDS-6163. Fix PATH in docker image (#2967)
add 431ce39 HDDS-6202. Avoid using jmh-generator-annprocess since it is
GPL2.0. (#2998)
add 05773af HDDS-6135. SCM Container DB bootstrap on Recon startup for
SCM HA. (#2972)
add 66aadb0 HDDS-6109. Preserve the underlying exception raised in client
lib. (#2989)
add bd91ab9 HDDS-3408. Rename ChunkLayOutVersion to
ContainerLayoutVersion. (#2983)
add 18f1461 HDDS-6203. CleanUp incomplete gz files during Container move
(#3000)
add 2af225d HDDS-6216. Move OMOpenKeysDeleteRequest to package
om.request.key (#3011)
add ada4a3b HDDS-6191. Intermittent failure in TestDeleteWithSlowFollower
(#3015)
add 6180d21 HDDS-6128. CLI tool that downloads all the block replicas and
creates a manifest file (#2987)
add 3a16ebe HDDS-6177. Extend container info command to include replica
details (#2995)
add 5823f56 HDDS-6211. [Docs] Image styling on deployed site does not
replicate local builds. (#3007)
add d3b1a06 HDDS-6219. Switch to RATIS ReplicationType from STAND_ALONE
in our tests. (#3014)
add dc13410 HDDS-6192. feature/Observability.md translated to Chinese
(#2994)
add dc6f279 HDDS-6205. Add CLI command to display the latest Replication
Manager report (#3013)
add 11605e1 HDDS-6227. Test helpers should observe naming conditions
(#3020)
add 634d666 HDDS-6239. ozonesecure-mr failing with No URLs in mirrorlist
(#3029)
add 5d496f2 HDDS-6201. Fix NPE for DataScanner with scanned container
deleted by others. (#3005)
add 9186e6b HDDS-5529. For any IOexception from @Replicated method we
should throw it (#2788)
add 1804e22 HDDS-6181. Change SCMHAInvocationHandler#invokeRatis()
logging to TRACE (#2992)
add e47b6f0 HDDS-6206. Application errors must not flood system log
(#3001)
add f757d99 HDDS-6245. Add BucketLayout logging to Audit Logs (#3040)
add aafc21a HDDS-6238 Reduce memory requirements for list keys. (#3032)
add 7cee0ea HDDS-2919. Intermittent failure in TestRDBStore (#3028)
add 5a35cab HDDS-6253. Unnecessary duplicate smoketest after defaulting
to FSO (#3036)
add 5b1dbeb HDDS-6204. Cleanup handling malformed authorization header
(#2999)
add b32e135 HDDS-6169. Selective checks: skip junit tests on ozone-runner
image update (#2974)
add 14fa87c HDDS-6270. Use a dedicated file instead of /etc/passwd for
xcompat acceptance test (#3050)
add 5c3aa01 HDDS-6273. Amend doc SecuringTDE.md (#3047)
add c5fb612 HDDS-6140. Selective checks: skip unit check for
integration-test changes (#2948)
add 11f4c9b HDDS-6215. Recon get limited delta updates from OM (#3009)
add 40d0a40 HDDS-6226. Run tests for selective CI checks in CI (#3019)
add 86a771d HDDS-6247. Avoid logging stack trace for user input problems
(#3039)
add de42c61 HDDS-6208. New checkstyle: WhitespaceAround (#3003)
add ad6d3bc HDDS-6289. Upgrade acceptance test log flooded with parse
error (#3063)
add 5f8e637 HDDS-6291. Do not let slf4j-log4j12 leak into Ozone FS shaded
jar (#3064)
add 59cae07 HDDS-6285. ozonesecure-mr intermittently failing with timeout
downloading packages (#3057)
add a5accd2 HDDS-6278 Improve memory profile for listStatus API call.
(#3053)
add 594c4a9 HDDS-6257. Wrong stack trace for S3 errors (#3066)
add f31d589 HDDS-6088. Implement O3FS/OFS getFileChecksum() using file
checksum helpers. (#2935)
add 7c990ab HDDS-6088. Implement O3FS/OFS getFileChecksum() using file
checksum helpers - addendum: fix checkstyle
add f7e1fa0 HDDS-4126. Freon key generator should support >2GB files.
(#3054)
add 9ce981c HDDS-6293. Allow using custom ozone-runner image (#3072)
add fa2ae7b HDDS-6309. Update ozone-runner version to 20220212-1 (#3079)
add 3ed0b6b HDDS-6304. Add enforcer to make sure ozone.version equals
project.version (#3075)
add 49221c0 HDDS-6190. Cleanup unnecessary datanode id path checks.
(#2993)
add e7f5b4e HDDS-6310. Update json-smart to 2.4.7. (#3080)
add 917ce68 HDDS-6186. Selective checks: skip integration check for unit
test changes (#3061)
add 41651e8 HDDS-6313. Remove replicas in ContainerStateMap when a
container is deleted (#3086)
add c04c01d HDDS-5913. Avoid integer overflow when setting
dfs.container.ratis.lo… (#2785)
add e0d4007 HDDS-6322. Fix Recon getting inccorrect sequenceNumber from
OM (#3090)
add 000902d HDDS-6325. Fix interface ClientProtocol methods typo
setThreadLocalS3Auth and clearThreadLocalS3Auth (#3093)
add f0f344d HDDS-6311. Fix number of keys displayed in Recon Overview.
(#3081)
add 87ff329 HDDS-6305: Add metrics - number of FSO bucket creates (#3077)
add 8c5fefe HDDS-6330. Remove unnecessary duplicate semicolons (#3097)
add ff0209d HDDS-6331. Remove toString in debug log parameters within
SCMCommonPlacementPolicy (#3098)
add 2c561d0 HDDS-6283. Change ContainerStateMachine ContainerOpExecutor
name (#3055)
add eb0f56b HDDS-6324. Do not trigger CI by reopening PR (#3092)
add c87b059 HDDS-6284. Add BlockDeletingService worker size config (#3056)
add 51f47fc HDDS-6314. ConcurrentModificationException getting
SCMContainerMetrics (#3101)
add 53fa44d HDDS-6290. operational-state and node-state options in
datanode list CLI not working correctly (#3105)
add 91cf777 HDDS-6262. ozone insight log stops working after OM DBUpdates
message (#3044)
add 07fa775 HDDS-6234. Repair containers affected by incorrect used bytes
and block count. (#3042)
add 788ff0f HDDS-6212. SCM Container DB bootstrap on Recon startup for
secure cluster (#3027)
add ad33ac6 HDDS-6292. Ensure immutable ContainerReplica set is returned
from ContainerStateManagerImpl (#3071)
add 8ad0796 HDDS-6329. New checkstyle: AvoidStarImport (#3096)
add 7f6e6fb HDDS-6350. Rename TestStandardOutputUtil to observe naming
conventions (#3114)
add 4b935c5 HDDS-6328. Add metrics - number of FSO bucket deletes (#3107)
add e848ab7 HDDS-6327. Upgrade acceptance test doesn't collect logs when
the test fails (#3106)
add 68c5ac5 HDDS-6351. [Docs] Update prefix-based FSO documentation.
(#3115)
add 239d889 HDDS-5267. Full Container Report can remove replicas added by
an Incremental Report (#2963)
add f0ee98a HDDS-6363. Update checkstyle version to 9.3 (#3123)
add 1c7ff7e HDDS-6221. Update versions covered by cross-compatibility
test (#3017)
add a195100 HDDS-5359. Incorrect BLOCKCOUNT and BYTESUSED in container
DB. (#3034)
add 5f4c31a HDDS-6349. IncompleteReadError on get MPU key from TDE bucket
(#3116)
add a53a3a3 HDDS-6235. Empty KeyValueContainers are replicated without
chunks directory. (#3052)
add 7310491 HDDS-5194. Provide kustomize descriptors for Ozone kubernetes
examples (#2221)
add 93631a1 HDDS-6334. Remove ContainerID to Proto to ContainerID
conversion in ContainerStateManagerImpl (#3110)
add 17d86f1 HDDS-6361. Modify docs build flow to replace image tags with
shortcodes. (#3122)
add da93105 HDDS-6369. PARTIAL_RENAME does not update OM DB (#3126)
add fbce851 HDDS-6374. Fix incorrect queueTime metrics of ReplicationTask
(#3135)
add ebbe9b5 HDDS-6337. [FSO] Disable recursive access check flag for
directories with no children. (#3134)
new 84afcf3 Merge remote-tracking branch 'apache/master' into HDDS-3630
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
