This is an automated email from the ASF dual-hosted git repository. avijayan pushed a change to branch HDDS-3698-upgrade in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
omit a2efcd5 Merge branch 'HDDS-3698-upgrade' of github.com:avijayanhwx/hadoop-ozone into HDDS-3698-upgrade omit b223f8b HDDS-4167. Acceptance test logs missing if fails during cluster startup (#1366) omit 4d00731 HDDS-4121. Implement OmMetadataMangerImpl#getExpiredOpenKeys. (#1351) omit 37f411b HDDS-3867. Extend the chunkinfo tool to display information from all nodes in the pipeline. (#1154) omit 84dfff4 HDDS-4077. Incomplete OzoneFileSystem statistics (#1329) omit 2f5c539 HDDS-3903. OzoneRpcClient support batch rename keys. (#1150) omit 6ffd933 HDDS-4151. Skip the inputstream while offset larger than zero in s3g (#1354) omit c6197b0 HDDS-4147. Add OFS to FileSystem META-INF (#1352) omit 1395451 HDDS-4137. Turn on the verbose mode of safe mode check on testlib (#1343) omit 89a61af HDDS-4146. Show the ScmId and ClusterId in the scm web ui. (#1350) omit dbd7825 HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master (#1349) omit 9ad9af1 HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster (#1316) omit 085e194 HDDS-4149. Implement OzoneFileStatus#toString (#1356) omit a2e45ad HDDS-4153. Increase default timeout in kubernetes tests (#1357) omit 9e489f7 HDDS-2411. add a datanode chunk validator fo datanode chunk generator (#1312) omit fe73df4 HDDS-4140. Auto-close /pending pull requests after 21 days of inactivity (#1344) omit ee8eb40 HDDS-4152. Archive container logs for kubernetes check (#1355) omit d14d288 HDDS-4056. Convert OzoneAdmin to pluggable model (#1285) omit c51e4b3 HDDS-3972. Add option to limit number of items displaying through ldb tool. (#1206) omit 5a2ea74 HDDS-4068. Client should not retry same OM on network connection failure (#1324) omit 2e222c4 HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive. (#1291) omit 7d612f4 HDDS-4111. Keep the CSI.zh.md consistent with CSI.md (#1320) omit 3c7975d HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately (#984) omit bb248bb HDDS-4112. Improve SCM webui page performance (#1323) omit f16c233 HDDS-4074. [OFS] Implement AbstractFileSystem for RootedOzoneFileSystem (#1330) omit caa0331 HDDS-4144. Update version info in hadoop client dependency readme (#1348) omit e1cd7af HDDS-4139. Update version number in upgrade tests (#1347) omit cfdaaa1 HDDS-4094. Support byte-level write in Freon HadoopFsGenerator (#1310) omit ab98099 HDDS-4127. Components with web interface should depend on hdds-docs. (#1335) omit 67914d4 HDDS-4114. Bump log4j2 version (#1325) omit 977c456 HDDS-4099. No Log4j 2 configuration file found error appears in CLI (#1318) omit 0341b89 HDDS-4108. ozone debug ldb scan without arguments results in core dump (#1317) omit ed17fe2 HDDS-3829. Introduce Layout Feature interface in Ozone. (#1322) omit 7bbd480 HDDS-3829. Introduce Layout Feature interface in Ozone. (#1322) add 9292b39 HDDS-4068. Client should not retry same OM on network connection failure (#1324) add 7f674fd HDDS-3972. Add option to limit number of items displaying through ldb tool. (#1206) add bc7786a HDDS-4056. Convert OzoneAdmin to pluggable model (#1285) add 5fab834 HDDS-4152. Archive container logs for kubernetes check (#1355) add 5523636 HDDS-4140. Auto-close /pending pull requests after 21 days of inactivity (#1344) add dcb1c6e HDDS-2411. add a datanode chunk validator fo datanode chunk generator (#1312) add 2f3edd9 HDDS-4153. Increase default timeout in kubernetes tests (#1357) add da61c4a HDDS-4149. Implement OzoneFileStatus#toString (#1356) add d064230 HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster (#1316) add f6e4417 HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master (#1349) add 02289ce HDDS-4146. Show the ScmId and ClusterId in the scm web ui. (#1350) add f64bc6e HDDS-4137. Turn on the verbose mode of safe mode check on testlib (#1343) add 44acf78 HDDS-4147. Add OFS to FileSystem META-INF (#1352) add 8e98977 HDDS-4151. Skip the inputstream while offset larger than zero in s3g (#1354) add d34ab29 HDDS-3903. OzoneRpcClient support batch rename keys. (#1150) add 78ca8bf HDDS-4077. Incomplete OzoneFileSystem statistics (#1329) add 0ec1a8a HDDS-3867. Extend the chunkinfo tool to display information from all nodes in the pipeline. (#1154) add 34ee831 HDDS-4121. Implement OmMetadataMangerImpl#getExpiredOpenKeys. (#1351) add 13fe31b HDDS-4167. Acceptance test logs missing if fails during cluster startup (#1366) add 9cef3f6 HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException (#1370) add 199512b HDDS-4131. Container report should update container key count and bytes used if they differ in SCM (#1339) add 77d56e6 HDDS-4165. GitHub Actions cache does not work outside of workspace (#1364) add c77e7ba HDDS-3804. Recon start fails with SQL exception with MySQL DB. (#1377) add b58054e HDDS-4169. Fix some minor errors in StorageContainerManager.md (#1367) add d2fb937 HDDS-4200. Fix missing right bracket in HA doc (#1380) add dc5a997 HDDS-1889. Add support for verifying multiline log entry (#1308) add 79f9fab HDDS-3762. Intermittent failure in TestDeleteWithSlowFollower (#1376) add fd63aac HDDS-4150. Disabling flaky unit test until HDDS-4150 is fixed. add b2fca43 HDDS-4189. Add alias `roles` for `ozone admin om` subcommand `getserviceroles` (#1375) add c8d5334 HDDS-4199. Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache (#1379) add ead6371 HDDS-3840. Use OFS in MapReduce acceptance test (#1365) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (a2efcd5) \ N -- N -- N refs/heads/HDDS-3698-upgrade (ead6371) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/post-commit.yml | 6 +- hadoop-hdds/common/pom.xml | 5 + .../upgrade/AbstractLayoutVersionManager.java | 110 -------------- .../apache/hadoop/ozone/upgrade/LayoutFeature.java | 45 ------ .../hadoop/ozone/upgrade/LayoutVersionManager.java | 64 -------- .../apache/hadoop/ozone/upgrade/package-info.java | 24 --- .../hadoop/ozone/audit/TestOzoneAuditLogger.java | 62 +++++++- .../upgrade/TestAbstractLayoutVersionManager.java | 85 ----------- .../commandhandler/DeleteBlocksCommandHandler.java | 2 +- .../ozone/container/ContainerTestHelper.java | 5 + .../content/concept/StorageContainerManager.md | 5 +- hadoop-hdds/docs/content/feature/HA.md | 2 +- .../container/AbstractContainerReportHandler.java | 47 +++++- .../hdds/scm/container/ReplicationManager.java | 34 ----- .../scm/container/TestContainerReportHandler.java | 164 ++++++++++++++++++++- .../src/main/compose/ozone-mr/hadoop27/test.sh | 7 +- .../src/main/compose/ozone-mr/hadoop31/test.sh | 7 +- .../src/main/compose/ozone-mr/hadoop32/test.sh | 7 +- .../dist/src/main/compose/ozonesecure-mr/test.sh | 5 +- .../dist/src/main/smoketest/createmrenv.robot | 13 +- .../dist/src/main/smoketest/mapreduce.robot | 11 +- .../main/smoketest/om-ratis/testOMAdminCmd.robot | 2 +- .../dist/src/main/smoketest/omha/testOMHA.robot | 2 +- .../src/main/smoketest/ozonefs/hadoopo3fs.robot | 12 +- .../ozone/client/rpc/TestWatchForCommit.java | 5 +- .../commandhandler/TestBlockDeletion.java | 5 +- hadoop-ozone/ozone-manager/pom.xml | 31 ---- .../org/apache/hadoop/ozone/om/OzoneManager.java | 4 - .../om/response/s3/security/package-info.java | 2 +- .../om/upgrade/NewOmFeatureUpgradeAction.java | 32 ---- .../ozone/om/upgrade/OMLayoutFeatureAPI.java | 35 ----- .../ozone/om/upgrade/OMLayoutFeatureAspect.java | 54 ------- .../ozone/om/upgrade/OMLayoutFeatureCatalog.java | 93 ------------ .../ozone/om/upgrade/OMLayoutVersionManager.java | 92 ------------ .../hadoop/ozone/om/upgrade/OmUpgradeAction.java | 28 ---- .../hadoop/ozone/om/upgrade/package-info.java | 23 --- .../om/request/key/TestOMAllocateBlockRequest.java | 22 +-- .../request/volume/TestOMVolumeDeleteRequest.java | 2 +- .../om/upgrade/TestOMLayoutFeatureAspect.java | 71 --------- .../ozone/om/upgrade/TestOMVersionManager.java | 66 --------- .../recon/schema/ContainerSchemaDefinition.java | 4 +- .../recon/schema/ReconTaskSchemaDefinition.java | 2 +- .../ozone/recon/schema/StatsSchemaDefinition.java | 2 +- .../recon/schema/UtilizationSchemaDefinition.java | 10 +- .../hadoop/ozone/recon/api/TestEndpoints.java | 2 + .../ozone/admin/om/GetServiceRolesSubcommand.java | 4 +- 46 files changed, 354 insertions(+), 961 deletions(-) delete mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java delete mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/LayoutFeature.java delete mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/LayoutVersionManager.java delete mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/package-info.java delete mode 100644 hadoop-hdds/common/src/test/java/org/apache/hadoop/ozone/upgrade/TestAbstractLayoutVersionManager.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/NewOmFeatureUpgradeAction.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMLayoutFeatureAPI.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMLayoutFeatureAspect.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMLayoutFeatureCatalog.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMLayoutVersionManager.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OmUpgradeAction.java delete mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/package-info.java delete mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/upgrade/TestOMLayoutFeatureAspect.java delete mode 100644 hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/upgrade/TestOMVersionManager.java --------------------------------------------------------------------- To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org