This is an automated email from the ASF dual-hosted git repository. zghao pushed a change to branch HBASE-24666 in repository https://gitbox.apache.org/repos/asf/hbase.git.
discard 3640775 HBASE-25071 ReplicationServer support start ReplicationSource internal (#2452) omit f67c3df HBASE-24999 Master manages ReplicationServers (#2579) omit 1a64f1a HBASE-24684 Fetch ReplicationSink servers list from HMaster instead o… (#2077) omit 4f77158 HBASE-24998 Introduce a ReplicationSourceOverallController interface and decouple ReplicationSourceManager and ReplicationSource (#2364) omit 8ed76d4 HBASE-24982 Disassemble the method replicateWALEntry from AdminService to a new interface ReplicationServerService (#2360) omit d43d2c9 HBASE-24683 Add a basic ReplicationServer which only implement ReplicationSink Service (#2111) omit 43410f9 HBASE-24735: Refactor ReplicationSourceManager: move logPositionAndCleanOldLogs/cleanUpHFileRefs to ReplicationSource inside (#2064) omit 25764a3 HBASE-24681 Remove the cache walsById/walsByIdRecoveredQueues from ReplicationSourceManager (#2019) omit 7a41a3e HBASE-24682 Refactor ReplicationSource#addHFileRefs method: move it to ReplicationSourceManager (#2020) add 74df1e1 HBASE-25207 Revisit the implementation and usage of RegionStates.include (#2571) add d8de24c HBASE-25128 RSGroupInfo's toString() and hashCode() does not take into account configuration map. (#2484) add 5e3ffb1 HBASE-25193: Add support for row prefix and type in the WAL Pretty Printer add 881c92b HBASE-25206 Data loss can happen if a cloned table loses original split region(delete table) (#2569) add e5d4e2f HBASE-25189 [Metrics] Add checkAndPut and checkAndDelete latency metrics at table level (#2549) add 164cc5a HBASE-25215 TestClientOperationTimeout.testScanTimeout is flaky (#2583) add 4bbc772 HBASE-25173 Remove owner related methods in TableDescriptor/TableDescriptorBuilder (#2541) add 485da75 HBASE-25176 MasterStoppedException should be moved to hbase-client module (#2538) add 17f9ade HBASE-25201 YouAreDeadException should be moved to hbase-server module (#2581) add 735689d HBASE-25223 Use try-with-resources statement (#2592) add bb4a9d3 HBASE-25224 Maximize sleep for checking meta and namespace regions availability (#2593) add 259fe19 HBASE-24845 Git/Jira Release Audit: limit branches when building audit db (#2238) add 35b344c HBASE-25090 CompactionConfiguration logs unrealistic store file sizes (#2595) add 12d0397 HBASE-24419 Normalizer merge plans should consider more than 2 regions when possible add eee1cf7 HBASE-24200 Upgrade to Yetus 0.12.0 add e3beccf HBASE-24977 Meta table shouldn't be modified as read only (#2537) add d790bde HBASE-25167 Normalizer support for hot config reloading (#2523) add 85dfd9a HBASE-25218 : Add 2.3.3 to the downloads page add 7a41247 HBASE-25228 Delete dev-support/jenkins_precommit_jira_yetus.sh (#2611) add 5abbda1 HBASE-24859: Optimize in-memory representation of HBase map reduce table splits (#2609) add 1eceab6 HBASE-25210 RegionInfo.isOffline is now a duplication with RegionInfo.isSplit (#2580) add c98e993 HBASE-25212 Optionally abort requests in progress after deciding a region should close (#2574) add f37cd05 HBASE-25235 Cleanup the deprecated methods in TimeRange (#2616) add 49774c7 HBASE-25216 The client zk syncer should deal with meta replica count change (#2614) add 4bd9ee4 HBASE-25245 : Fixing incorrect maven and jdk names for generate-hbase-website add 0e71d61 HBASE-25053 WAL replay should ignore 0-length files (#2437) add 0356e8e HBASE-25240 gson format of RpcServer.logResponse is abnormal add 23e6567 HBASE-25238 Upgrading HBase from 2.2.0 to 2.3.x fails because of “Message missing required fields: state” (#2625) add 671129d HBASE-25252 Move HMaster inner classes out (#2628) add c36ee4f HBASE-25254 Rewrite TestMultiLogThreshold to remove the LogDelegate in RSRpcServices (#2631) new ee34412 HBASE-24682 Refactor ReplicationSource#addHFileRefs method: move it to ReplicationSourceManager (#2020) new efbb75c HBASE-24681 Remove the cache walsById/walsByIdRecoveredQueues from ReplicationSourceManager (#2019) new a86c174 HBASE-24735: Refactor ReplicationSourceManager: move logPositionAndCleanOldLogs/cleanUpHFileRefs to ReplicationSource inside (#2064) new 1bcf389 HBASE-24683 Add a basic ReplicationServer which only implement ReplicationSink Service (#2111) new 83dcae9 HBASE-24982 Disassemble the method replicateWALEntry from AdminService to a new interface ReplicationServerService (#2360) new 13006e4 HBASE-24998 Introduce a ReplicationSourceOverallController interface and decouple ReplicationSourceManager and ReplicationSource (#2364) new 3ef10b0 HBASE-24684 Fetch ReplicationSink servers list from HMaster instead o… (#2077) new e118d8d HBASE-24999 Master manages ReplicationServers (#2579) new 34e49bc HBASE-25071 ReplicationServer support start ReplicationSource internal (#2452) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3640775) \ N -- N -- N refs/heads/HBASE-24666 (34e49bc) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 9 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: dev-support/Jenkinsfile | 2 +- dev-support/Jenkinsfile_GitHub | 2 +- dev-support/create-release/do-release.sh | 4 +- dev-support/create-release/hbase-rm/Dockerfile | 2 +- dev-support/git-jira-release-audit/README.md | 9 +- .../git_jira_release_audit.py | 11 +- .../generate-hbase-website.Jenkinsfile | 4 +- dev-support/jenkins_precommit_jira_yetus.sh | 182 ----------- .../org/apache/hadoop/hbase/client/Append.java | 5 +- .../java/org/apache/hadoop/hbase/client/Get.java | 10 +- .../org/apache/hadoop/hbase/client/Increment.java | 5 +- .../hadoop/hbase/client/MutableRegionInfo.java | 6 + .../java/org/apache/hadoop/hbase/client/Query.java | 2 +- .../org/apache/hadoop/hbase/client/RegionInfo.java | 6 + .../hadoop/hbase/client/RegionInfoBuilder.java | 1 + .../java/org/apache/hadoop/hbase/client/Scan.java | 4 +- .../hadoop/hbase/client/TableDescriptor.java | 7 - .../hbase/client/TableDescriptorBuilder.java | 59 ---- .../MasterStoppedException.java} | 18 +- .../hadoop/hbase/shaded/protobuf/ProtobufUtil.java | 20 +- .../hadoop/hbase/conf/ConfigurationManager.java | 27 +- .../hadoop/hbase/conf/ConfigurationObserver.java | 4 +- .../java/org/apache/hadoop/hbase/io/TimeRange.java | 86 +---- .../apache/hadoop/hbase/rsgroup/RSGroupInfo.java | 4 + .../org/apache/hadoop/hbase/util/GsonUtil.java | 4 + .../org/apache/hadoop/hbase/MatcherPredicate.java | 65 ++++ .../hbase/conf/TestConfigurationManager.java | 11 +- .../org/apache/hadoop/hbase/util/TestGsonUtil.java | 25 +- .../hadoop/hbase/coprocessor/TestSecureExport.java | 14 +- .../hbase/regionserver/MetricsTableLatencies.java | 25 ++ .../regionserver/MetricsTableLatenciesImpl.java | 36 ++ .../hbase/mapreduce/TableInputFormatBase.java | 35 +- .../apache/hadoop/hbase/mapreduce/TableSplit.java | 34 +- .../mapreduce/TestTableInputFormatScanBase.java | 17 +- .../src/main/protobuf/server/ClusterStatus.proto | 7 +- .../protobuf/server/master/MasterProcedure.proto | 4 +- .../apache/hadoop/hbase/YouAreDeadException.java | 6 +- .../org/apache/hadoop/hbase/ipc/RpcServer.java | 2 +- .../org/apache/hadoop/hbase/master/HMaster.java | 145 ++------ .../hbase/master/MasterInitializationMonitor.java | 80 +++++ .../hadoop/hbase/master/MasterRedirectServlet.java | 81 +++++ .../apache/hadoop/hbase/master/MasterServices.java | 8 + .../hbase/master/assignment/AssignmentManager.java | 17 +- .../assignment/RegionRemoteProcedureBase.java | 5 +- .../hbase/master/assignment/RegionStates.java | 40 ++- .../assignment/TransitRegionStateProcedure.java | 1 + .../master/normalizer/MergeNormalizationPlan.java | 6 + .../master/normalizer/NormalizationTarget.java | 3 +- .../master/normalizer/RegionNormalizerManager.java | 26 +- .../master/normalizer/RegionNormalizerWorker.java | 41 ++- .../master/normalizer/SimpleRegionNormalizer.java | 233 +++++++++---- .../master/procedure/DeleteTableProcedure.java | 3 +- .../master/procedure/EnableTableProcedure.java | 4 +- .../master/procedure/ModifyTableProcedure.java | 7 + .../hbase/master/zksyncer/ClientZKSyncer.java | 216 ++++++++---- .../hbase/master/zksyncer/MasterAddressSyncer.java | 13 +- .../hbase/master/zksyncer/MetaLocationSyncer.java | 24 +- .../store/region/WALProcedurePrettyPrinter.java | 2 +- .../apache/hadoop/hbase/regionserver/HRegion.java | 308 ++++++++++++++--- .../hbase/regionserver/MetricsRegionServer.java | 15 +- .../hadoop/hbase/regionserver/RSRpcServices.java | 53 +-- .../apache/hadoop/hbase/regionserver/Region.java | 3 +- .../regionserver/RegionServerTableMetrics.java | 12 + .../hbase/regionserver/TimeRangeTracker.java | 2 +- .../compactions/CompactionConfiguration.java | 4 +- .../hbase/security/access/AccessController.java | 8 +- .../access/SnapshotScannerHDFSAclController.java | 3 +- .../hadoop/hbase/snapshot/CreateSnapshot.java | 23 +- .../hbase/snapshot/SnapshotDescriptionUtils.java | 26 +- .../hadoop/hbase/snapshot/SnapshotManifest.java | 11 +- .../hadoop/hbase/snapshot/SnapshotManifestV2.java | 17 +- .../hadoop/hbase/util/TableDescriptorChecker.java | 6 + .../apache/hadoop/hbase/wal/WALPrettyPrinter.java | 89 +++-- .../apache/hadoop/hbase/HBaseTestingUtility.java | 44 ++- .../hadoop/hbase/TestClientOperationTimeout.java | 95 +++--- .../org/apache/hadoop/hbase/TestHBaseMetaEdit.java | 29 ++ ...shotFromClientAfterSplittingRegionTestBase.java | 36 ++ .../hbase/client/SnapshotWithAclTestBase.java | 13 +- .../hbase/client/TestSeparateClientZKCluster.java | 62 ++-- .../hbase/coprocessor/TestAppendTimeRange.java | 8 +- .../hbase/coprocessor/TestIncrementTimeRange.java | 4 +- .../hbase/master/MockNoopMasterServices.java | 6 + .../hadoop/hbase/master/TestMasterNoCluster.java | 2 +- .../hbase/master/assignment/TestRegionStates.java | 23 +- ...gionNormalizerManagerConfigurationObserver.java | 110 +++++++ .../normalizer/TestSimpleRegionNormalizer.java | 64 +++- .../TestSimpleRegionNormalizerOnCluster.java | 167 ++++++---- .../regionserver/TestCacheOnWriteInSchema.java | 2 +- .../regionserver/TestFailedAppendAndSync.java | 10 +- .../hadoop/hbase/regionserver/TestHRegion.java | 272 +++++++++++++-- .../regionserver/TestHRegionReplayEvents.java | 2 +- .../regionserver/TestHRegionWithInMemoryFlush.java | 7 +- .../regionserver/TestMetricsRegionServer.java | 17 +- .../hbase/regionserver/TestMultiLogThreshold.java | 121 ++++--- .../hbase/regionserver/TestRegionIncrement.java | 2 +- .../hbase/regionserver/TestRegionInterrupt.java | 363 +++++++++++++++++++++ .../regionserver/TestSimpleTimeRangeTracker.java | 14 +- .../hadoop/hbase/regionserver/TestWALLockup.java | 10 +- .../hbase/regionserver/wal/AbstractTestFSWAL.java | 2 +- .../hadoop/hbase/regionserver/wal/TestFSHLog.java | 2 +- .../regionserver/wal/WALDurabilityTestBase.java | 12 +- .../hadoop/hbase/rsgroup/TestRSGroupsWithACL.java | 6 +- .../hbase/security/access/SecureTestUtil.java | 12 + .../security/access/TestAccessController.java | 34 +- .../security/access/TestAccessController3.java | 8 +- .../access/TestCellACLWithMultipleVersions.java | 13 +- .../hadoop/hbase/security/access/TestCellACLs.java | 10 +- .../hbase/security/access/TestHDFSAclHelper.java | 29 +- .../security/access/TestScanEarlyTermination.java | 9 +- .../access/TestWithDisabledAuthorization.java | 10 +- hbase-shell/src/main/ruby/hbase/admin.rb | 3 +- hbase-shell/src/main/ruby/shell/commands/alter.rb | 2 +- hbase-shell/src/main/ruby/shell/commands/create.rb | 2 +- hbase-shell/src/test/ruby/hbase/admin_test.rb | 7 +- src/site/xdoc/downloads.xml | 16 +- 115 files changed, 2717 insertions(+), 1243 deletions(-) delete mode 100755 dev-support/jenkins_precommit_jira_yetus.sh copy hbase-client/src/main/java/org/apache/hadoop/hbase/{ipc/StoppedRpcClientException.java => exceptions/MasterStoppedException.java} (76%) create mode 100644 hbase-common/src/test/java/org/apache/hadoop/hbase/MatcherPredicate.java copy hbase-asyncfs/src/test/java/org/apache/hadoop/hbase/io/asyncfs/TestSendBufSizePredictor.java => hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestGsonUtil.java (68%) rename {hbase-client => hbase-server}/src/main/java/org/apache/hadoop/hbase/YouAreDeadException.java (90%) create mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterInitializationMonitor.java create mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRedirectServlet.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/master/normalizer/TestRegionNormalizerManagerConfigurationObserver.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionInterrupt.java