Hello Tidy Bot, Alexey Serbin, Kudu Jenkins, Andrew Wong, I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/14177 to look at the new patch set (#16). Change subject: KUDU-2780: create thread for auto-rebalancing ...................................................................... KUDU-2780: create thread for auto-rebalancing The auto-rebalancer thread is a background task of the master's catalog manager. Each loop iteration, the thread collects information on tablet servers, tables, and tablets, in order to determine the best rebalancing replica moves for the current state of the cluster. The maximum number of moves per tserver, per iteration, is controlled by a flag. Currently, each batch of moves scheduled per iteration is executed synchronously. The thread waits for the moves to complete, then sleeps for a time interval, which is controlled by a flag, before resuming. If the cluster has placement policy violations, the thread will prioritize scheduling and executing replica moves to reinstate the policy. Otherwise, the thread will perform inter-location (cross-location), then intra-location (by table, then by tserver) rebalancing. By default, auto-rebalancing is disabled. This can be changed by a flag in the catalog manager. The rebalancer tool should be run first, to fully rebalance the cluster, before enabling auto-rebalancing. Change-Id: Ifca25d1063c07047cf2123e6792b3c7395be20e4 --- M src/kudu/master/CMakeLists.txt A src/kudu/master/auto_rebalancer-test.cc A src/kudu/master/auto_rebalancer.cc A src/kudu/master/auto_rebalancer.h M src/kudu/master/catalog_manager.cc M src/kudu/master/catalog_manager.h M src/kudu/master/master_runner.cc M src/kudu/master/ts_descriptor.cc M src/kudu/master/ts_descriptor.h M src/kudu/master/ts_manager.cc M src/kudu/master/ts_manager.h M src/kudu/rebalance/rebalancer.cc M src/kudu/rebalance/rebalancer.h M src/kudu/tools/rebalancer_tool.cc M src/kudu/tools/tool_replica_util.cc M src/kudu/tools/tool_replica_util.h 16 files changed, 1,665 insertions(+), 107 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/77/14177/16 -- To view, visit http://gerrit.cloudera.org:8080/14177 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ifca25d1063c07047cf2123e6792b3c7395be20e4 Gerrit-Change-Number: 14177 Gerrit-PatchSet: 16 Gerrit-Owner: Hannah Nguyen <hannah.ngu...@cloudera.com> Gerrit-Reviewer: Alexey Serbin <aser...@cloudera.com> Gerrit-Reviewer: Andrew Wong <aw...@cloudera.com> Gerrit-Reviewer: Hannah Nguyen <hannah.ngu...@cloudera.com> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Tidy Bot (241)