[jira] [Commented] (HBASE-3743) Throttle major compaction
[ https://issues.apache.org/jira/browse/HBASE-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491694#comment-13491694 ] Otis Gospodnetic commented on HBASE-3743: - Is this issue still needed or did HBASE-5867 take care of compaction throttling? > Throttle major compaction > - > > Key: HBASE-3743 > URL: https://issues.apache.org/jira/browse/HBASE-3743 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: Joep Rottinghuis > > Add the ability to throttle major compaction. > For those use cases when a stop-the-world approach is not practical, it is > useful to be able to throttle the impact that major compaction has on the > cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3743) Throttle major compaction
[ https://issues.apache.org/jira/browse/HBASE-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400453#comment-13400453 ] Lars George commented on HBASE-3743: +1 on a feature like that. We need some script/tool/thread that can run major compactions based on load and abort if the load goes over a certain threshold. Once the low load is resumed we can continue where left off. Do this region by region, with a configurable number, i.e. one per cluster, one per node, and so on. We should also add a JMX/API call that returns the compaction status per server. It should list the various compaction queues, live compactions, their scope, and region/cf they work on. Maybe put this into the ServerInfo? > Throttle major compaction > - > > Key: HBASE-3743 > URL: https://issues.apache.org/jira/browse/HBASE-3743 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: Joep Rottinghuis > > Add the ability to throttle major compaction. > For those use cases when a stop-the-world approach is not practical, it is > useful to be able to throttle the impact that major compaction has on the > cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3743) Throttle major compaction
[ https://issues.apache.org/jira/browse/HBASE-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016694#comment-13016694 ] stack commented on HBASE-3743: -- As a workaround, we could run a script external to hbase that would first elicted the set of regions in a cluster and then per region, set in motion a major compaction waiting on completion before moving to the next region (Script could check hdfs and count storefiles in the region to figure completion of region major compaction). The script could be run from cron or, as per the painting of the golden gate legend, once we'd gotten to the end of the bridge/table, we would loop around and start in again on the first region, in perpetuum. > Throttle major compaction > - > > Key: HBASE-3743 > URL: https://issues.apache.org/jira/browse/HBASE-3743 > Project: HBase > Issue Type: Improvement > Components: regionserver >Reporter: Joep Rottinghuis > > Add the ability to throttle major compaction. > For those use cases when a stop-the-world approach is not practical, it is > useful to be able to throttle the impact that major compaction has on the > cluster. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
