[
https://issues.apache.org/jira/browse/ACCUMULO-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238576#comment-15238576
]
ASF GitHub Bot commented on ACCUMULO-4187:
------------------------------------------
Github user joshelser commented on a diff in the pull request:
https://github.com/apache/accumulo/pull/90#discussion_r59490771
--- Diff:
server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java ---
@@ -3089,4 +3093,20 @@ public void removeBulkImportState(List<String>
files) {
bulkImportStatus.removeBulkImportStatus(files);
}
+ private static final String MAJC_READ_LIMITER_KEY = "tserv_majc_read";
+ private static final String MAJC_WRITE_LIMITER_KEY = "tserv_majc_write";
+ private final Callable<Long> rateProvider = new Callable<Long>() {
+ @Override
+ public Long call() throws Exception {
+ return
getConfiguration().getMemoryInBytes(Property.TSERV_MAJC_THROUGHPUT);
+ }
+ };
+
+ public final RateLimiter getMajorCompactionReadLimiter() {
--- End diff --
Javadoc, please
> Rate limiting of major compactions
> ----------------------------------
>
> Key: ACCUMULO-4187
> URL: https://issues.apache.org/jira/browse/ACCUMULO-4187
> Project: Accumulo
> Issue Type: Improvement
> Components: core, tserver
> Affects Versions: 1.8.0
> Reporter: Shawn Walker
> Assignee: Shawn Walker
> Priority: Minor
> Fix For: 1.8.0
>
>
> In discussing [ACCUMULO-4166] with Keith Turner, we decided that the
> underlying issue is that major compactions can overwhelm a tablet server,
> rendering it nearly unresponsive.
> To address this, we should take a cue from Apache Cassandra and restrict how
> quickly we perform major compactions. Rate limiting reads and writes
> involved in major compactions will directly affect the IO load caused by
> major compactions, and should also indirectly affect the CPU load.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
