[
https://issues.apache.org/jira/browse/ACCUMULO-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Tubbs resolved ACCUMULO-4066.
-----------------------------------------
Resolution: Fixed
Marking this as fixed for now, in prep for 1.6.5 release. New tests for
IteratorUtil can be done in a separate ticket, if necessary.
> Conditional mutation processing performance could be improved.
> --------------------------------------------------------------
>
> Key: ACCUMULO-4066
> URL: https://issues.apache.org/jira/browse/ACCUMULO-4066
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Affects Versions: 1.6.4, 1.7.0
> Reporter: Keith Turner
> Assignee: Keith Turner
> Fix For: 1.6.5, 1.7.1, 1.8.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> When processing conditional mutations tablets reads are done. The way the
> current implementation does tablet reads has a lot of overhead. For each
> condition the following is done :
> * Opens and reserves iterators files.
> * Parse table iterators from table config (involves scanning and filtering
> entire table config)
> * Merges condition iterators and table iterators
> * Constructs iterator stack.
> I created a branch where these operations (except for constructing iterator
> stack) are done per tablet and/or per batch of conditional mutations. Doing
> this I am seeing a 3x speed up in conditional mutation processing rates when
> data is cached.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
