[ 
https://issues.apache.org/jira/browse/ACCUMULO-112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keith Turner updated ACCUMULO-112:
----------------------------------

    Fix Version/s: 1.5.0
    
> Investigate partitioning in memory map by locality group
> --------------------------------------------------------
>
>                 Key: ACCUMULO-112
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-112
>             Project: Accumulo
>          Issue Type: Task
>          Components: tserver
>            Reporter: Keith Turner
>            Assignee: Keith Turner
>             Fix For: 1.5.0
>
>
> Currently the in memory map is not partitioned by locality group.  This could 
> negatively impact scan and minor compaction performance.    Would like to run 
> some experiments to understand the performance implications.  Partitioning by 
> locality group could negatively impact insert performance, it could go from 
> O(log(R)+log(C))  to O(L * (log(R)+log(C))) in the worst case.  L is the 
> number of locality groups, R is the number of rows and C is the number of 
> columns.  The worst case is where each mutation has a change for each 
> locality group. 
> Currently the in memory map is a map of maps.  Like the following.
> {noformat}
>   map<row, map<col, val>>
> {noformat}
> Could conceptually change this to one of the following.  The first is best 
> for scans, that access some locality groups, and minor compactions.  The 
> second is good for inserts where the mutation covers all locality groups, 
> because the row is only looked up once.
> {noformat}
>   map<localityGroup, map<row, map<col, val>>>
> {noformat}
> {noformat}
>   map<row, map<localityGroup, map<col, val>>>
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to