Lars Hofhansl created PHOENIX-1701:
--------------------------------------

             Summary: Adapt guidepost selection at compile time
                 Key: PHOENIX-1701
                 URL: https://issues.apache.org/jira/browse/PHOENIX-1701
             Project: Phoenix
          Issue Type: Improvement
            Reporter: Lars Hofhansl


Currently we tweak the guide post width for the partition size we want - for 
example it just changed to 100mb to 300mb because FAST_DIFF is used by default.

Instead it might better to collect more guideposts (maybe even as low as every 
10mb) and then combine them at compile time into larger chunks.
If we store them correctly the adjacent guideposts would be stored in order in 
the stats table and hence we would scan that table until we have a size we want 
(in terms of chunk size).

The more information we have, the better, we can combine smaller guideposts, 
but we cannot split larger ones because we lack information.

Just filing as a brainstorming issue for debate.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to