[
https://issues.apache.org/jira/browse/LENS-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867659#comment-15867659
]
Rajat Khandelwal commented on LENS-974:
---------------------------------------
One way is to use external recursion, in which we'll only populate segmentation
candidates and keep them as a black box untill the end. We'll try to open the
black box at the end if no other types of candidates are found. So there will
be a resolver at the end which will open all segmentation candidates and prune
them recursively. We don't even need to populate the candidates before, we can
populate the segmentations in this phase itself. In this phase, we won't
`process all and prune some`. We'll sort them by a notion of `cost of
processing` and process them in that order, forwarding the first one that
doesn't fail ahead as the chosen candidate. This will save processing time,
since we'll not open all black boxes, but minimal ones, and that too as a last
resort. We can't open the black box any other time before the `end`, for let's
assume the `opening of black box` is inserted between `r1` and `r2`. Then
whatever `r2` does on normal candidates, has already been done for complex
candidates before `r2` even starts. So we'll need careful consideration for
partitioning the resolvers as `before-open-segmentation-candidates` and
`after-open-segmentation-candidates` to make sure that all the `after`
resolvers don't do anything meaningful that can be used in the recursive step.
> Add cube-segmentation for base cube
> -----------------------------------
>
> Key: LENS-974
> URL: https://issues.apache.org/jira/browse/LENS-974
> Project: Apache Lens
> Issue Type: New Feature
> Components: cube
> Reporter: Sushil Mohanty
>
> With cube segmentation a cube can have multiple cubes and all these child
> cubes together will make the cube complete.
> CubeSegmentation and CubeFactTable will sit together, which means it can
> belong to only one base cube. A base cube can have one or more cube
> segmentations. Fields of segmentation will be intersection of all columns of
> its cubes. Segmentation will have weight to compare with its buddies (facts
> or other segmentations). Also it can have start and end time defined or it
> can derive from its underline facts.
> eg:
> base_cube
> |_fact1
> |_fact2
> |_cube_segment1
> |_cube1
> |_fact_11
> |_fact_12
> ...
> ...
> |_cube_segment2
> |_cube2
> |_fact_21
> |_fact_22
> ...
> ...
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
