hongbin ma created KYLIN-1210:
---------------------------------

             Summary: Allowing segment overlap to solve streaming data 
completeness
                 Key: KYLIN-1210
                 URL: https://issues.apache.org/jira/browse/KYLIN-1210
             Project: Kylin
          Issue Type: Improvement
            Reporter: hongbin ma
            Assignee: hongbin ma


Previously cube segments in one cube are not allowed to overlap with each 
other. This constraint to more intuitive and simple to maintain. This 
constraint makes cube segments immutable, which is acceptable in batch cubing 
scenarios.

In streaming cubing scenarios, however, there may exist late coming data due to 
upstream latencies. It's best we can still consume those late data rather than 
simply ignore it. To accomplish this we have to relief the above constraint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to