[ 
https://issues.apache.org/jira/browse/KYLIN-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongbin ma updated KYLIN-1500:
------------------------------
    Fix Version/s: v1.5.1
                   v1.4.0

> streaming_fillgap cause out of memory
> -------------------------------------
>
>                 Key: KYLIN-1500
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1500
>             Project: Kylin
>          Issue Type: Improvement
>          Components: streaming
>    Affects Versions: v1.4.0
>            Reporter: qianqiaoneng
>            Assignee: Zhong Yanghong
>             Fix For: v1.4.0, v1.5.1
>
>         Attachments: split_large_gap_for_streaming_fillgap_1_4_rc.patch, 
> split_large_gap_for_streaming_fillgap_master.patch
>
>
> streaming_fillgap.sh will try to fill gap when there is some error of the 
> streaming job. But no matter how long the gap it is, how big the missing data 
> it is, kylin tried to fill gap in one thread, which sometimes cause out of 
> memory error. Need streaming_fillgap.sh to be more intelligent based on gap 
> time range and data volume. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to