[ 
https://issues.apache.org/jira/browse/KYLIN-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18128570#comment-18128570
 ] 

ASF subversion and git services commented on KYLIN-6087:
--------------------------------------------------------

Commit 705dd08bcded09a64a2b7092929ac34132c5dd5b in kylin's branch 
refs/heads/kylin5 from huangsheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=705dd08bcd ]

[KYLIN-6087] Support built-in auto scheduled segment build with model-level 
config and scheduler

* feat(model): add built-in auto scheduled segment build with model-level 
config and scheduler

* feat(model): add built-in auto scheduled segment build with model-level 
config and scheduler

* fix forbidden check

* refactor(model): use dispatcher for automatic segment builds

* fix(model): address auto segment build review comments

* fix(model): harden auto segment build dispatching

Add a project-level dispatcher switch and evaluate the latest due schedule 
cycle on each scan. Handle covered, overlapping, blocked, and retryable segment 
build states by target range.

> Support built-in auto scheduled segment build with model-level config
> ---------------------------------------------------------------------
>
>                 Key: KYLIN-6087
>                 URL: https://issues.apache.org/jira/browse/KYLIN-6087
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Job Engine
>    Affects Versions: 5.0.3
>            Reporter: huangsheng
>            Assignee: huangsheng
>            Priority: Minor
>
> Currently, in kylin, incremental segment build job can only be triggered 
> manually. I would like to add an automatic timed trigger for segment build 
> job function because now we all rely on external timing tools (such as 
> crontab) to call the kylin incremental build api at regular intervals to 
> start segment construction. For example, the build job of yesterday's segment 
> is triggered at 1 a.m. every day
> I want to directly incorporate this function into kylin. My idea is to add a 
> new entry for scheduled scheduling in the model configuration pop-up box. It 
> is necessary to configure the daily trigger time and the time range for 
> building this segment. There are two parameters to configure for the time 
> range. One is the logical date, such as yesterday
> The day before yesterday, etc., one is a specific time, for example, from 
> 0:00 to 24:00. Then the back end schedules build tasks at regular intervals 
> based on this configuration.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to