[ https://issues.apache.org/jira/browse/KYLIN-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518919#comment-16518919 ]
kangkaisen commented on KYLIN-3421: ----------------------------------- OK, Thanks for your work. I will review this patch in this week. I glanced the patch, if we change the lock path from segment to job, the IT for the DistributedScheduler should be update. > Improve job scheduler fetch performance > --------------------------------------- > > Key: KYLIN-3421 > URL: https://issues.apache.org/jira/browse/KYLIN-3421 > Project: Kylin > Issue Type: Improvement > Components: Job Engine > Reporter: Zhong Yanghong > Assignee: Zhong Yanghong > Priority: Major > Attachments: APACHE-KYLIN-3421.patch > > > Currently, there are several improvements we can do for job scheduler: > * For {{DistributedScheduler}}, it does not check {{isReady()}} for > checkpoint jobs > * Since the state lots of executables fetched from HBase are not READY, it's > better to fetch their output first, which can reduce lots of get requests to > hbase > * {{FetcherRunnerWithPriority}} is not enabled in {{DistributedScheduler}}, > which needs to change the lockPath from *{color:#f79232}segmentId{color}* to > *{color:#f79232}jobId{color}* -- This message was sent by Atlassian JIRA (v7.6.3#76005)