[
https://issues.apache.org/jira/browse/GRIFFIN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750567#comment-16750567
]
William Guo commented on GRIFFIN-220:
-------------------------------------
make sense, we need to optimize this , reviewing code.
> Livy concurrent submission queue
> --------------------------------
>
> Key: GRIFFIN-220
> URL: https://issues.apache.org/jira/browse/GRIFFIN-220
> Project: Griffin (Incubating)
> Issue Type: Improvement
> Components: timeliness-batch
> Reporter: Yang
> Priority: Minor
>
> Hi William and Lionel：
> Problem：
> Too many tasks submitted at the same time, resulting in failure of livy's
> submission job
> Optimization thinking:
> In view of the shortage of cluster resources caused by too many jobs
> submitted at the same time.We increase Livy submission job queue, when Livy
> submits,queues are increased, producer-consumer mode is adopted, and the
> number of jobs submitted is limited. When one job is completed, the next job
> is executed.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
