[
https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033089#comment-16033089
]
Xuefu Zhang commented on HIVE-16799:
------------------------------------
Test failures seems unrelated. [~lirui], could you please review since you
reviewed HIVE-16552? Thanks.
> Control the max number of task for a stage in a spark job
> ---------------------------------------------------------
>
> Key: HIVE-16799
> URL: https://issues.apache.org/jira/browse/HIVE-16799
> Project: Hive
> Issue Type: Improvement
> Reporter: Xuefu Zhang
> Assignee: Xuefu Zhang
> Attachments: HIVE-16799.patch
>
>
> HIVE-16552 gives admin an option to control the maximum number of tasks a
> Spark job may have. However, this may not be sufficient as this tends to
> penalize jobs that have many stages while favoring jobs that has fewer
> stages. Ideally, we should also limit the number of tasks in a stage, which
> is closer to the maximum number of mappers or reducers in a MR job.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
