[
https://issues.apache.org/jira/browse/SPARK-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074045#comment-14074045
]
Patrick Wendell commented on SPARK-2618:
----------------------------------------
We shouldn't should expose these types of hooks into the scheduler internals.
The TaskSet, for instance, is an implementation detail we don't want to be part
of a public API and the priority is an internal concept.
The public API of Spark for scheduling policies is the Fair Scheduler. Many
different types of policies can be achieved within Fair Scheduling, including
having a high priority pool to which tasks are submitted.
> use config spark.scheduler.priority for specifying TaskSet's priority on
> DAGScheduler
> -------------------------------------------------------------------------------------
>
> Key: SPARK-2618
> URL: https://issues.apache.org/jira/browse/SPARK-2618
> Project: Spark
> Issue Type: Improvement
> Reporter: Lianhui Wang
>
> we use shark server to do interative query. every sql run with a job.
> sometimes we want to immediately run a query that later be submitted to shark
> server. so we need to provide user to define a job's priority and ensure that
> high priority job can be firstly launched.
> i have created a pull request: https://github.com/apache/spark/pull/1528
--
This message was sent by Atlassian JIRA
(v6.2#6252)
