[
https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099923#comment-16099923
]
Stavros Kontopoulos edited comment on SPARK-15142 at 7/25/17 11:59 AM:
-----------------------------------------------------------------------
[~devaraj.k] Great, so one question to clarify things, if the dispatcher is
running and then the master is restarted,
a DRIVER_ABORTED is fired and its handled properly? In that PR you mention it
says: "I think we need to throw the exception and shutdown the dispatcher." and
so later some other PRs like (https://github.com/apache/spark/pull/13072)
handle the shutdown process is that right?
In your PR(https://github.com/apache/spark/pull/13143/files) I see you throw
the exception only when you start the dispatcher and things fail.
was (Author: skonto):
[~devaraj.k] Great, so one question to clarify things, if the dispatcher is
running and then the master is restarted,
a DRIVER_ABORTED is fired and its handled properly? In that PR you mention it
says: "I think we need to throw the exception and shutdown the dispatcher." and
so later some other PRs like (https://github.com/apache/spark/pull/13072)
handle the shutdown process is that right?
> Spark Mesos dispatcher becomes unusable when the Mesos master restarts
> ----------------------------------------------------------------------
>
> Key: SPARK-15142
> URL: https://issues.apache.org/jira/browse/SPARK-15142
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Mesos
> Reporter: Devaraj K
> Priority: Minor
> Attachments:
> spark-devaraj-org.apache.spark.deploy.mesos.MesosClusterDispatcher-1-stobdtserver5.out
>
>
> While Spark Mesos dispatcher running if the Mesos master gets restarted then
> Spark Mesos dispatcher will keep running and queues up all the submitted
> applications and will not launch them.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
