[ 
https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291349#comment-14291349
 ] 

Jesper Lundgren commented on SPARK-4986:
----------------------------------------

[~srowen] The current patch I have does not address this issue, but looking at 
the code I think a check for eventActor == null might do the trick.

"  // eventActor is created when generator starts.
  // This not being null means the scheduler has been started and not stopped
  private var eventActor: ActorRef = null
"

> Graceful shutdown for Spark Streaming does not work in Standalone cluster mode
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-4986
>                 URL: https://issues.apache.org/jira/browse/SPARK-4986
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.2.0
>            Reporter: Jesper Lundgren
>             Fix For: 1.3.0, 1.2.1
>
>
> When using the graceful stop API of Spark Streaming in Spark Standalone 
> cluster the stop signal never reaches the receivers. I have tested this with 
> Spark 1.2 and Kafka receivers. 
> ReceiverTracker will send StopReceiver message to ReceiverSupervisorImpl.
> In local mode ReceiverSupervisorImpl receives this message but in Standalone 
> cluster mode the message seems to be lost.
> (I have modified the code to send my own string message as a stop signal from 
> ReceiverTracker to ReceiverSupervisorImpl and it works as a workaround.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to