[jira] [Commented] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully

2018-09-20 Thread Apache Spark (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-25472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622830#comment-16622830
 ] 

Apache Spark commented on SPARK-25472:
--

User 'brkyvz' has created a pull request for this issue:
https://github.com/apache/spark/pull/22478

> Structured Streaming query.stop() doesn't always stop gracefully
> 
>
> Key: SPARK-25472
> URL: https://issues.apache.org/jira/browse/SPARK-25472
> Project: Spark
>  Issue Type: Bug
>  Components: Structured Streaming
>Affects Versions: 2.4.0
>Reporter: Burak Yavuz
>Assignee: Burak Yavuz
>Priority: Major
> Fix For: 2.5.0
>
>
> We can have race conditions where the cancelling of Spark jobs will throw a 
> SparkException when stopping a streaming query. This SparkException specifies 
> that the job was cancelled. We can use this error message to swallow the 
> error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully

2018-09-20 Thread Burak Yavuz (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-25472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622828#comment-16622828
 ] 

Burak Yavuz commented on SPARK-25472:
-

Resolved by https://github.com/apache/spark/pull/22478

> Structured Streaming query.stop() doesn't always stop gracefully
> 
>
> Key: SPARK-25472
> URL: https://issues.apache.org/jira/browse/SPARK-25472
> Project: Spark
>  Issue Type: Bug
>  Components: Structured Streaming
>Affects Versions: 2.4.0
>Reporter: Burak Yavuz
>Assignee: Burak Yavuz
>Priority: Major
> Fix For: 2.5.0
>
>
> We can have race conditions where the cancelling of Spark jobs will throw a 
> SparkException when stopping a streaming query. This SparkException specifies 
> that the job was cancelled. We can use this error message to swallow the 
> error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully

2018-09-20 Thread Apache Spark (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-25472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622827#comment-16622827
 ] 

Apache Spark commented on SPARK-25472:
--

User 'brkyvz' has created a pull request for this issue:
https://github.com/apache/spark/pull/22478

> Structured Streaming query.stop() doesn't always stop gracefully
> 
>
> Key: SPARK-25472
> URL: https://issues.apache.org/jira/browse/SPARK-25472
> Project: Spark
>  Issue Type: Bug
>  Components: Structured Streaming
>Affects Versions: 2.4.0
>Reporter: Burak Yavuz
>Assignee: Burak Yavuz
>Priority: Major
> Fix For: 2.5.0
>
>
> We can have race conditions where the cancelling of Spark jobs will throw a 
> SparkException when stopping a streaming query. This SparkException specifies 
> that the job was cancelled. We can use this error message to swallow the 
> error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org