[
https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833743#comment-16833743
]
Gabor Somogyi commented on SPARK-27634:
---------------------------------------
[~yuwang0...@gmail.com] I think one should use temporary checkpoint location.
In Spark 3.0 this can be force deleted with
"spark.sql.streaming.forceDeleteTempCheckpointLocation".
> deleteCheckpointOnStop should be configurable
> ---------------------------------------------
>
> Key: SPARK-27634
> URL: https://issues.apache.org/jira/browse/SPARK-27634
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.4.2
> Reporter: Yu Wang
> Priority: Minor
> Attachments: SPARK-27634.patch
>
>
> we need to delete checkpoint file after running the stream application
> multiple times, so deleteCheckpointOnStop should be configurable
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
