[jira] [Commented] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-16 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266704#comment-17266704
 ] 

Apache Spark commented on SPARK-34142:
--

User 'dongjoon-hyun' has created a pull request for this issue:
https://github.com/apache/spark/pull/31215

> Support Fallback Storage Cleanup during stopping SparkContext
> -
>
> Key: SPARK-34142
> URL: https://issues.apache.org/jira/browse/SPARK-34142
> Project: Spark
>  Issue Type: New Feature
>  Components: Spark Core
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Priority: Major
>
> SPARK-33545 added `Support Fallback Storage during worker decommission` for 
> the managed cloud-storage with TTL support. This issue aims to add additional 
> clean-up feature during stopping SparkContext to save some money before TTL 
> or the other HDFS-compatible storage which doesn't have TTL support.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-16 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266703#comment-17266703
 ] 

Apache Spark commented on SPARK-34142:
--

User 'dongjoon-hyun' has created a pull request for this issue:
https://github.com/apache/spark/pull/31215

> Support Fallback Storage Cleanup during stopping SparkContext
> -
>
> Key: SPARK-34142
> URL: https://issues.apache.org/jira/browse/SPARK-34142
> Project: Spark
>  Issue Type: New Feature
>  Components: Spark Core
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Priority: Major
>
> SPARK-33545 added `Support Fallback Storage during worker decommission` for 
> the managed cloud-storage with TTL support. This issue aims to add additional 
> clean-up feature during stopping SparkContext to save some money before TTL 
> or the other HDFS-compatible storage which doesn't have TTL support.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org