[jira] [Assigned] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-17 Thread Dongjoon Hyun (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dongjoon Hyun reassigned SPARK-34142:
-

Assignee: Dongjoon Hyun

> Support Fallback Storage Cleanup during stopping SparkContext
> -
>
> Key: SPARK-34142
> URL: https://issues.apache.org/jira/browse/SPARK-34142
> Project: Spark
>  Issue Type: New Feature
>  Components: Spark Core
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
>
> SPARK-33545 added `Support Fallback Storage during worker decommission` for 
> the managed cloud-storage with TTL support. This issue aims to add additional 
> clean-up feature during stopping SparkContext to save some money before TTL 
> or the other HDFS-compatible storage which doesn't have TTL support.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-16 Thread Apache Spark (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-34142:


Assignee: Apache Spark

> Support Fallback Storage Cleanup during stopping SparkContext
> -
>
> Key: SPARK-34142
> URL: https://issues.apache.org/jira/browse/SPARK-34142
> Project: Spark
>  Issue Type: New Feature
>  Components: Spark Core
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Assignee: Apache Spark
>Priority: Major
>
> SPARK-33545 added `Support Fallback Storage during worker decommission` for 
> the managed cloud-storage with TTL support. This issue aims to add additional 
> clean-up feature during stopping SparkContext to save some money before TTL 
> or the other HDFS-compatible storage which doesn't have TTL support.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-34142) Support Fallback Storage Cleanup during stopping SparkContext

2021-01-16 Thread Apache Spark (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-34142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-34142:


Assignee: (was: Apache Spark)

> Support Fallback Storage Cleanup during stopping SparkContext
> -
>
> Key: SPARK-34142
> URL: https://issues.apache.org/jira/browse/SPARK-34142
> Project: Spark
>  Issue Type: New Feature
>  Components: Spark Core
>Affects Versions: 3.2.0
>Reporter: Dongjoon Hyun
>Priority: Major
>
> SPARK-33545 added `Support Fallback Storage during worker decommission` for 
> the managed cloud-storage with TTL support. This issue aims to add additional 
> clean-up feature during stopping SparkContext to save some money before TTL 
> or the other HDFS-compatible storage which doesn't have TTL support.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org