[jira] [Updated] (SPARK-45463) Allow ShuffleDriverComponent to support reliable store with specified executorId

2023-10-08 Thread zhoubin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoubin updated SPARK-45463: Summary: Allow ShuffleDriverComponent to support reliable store with specified executorId (was: Allow

[jira] [Updated] (SPARK-45463) Allow ShuffleDriverComponent to decide weather shuffle data is reliably stored when different stage has different policy

2023-10-08 Thread zhoubin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoubin updated SPARK-45463: Description: After SPARK-42689, ShuffleDriverComponent.supportsReliableStorage is determined globally.

[jira] [Created] (SPARK-45463) Allow ShuffleDriverComponent to decide weather shuffle data is reliably stored when different stage has different policy

2023-10-08 Thread zhoubin (Jira)
zhoubin created SPARK-45463: --- Summary: Allow ShuffleDriverComponent to decide weather shuffle data is reliably stored when different stage has different policy Key: SPARK-45463 URL:

[jira] [Commented] (SPARK-37493) expose driver gc time and duration time

2021-11-29 Thread zhoubin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450822#comment-17450822 ] zhoubin commented on SPARK-37493: - Issue resolved by pull request 34749

[jira] [Updated] (SPARK-37493) expose driver gc time and duration time

2021-11-29 Thread zhoubin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoubin updated SPARK-37493: Summary: expose driver gc time and duration time (was: expose driver gc time) > expose driver gc time

[jira] [Created] (SPARK-37493) expose driver gc time

2021-11-29 Thread zhoubin (Jira)
zhoubin created SPARK-37493: --- Summary: expose driver gc time Key: SPARK-37493 URL: https://issues.apache.org/jira/browse/SPARK-37493 Project: Spark Issue Type: Improvement Components: