[jira] [Commented] (SPARK-15548) Shuffle file remains with dynamic allocation on YARN

[ https://issues.apache.org/jira/browse/SPARK-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301715#comment-15301715 ] He Tianyi commented on SPARK-15548: --- Yes, but we have to restart application every few

[jira] [Created] (SPARK-15548) Shuffle file remains with dynamic allocation on YARN

He Tianyi created SPARK-15548: - Summary: Shuffle file remains with dynamic allocation on YARN Key: SPARK-15548 URL: https://issues.apache.org/jira/browse/SPARK-15548 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-1272) Don't fail job if some local directories are buggy

[ https://issues.apache.org/jira/browse/SPARK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295888#comment-15295888 ] He Tianyi commented on SPARK-1272: -- BTW, is there a good approach to skip failed disk if

[jira] [Created] (SPARK-15336) Detect and take action about executors running on corrupted nodes

He Tianyi created SPARK-15336: - Summary: Detect and take action about executors running on corrupted nodes Key: SPARK-15336 URL: https://issues.apache.org/jira/browse/SPARK-15336 Project: Spark

[jira] [Updated] (SPARK-14186) Size awareness during spill and shuffle

[ https://issues.apache.org/jira/browse/SPARK-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated SPARK-14186: -- Component/s: (was: Spark Core) Block Manager > Size awareness during spill and shu

[jira] [Created] (SPARK-14186) Size awareness during spill and shuffle

He Tianyi created SPARK-14186: - Summary: Size awareness during spill and shuffle Key: SPARK-14186 URL: https://issues.apache.org/jira/browse/SPARK-14186 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209686#comment-15209686 ] He Tianyi commented on SPARK-12194: --- Looking for OpenTSDB sink also. Would any committe

[jira] [Commented] (SPARK-14068) Pluggable DiskBlockManager

[ https://issues.apache.org/jira/browse/SPARK-14068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209624#comment-15209624 ] He Tianyi commented on SPARK-14068: --- For example: In my deployment, both SSDs and HDDs

[jira] [Created] (SPARK-14068) Pluggable DiskBlockManager

He Tianyi created SPARK-14068: - Summary: Pluggable DiskBlockManager Key: SPARK-14068 URL: https://issues.apache.org/jira/browse/SPARK-14068 Project: Spark Issue Type: New Feature Compon