[jira] [Commented] (SPARK-8413) DirectParquetOutputCommitter doesn't clean up the file on task failure

2016-03-02 Thread Constantijn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175280#comment-15175280 ] Constantijn commented on SPARK-8413: I'm having the same issue when writing data to gs:// (google

[jira] [Commented] (SPARK-8413) DirectParquetOutputCommitter doesn't clean up the file on task failure

2016-03-01 Thread Peter Halliday (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173985#comment-15173985 ] Peter Halliday commented on SPARK-8413: --- I'm not sure exactly why we shouldn't use abortTask

[jira] [Commented] (SPARK-8413) DirectParquetOutputCommitter doesn't clean up the file on task failure

2016-02-03 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130298#comment-15130298 ] Felix Maximilian Möller commented on SPARK-8413: With 1.6.0, I ran into this problem as