[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2018-02-01 Thread Henrique dos Santos Goulart (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349550#comment-16349550 ] Henrique dos Santos Goulart commented on SPARK-10063: - There is any a

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097479#comment-16097479 ] Apache Spark commented on SPARK-10063: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2017-07-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094610#comment-16094610 ] Apache Spark commented on SPARK-10063: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2017-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15852170#comment-15852170 ] Apache Spark commented on SPARK-10063: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644092#comment-15644092 ] Steve Loughran commented on SPARK-10063: HADOOP-13786 covers adding a committer f

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-10-13 Thread Chirag Vaya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574339#comment-15574339 ] Chirag Vaya commented on SPARK-10063: - [~mkim] Can you please tell us in what environ

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-10-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549570#comment-15549570 ] Yin Huai commented on SPARK-10063: -- Thanks! Seems https://issues.apache.org/jira/browse/

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-10-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548557#comment-15548557 ] Steve Loughran commented on SPARK-10063: Looking at the git logs to see which cod

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-10-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547216#comment-15547216 ] Yin Huai commented on SPARK-10063: -- [~ste...@apache.org] I took a quick look at hadoop 1

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-10-03 Thread Ai Deng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543412#comment-15543412 ] Ai Deng commented on SPARK-10063: - You can add this line for your SparkContext, and this

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-09-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490023#comment-15490023 ] Steve Loughran commented on SPARK-10063: Amazon EMR's s3 is its own codebase; afr

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-09-13 Thread Mayank Shete (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486990#comment-15486990 ] Mayank Shete commented on SPARK-10063: -- How can you achieve this in AWS EMR 5.0 whil

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410870#comment-15410870 ] Steve Loughran commented on SPARK-10063: The solution for this is going to be s3g

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-08-03 Thread Andy Dang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405663#comment-15405663 ] Andy Dang commented on SPARK-10063: --- What's the alternative for this? Because we rely o

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-07-14 Thread Matt Martin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377301#comment-15377301 ] Matt Martin commented on SPARK-10063: - For what it's worth, I gather that the Netflix

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15231465#comment-15231465 ] Reynold Xin commented on SPARK-10063: - I think Josh et al already replied -- but to c

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-07 Thread Mingyu Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229953#comment-15229953 ] Mingyu Kim commented on SPARK-10063: [~rxin], can you clarify why this is a problem e

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229880#comment-15229880 ] Steve Loughran commented on SPARK-10063: The problem with returning to the classi

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229679#comment-15229679 ] Apache Spark commented on SPARK-10063: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229675#comment-15229675 ] Reynold Xin commented on SPARK-10063: - Note that since this is a problem when there a

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-04-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221551#comment-15221551 ] Steve Loughran commented on SPARK-10063: I should add that as the default committ

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-02-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172654#comment-15172654 ] Steve Loughran commented on SPARK-10063: sorry! HADOOP-9565 > Remove DirectParqu

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-02-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172277#comment-15172277 ] Yin Huai commented on SPARK-10063: -- [~steve_l] Seems HADOOP-9545 is not the right jira?

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-02-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171744#comment-15171744 ] Steve Loughran commented on SPARK-10063: The fault is having speculation turned o