[jira] [Commented] (SPARK-13728) Fix ORC PPD
[ https://issues.apache.org/jira/browse/SPARK-13728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184742#comment-15184742 ] Hyukjin Kwon commented on SPARK-13728: -- I see. I found some clues. It looks https://github.com/apache/spark/pull/11509 PR make the output only single ORC file. It was 10 files but this PR writes only single file. So, this could not skip stripes in ORC. Whether it is right to write this to single file or multiple files, I think I should explicitly repartition the data. Can I maybe submit a PR for this? > Fix ORC PPD > --- > > Key: SPARK-13728 > URL: https://issues.apache.org/jira/browse/SPARK-13728 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Michael Armbrust > > Fix the ignored test "Enable ORC PPD" in OrcQuerySuite. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-13728) Fix ORC PPD
[ https://issues.apache.org/jira/browse/SPARK-13728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185463#comment-15185463 ] Michael Armbrust commented on SPARK-13728: -- That sounds like a good lead to follow! > Fix ORC PPD > --- > > Key: SPARK-13728 > URL: https://issues.apache.org/jira/browse/SPARK-13728 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Michael Armbrust > > Fix the ignored test "Enable ORC PPD" in OrcQuerySuite. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-13728) Fix ORC PPD
[ https://issues.apache.org/jira/browse/SPARK-13728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186166#comment-15186166 ] Apache Spark commented on SPARK-13728: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/11593 > Fix ORC PPD > --- > > Key: SPARK-13728 > URL: https://issues.apache.org/jira/browse/SPARK-13728 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Michael Armbrust >Assignee: Hyukjin Kwon > > Fix the ignored test "Enable ORC PPD" in OrcQuerySuite. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
