[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704534#comment-14704534
]
Littlestar commented on SPARK-2883:
---
spark 1.4.1: The orc file writer relies on
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705073#comment-14705073
]
Yin Huai commented on SPARK-2883:
-
Yeah. It is because ORC is still a part of Hive in our
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603166#comment-14603166
]
Zhan Zhang commented on SPARK-2883:
---
[~philclaridge] Please refer to the test case in
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603187#comment-14603187
]
Yin Huai commented on SPARK-2883:
-
You can use DataFrameWriter
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603507#comment-14603507
]
Phil Claridge commented on SPARK-2883:
--
Took your data frame.write.format sample and
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603164#comment-14603164
]
Zhan Zhang commented on SPARK-2883:
---
[~biao luo] saveAsOrcFile and orcFile is not
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603554#comment-14603554
]
Michael Armbrust commented on SPARK-2883:
-
Usage questions should probably go to
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603505#comment-14603505
]
Phil Claridge commented on SPARK-2883:
--
Please can you provide link to text case?
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603669#comment-14603669
]
Zhan Zhang commented on SPARK-2883:
---
[~philclaridge]
I try the spark-shell in local
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602622#comment-14602622
]
Phil Claridge commented on SPARK-2883:
--
Unable to run with Spark 1.4. Can not find
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601273#comment-14601273
]
biao luo commented on SPARK-2883:
-
peopleSchemaRDD.saveAsOrcFile(people.orc)
val orcFile =
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601275#comment-14601275
]
biao luo commented on SPARK-2883:
-
peopleSchemaRDD.saveAsOrcFile(people.orc)
val orcFile =
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546394#comment-14546394
]
Patrick Wendell commented on SPARK-2883:
Since this is a feature I'm going to drop
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14545802#comment-14545802
]
Apache Spark commented on SPARK-2883:
-
User 'liancheng' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542903#comment-14542903
]
Apache Spark commented on SPARK-2883:
-
User 'zhzhan' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393141#comment-14393141
]
Zhan Zhang commented on SPARK-2883:
---
Following code demonstrate the usage of the orc
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387532#comment-14387532
]
Apache Spark commented on SPARK-2883:
-
User 'zhzhan' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255079#comment-14255079
]
Apache Spark commented on SPARK-2883:
-
User 'scwf' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215643#comment-14215643
]
Apache Spark commented on SPARK-2883:
-
User 'scwf' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195301#comment-14195301
]
René X Parra commented on SPARK-2883:
-
[~marmbrus] I see this was changed from Version
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195308#comment-14195308
]
Michael Armbrust commented on SPARK-2883:
-
The merge deadline for 1.2.0 was on
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195427#comment-14195427
]
Zhan Zhang commented on SPARK-2883:
---
[~neoword] , As [~marmbrus] mentioned, the PR need
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172917#comment-14172917
]
Fi commented on SPARK-2883:
---
This sounds great!
Is this a scala only patch, or would it also
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173269#comment-14173269
]
Zhan Zhang commented on SPARK-2883:
---
It is scala patch, and I am not very familiar with
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14171654#comment-14171654
]
Zhan Zhang commented on SPARK-2883:
---
I almost finished the prototype, and following is
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137759#comment-14137759
]
Zhan Zhang commented on SPARK-2883:
---
I am starting to prototyping the last feature with
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136102#comment-14136102
]
Zhan Zhang commented on SPARK-2883:
---
There are several features to be supported. 1st:
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136407#comment-14136407
]
Michael Armbrust commented on SPARK-2883:
-
#1 should be easy, that information is
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136455#comment-14136455
]
Yin Huai commented on SPARK-2883:
-
The column projection issue is actually a bug. Because
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136478#comment-14136478
]
Yin Huai commented on SPARK-2883:
-
I have created
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136481#comment-14136481
]
Zhan Zhang commented on SPARK-2883:
---
Sorry, I mean column pruning. Currently what I see
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136521#comment-14136521
]
Yin Huai commented on SPARK-2883:
-
Oh, seems types (including field names) of the
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132472#comment-14132472
]
Fi commented on SPARK-2883:
---
I was able to run a simple query and access my ORC hive table
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118921#comment-14118921
]
Michael Armbrust commented on SPARK-2883:
-
Can you elaborate on what you mean
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099275#comment-14099275
]
Zhan Zhang commented on SPARK-2883:
---
Spark with Hive12 can operate Orc table through
35 matches
Mail list logo