[ 
https://issues.apache.org/jira/browse/HIVE-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13843918#comment-13843918
 ] 

Carl Steinbach commented on HIVE-5783:
--------------------------------------

bq. on the parquet-hive side, we're good to submit a new patch with direct 
serde integration

:)

bq. I humbly submit that the two are not linked and one should not impede the 
other.

I agree. It wasn't my intention to imply that these issues were linked. Sorry 
if that wasn't clear.

In addition to the SerDe can please also include some test cases? I think it 
would be good to aim for coverage on par with what was provided with OrcFile. 
Also, the data/files directory contains two files (alltypes.txt and 
alltypesorc) which will make testing type support a lot easier.

> Native Parquet Support in Hive
> ------------------------------
>
>                 Key: HIVE-5783
>                 URL: https://issues.apache.org/jira/browse/HIVE-5783
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Justin Coffey
>            Assignee: Justin Coffey
>            Priority: Minor
>             Fix For: 0.11.0
>
>         Attachments: HIVE-5783.patch, hive-0.11-parquet.patch
>
>
> Problem Statement:
> Hive would be easier to use if it had native Parquet support. Our 
> organization, Criteo, uses Hive extensively. Therefore we built the Parquet 
> Hive integration and would like to now contribute that integration to Hive.
> About Parquet:
> Parquet is a columnar storage format for Hadoop and integrates with many 
> Hadoop ecosystem tools such as Thrift, Avro, Hadoop MapReduce, Cascading, 
> Pig, Drill, Crunch, and Hive. Pig, Crunch, and Drill all contain native 
> Parquet integration.
> Changes Details:
> Parquet was built with dependency management in mind and therefore only a 
> single Parquet jar will be added as a dependency.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Reply via email to