[
https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13544237#comment-13544237
]
Jakob Homan commented on HIVE-3585:
-----------------------------------
bq. Will Trevni but just another Serde/inputFormat combination of will it
involve large scale changes to hive?
Just another serde/inputformat combination. In fact, for Avro-wrapped Trevni,
it'll just be AvroSerde + Trevni{I|O}Format. For raw Trevni data it'll just be
TrevniSerde + (probably) (?Raw)Trevni{I|O}Format. This is not a big patch and
doesn't require any more changes to Hive than AvroSerde did - none at all. As
I mentioned above, a veto on this can't be sustained on technical grounds, so
I'm happy to re-assure He as to his concerns, but I don't see any reason not to
proceed.
bq. I did not get why it does not work with partition schema update.
I didn't want to try to mix Avro-style schemas and Trevni-style schemas, but
Mark has a way around that.
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
> Key: HIVE-3585
> URL: https://issues.apache.org/jira/browse/HIVE-3585
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
> Affects Versions: 0.10.0
> Reporter: alex gemini
> Assignee: Mark Wagner
> Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format
> need a columnar SerDe,seems fastutil is a good choice.the shark project use
> fastutil library as columnar serde library but it seems too large (almost
> 15m) for just a few primitive array collection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
