[
https://issues.apache.org/jira/browse/ORC-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated ORC-255:
---------------------------
Description:
When ORC was split out of Hive the reading and writing of ACID files was left
in Hive. This blocks non-Hive users from reading or writing ACID. I propose
to add support for ACID to ORC.
At this point I only propose to add support for ACID 2 (that is, the version
that will be released in Hive 3, which simplifies the storage to have only
inserts and deletes (updates are an insert plus a delete)). Also, I am
initially at least just adding support via the vector batch interface, not the
row by row interface.
Also, note that to use this readers and writers would still have to interact
with the Hive metastore to get a list of valid transactions and acquire
appropriate locks.
was:
When ORC was split out of Hive the reading and writing of ACID files was left
in Hive. This blocks non-Hive users from reading or writing ACID. I propose
to add support for ACID to ORC.
At this point I only propose to add support for ACID 2 (that is, the version
that will be released in Hive 3, which simplifies the storage to have only
inserts and deletes (updates are an insert plus a delete)).
Also, note that to use this readers and writers would still have to interact
with the Hive metastore to get a list of valid transactions and acquire
appropriate locks.
> Add support for reading ACID2 files to ORC
> ------------------------------------------
>
> Key: ORC-255
> URL: https://issues.apache.org/jira/browse/ORC-255
> Project: ORC
> Issue Type: New Feature
> Components: ACID
> Reporter: Alan Gates
> Assignee: Alan Gates
>
> When ORC was split out of Hive the reading and writing of ACID files was left
> in Hive. This blocks non-Hive users from reading or writing ACID. I propose
> to add support for ACID to ORC.
> At this point I only propose to add support for ACID 2 (that is, the version
> that will be released in Hive 3, which simplifies the storage to have only
> inserts and deletes (updates are an insert plus a delete)). Also, I am
> initially at least just adding support via the vector batch interface, not
> the row by row interface.
> Also, note that to use this readers and writers would still have to interact
> with the Hive metastore to get a list of valid transactions and acquire
> appropriate locks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
