[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Attachment: HIVE-11595.04.patch Some more small fixes from metastore branch. ORC allocates a new buffer so patch 03 code works on normal path, but in case of non-0 position it breaks (i.e. when footer comes from HBase response w/o copy). This fixes these issues. > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-10595.patch, HIVE-11595.01.patch, > HIVE-11595.02.patch, HIVE-11595.03.patch, HIVE-11595.04.patch > > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Attachment: HIVE-11595.03.patch rebased the patch > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-10595.patch, HIVE-11595.01.patch, > HIVE-11595.02.patch, HIVE-11595.03.patch > > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Attachment: HIVE-11595.02.patch Updated patch > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-10595.patch, HIVE-11595.01.patch, > HIVE-11595.02.patch > > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Attachment: HIVE-11595.01.patch Some more changes on top > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-10595.patch, HIVE-11595.01.patch > > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Attachment: HIVE-10595.patch [~prasanth_j] can you take a look? > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-10595.patch > > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11595) refactor ORC footer reading to make it usable from outside
[ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11595: Description: If ORC footer is read from cache, we want to parse it without having the reader, opening a file, etc. I thought it would be as simple as protobuf parseFrom bytes, but apparently there's bunch of stuff going on there. It needs to be accessible via something like parseFrom(ByteBuffer), or similar. (was: If ORC footer is read from cache, we want to parse it without having the reader, opening a file, etc. I thought it would be as simple as protobuf parseFrom bytes, but apparently there's bunch of stuff going on there.) > refactor ORC footer reading to make it usable from outside > -- > > Key: HIVE-11595 > URL: https://issues.apache.org/jira/browse/HIVE-11595 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > > If ORC footer is read from cache, we want to parse it without having the > reader, opening a file, etc. I thought it would be as simple as protobuf > parseFrom bytes, but apparently there's bunch of stuff going on there. It > needs to be accessible via something like parseFrom(ByteBuffer), or similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
