[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.patch The attached patch is preliminary. And it depends on HIVE-16063. > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.5.patch > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.1.patch, HIVE-14879.2.patch, > HIVE-14879.3.patch, HIVE-14879.4.patch, HIVE-14879.5.patch, HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Release Note: (was: Committed patch 5 into branch hive-14535) > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.1.patch, HIVE-14879.2.patch, > HIVE-14879.3.patch, HIVE-14879.4.patch, HIVE-14879.5.patch, HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.1.patch Uploading patch 1 for review. This patch implements the logic for replacing mmWriteId with txnId in Driver, and make sure txnId is used everywhere instead of the original mmWriteId. Also got rid of ValidWriteIds, and use ValidTxnList for the read path. Since ACID has limitation regarding INSERT OVERWRITE and CTAS (at least), I commented out the corresponding part in mm_all.q test and updated the output. Right now there's one failing test which is mm_conversions.q. I haven't figured out yet. Once [~sershe] or [~ekoifman] review and agree on this approach, I can go ahead and remove the metastore changes, schema changes and corresponding thrift changes in next patch. Right now they're not included for simplicity reason for the review. > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.1.patch, HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[
https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Zheng updated HIVE-14879:
-
Attachment: HIVE-14879.2.patch
patch 2 based off latest commit:
{code}
commit ccea0d6ff7aaeaac494d7c7c680a3efad7805e3d
Merge: 8e6719d 2a8d1bf
Author: Sergey Shelukhin
Date: Wed Mar 15 16:45:48 2017 -0700
HIVE-14671 : merge master into hive-14535 (Sergey Shelukhin)
Conflicts:
ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
{code}
> integrate MM tables into ACID: replace MM metastore calls and structures with
> ACID ones
> ---
>
> Key: HIVE-14879
> URL: https://issues.apache.org/jira/browse/HIVE-14879
> Project: Hive
> Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Wei Zheng
> Attachments: HIVE-14879.1.patch, HIVE-14879.2.patch, HIVE-14879.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.3.patch patch 3 fixed issues in mm_conversions.q > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.1.patch, HIVE-14879.2.patch, > HIVE-14879.3.patch, HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.4.patch patch 4 fixed a Operation_type issue (from NO_TXN to INSERT) and combined mmFileSink into acidFileSink, and fixed numerous naming issues to make mm and acid consistent > integrate MM tables into ACID: replace MM metastore calls and structures with > ACID ones > --- > > Key: HIVE-14879 > URL: https://issues.apache.org/jira/browse/HIVE-14879 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Wei Zheng > Attachments: HIVE-14879.1.patch, HIVE-14879.2.patch, > HIVE-14879.3.patch, HIVE-14879.4.patch, HIVE-14879.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
