[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=484253&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484253 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 15/Sep/20 00:46 Start Date: 15/Sep/20 00:46 Worklog Time Spent: 10m Work Description: github-actions[bot] closed pull request #967: URL: https://github.com/apache/hive/pull/967 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 484253) Time Spent: 1.5h (was: 1h 20m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 1.5h > Remaining Estimate: 0h > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=477548&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477548 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 02/Sep/20 00:41 Start Date: 02/Sep/20 00:41 Worklog Time Spent: 10m Work Description: github-actions[bot] commented on pull request #967: URL: https://github.com/apache/hive/pull/967#issuecomment-685209595 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Feel free to reach out on the d...@hive.apache.org list if the patch is in need of reviews. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 477548) Time Spent: 1h 20m (was: 1h 10m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 1h 20m > Remaining Estimate: 0h > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=452871&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-452871 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 30/Jun/20 08:56 Start Date: 30/Jun/20 08:56 Worklog Time Spent: 10m Work Description: John1Tang commented on pull request #967: URL: https://github.com/apache/hive/pull/967#issuecomment-651657855 my pull request only changed the postgres schematool, this test failed with hive jdbc storage handler... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 452871) Time Spent: 1h 10m (was: 1h) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 1h 10m > Remaining Estimate: 0h > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=443254&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-443254 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 09/Jun/20 16:47 Start Date: 09/Jun/20 16:47 Worklog Time Spent: 10m Work Description: John1Tang commented on pull request #967: URL: https://github.com/apache/hive/pull/967#issuecomment-641412921 > I'm looking at the corresponding MySQL scripts and they do not include `IF NOT EXISTS` statement. If the tool is failing on a simple upgrade, that's a bigger problem than just ignoring some table and indexes. It shouldn't include anything that is already present. Need more context of the problem. Actually, this is how it all began: I was going to do Hive metadata migration from 3.0.0 to 3.1.2 and when I executed the "bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0", the new Hive 3.1.2 was not able to start. Then I just found that the previous Hive 3.0.0 remained an older schema, in other words, the previous maintainer didn't upgrade schema from 2.3.0. So when I did "bin/schematool -dbType postgres -upgradeSchemaFrom 2.3.0" it reported all those "exists"/"not exists" error, so i would suggest to keep the idempotence of those scripts, we can use IF NOT EXISTS to avoid those error. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 443254) Remaining Estimate: 0h (was: 10m) Time Spent: 1h (was: 50m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 1h > Remaining Estimate: 0h > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=442872&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-442872 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 09/Jun/20 16:07 Start Date: 09/Jun/20 16:07 Worklog Time Spent: 10m Work Description: belugabehr commented on pull request #967: URL: https://github.com/apache/hive/pull/967#issuecomment-640605874 I'm looking at the corresponding MySQL scripts and they do not include `IF NOT EXISTS` statement. If the tool is failing on a simple upgrade, that's a bigger problem than just ignoring some table and indexes. It shouldn't include anything that is already present. Need more context of the problem. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 442872) Remaining Estimate: 10m (was: 20m) Time Spent: 50m (was: 40m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 50m > Remaining Estimate: 10m > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=442095&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-442095 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 06/Jun/20 00:23 Start Date: 06/Jun/20 00:23 Worklog Time Spent: 10m Work Description: github-actions[bot] commented on pull request #967: URL: https://github.com/apache/hive/pull/967#issuecomment-639913761 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Feel free to reach out on the d...@hive.apache.org list if the patch is in need of reviews. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 442095) Remaining Estimate: 20m (was: 0.5h) Time Spent: 40m (was: 0.5h) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 40m > Remaining Estimate: 20m > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=413666&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-413666 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 01/Apr/20 01:49 Start Date: 01/Apr/20 01:49 Worklog Time Spent: 10m Work Description: John1Tang commented on pull request #967: HIVE-23074: add "IF NOT EXISTS" for create & "IF EXISTS" for drop to … URL: https://github.com/apache/hive/pull/967 add "IF NOT EXISTS" for create & "IF EXISTS" for drop to keep consistency if there are some fields or indices already existing This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 413666) Remaining Estimate: 0.5h (was: 40m) Time Spent: 0.5h (was: 20m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 0.5h > Remaining Estimate: 0.5h > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=413661&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-413661 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 01/Apr/20 01:37 Start Date: 01/Apr/20 01:37 Worklog Time Spent: 10m Work Description: John1Tang commented on pull request #961: HIVE-23074: add "IF NOT EXISTS" for create & "IF EXISTS" for drop to … URL: https://github.com/apache/hive/pull/961 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 413661) Remaining Estimate: 40m (was: 50m) Time Spent: 20m (was: 10m) > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu > hive version: upgrade from version 3.0.0 to 3.1.2 >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 20m > Remaining Estimate: 40m > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > {code:java} > bin/schematool -dbType postgres -upgradeSchemaFrom 3.0.0{code} > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} > I've already come up with a solution and created a pull request for this > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-23074) SchemaTool sql script execution errors when updating the metadata's schema
[ https://issues.apache.org/jira/browse/HIVE-23074?focusedWorklogId=409410&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-409410 ] ASF GitHub Bot logged work on HIVE-23074: - Author: ASF GitHub Bot Created on: 25/Mar/20 09:58 Start Date: 25/Mar/20 09:58 Worklog Time Spent: 10m Work Description: John1Tang commented on pull request #961: HIVE-23074: add "IF NOT EXISTS" for create & "IF EXISTS" for drop to … URL: https://github.com/apache/hive/pull/961 add "IF NOT EXISTS" for create & "IF EXISTS" for drop to keep consistency and add " to avoid keywords This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 409410) Remaining Estimate: 50m (was: 1h) Time Spent: 10m > SchemaTool sql script execution errors when updating the metadata's schema > -- > > Key: HIVE-23074 > URL: https://issues.apache.org/jira/browse/HIVE-23074 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.2 > Environment: running machine: centos7.2 > metadata db: PostgreSQL 11.3 on x86_64-pc-linux-gnu >Reporter: John1Tang >Assignee: John1Tang >Priority: Major > Labels: pull-request-available > Fix For: 3.1.2 > > Original Estimate: 1h > Time Spent: 10m > Remaining Estimate: 50m > > SchemaTool sql script executed with conflicts on indices and columns and > missed " for avoiding keywords when updating the metadata's schema > went like this: > {code:java} > ALTER TABLE "GLOBAL_PRIVS" ADD COLUMN "AUTHORIZER" character varying(128) > DEFAULT NULL::character varying > Error: ERROR: column "AUTHORIZER" of relation "GLOBAL_PRIVS" already exists > (state=42701,code=0){code} > {code:java} > ALTER TABLE COMPLETED_TXN_COMPONENTS ADD COLUMN IF NOT EXISTS > CTC_UPDATE_DELETE char(1) NULL > Error: ERROR: relation "completed_txn_components" does not exist > (state=42P01,code=0) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)