[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Resolution: Fixed Status: Resolved (was: Patch Available) patch not required for branch-3 as the related changes are not committed to branch-3. Even without this change , truncate table is working fine for acid tables in branch-3. > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0 > > Attachments: HIVE-20293.01.patch, HIVE-20293.02.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-20293: Fix Version/s: (was: 3.2.0) > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0 > > Attachments: HIVE-20293.01.patch, HIVE-20293.02.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Status: Patch Available (was: Open) fixed review comments > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch, HIVE-20293.02.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Attachment: HIVE-20293.02.patch > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch, HIVE-20293.02.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Status: Open (was: Patch Available) > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch, HIVE-20293.02.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-20293: -- Labels: DR pull-request-available replication (was: DR replication) > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Status: Patch Available (was: Open) Added the write id to the alter table / alter partition messages to get the valid write id lists on the target cluster. Added a new test for alter table. The truncate table operation (removing files) is still non transactional. > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Attachment: HIVE-20293.01.patch > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, replication > Fix For: 4.0.0, 3.2.0 > > Attachments: HIVE-20293.01.patch > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20293: -- Component/s: Transactions > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl, Transactions >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, replication > Fix For: 4.0.0, 3.2.0 > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20293) Support Replication of ACID table truncate operation
[ https://issues.apache.org/jira/browse/HIVE-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-20293: --- Description: Support truncate acid table replication. 1. Write id allocation needs to be removed was: Add tags in jobconf for distcp related jobs started by replication. This will allow hive to kill these jobs in case beacon retries, or hs2 dies and beacon issues a kill command. * one of the tags should definitely be the query_id that starts the job : With this flow beacon before retrying the bootstrap load, will issue a kill command to hs2 with the query id of the previous issued command. hs2 will then kill an running jobs on yarn tagged with the Query_id. * To get around the additional failure point as mentioned above. The jobs can be tagged with an additional unique tag_id provided by Beacon in the WITH clause in repl load command to be used to tag distcp jobs ). Enhance the kill api to take the tag as input and kill jobs associated with that tag. Problem here is how do we validate the association of the tag with a hive query id to make sure this api is not used to kill jobs run by other components, however we can provide this capability to only admins and should be ok in that case. > Support Replication of ACID table truncate operation > > > Key: HIVE-20293 > URL: https://issues.apache.org/jira/browse/HIVE-20293 > Project: Hive > Issue Type: Task > Components: repl >Affects Versions: 3.1.0, 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: DR, replication > Fix For: 4.0.0, 3.2.0 > > > Support truncate acid table replication. > 1. Write id allocation needs to be removed -- This message was sent by Atlassian JIRA (v7.6.3#76005)
