Manish Maheshwari created HIVE-23155:
----------------------------------------

             Summary: Hive Replication to support "archival" destinations
                 Key: HIVE-23155
                 URL: https://issues.apache.org/jira/browse/HIVE-23155
             Project: Hive
          Issue Type: New Feature
            Reporter: Manish Maheshwari


Currently in Hive replication any partitions dropped in the source are also 
propagated to the destination. The request here is to support a new destination 
type called as "archival" with the following properties
 * Partitions deleted on source are not deleted in the target
 * Tables deleted on source are not deleted in the target
 ** When new tables with the same name are added in the source, rename the old 
table (s) in the destination with some naming mechanism
 * Overwritten partitions on prem / Acid changes on prem etc are should be 
allowed to be replicated.

Use case - We are using Hive replication from on prem HDFS to S3 where S3 is an 
archive for cold data. We want old  data that is deleted on prem does not get 
deleted on the cloud.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to