LiFu He created KUDU-3355:
-----------------------------

             Summary: Move range partitions that are out of date to hdfs 
directly
                 Key: KUDU-3355
                 URL: https://issues.apache.org/jira/browse/KUDU-3355
             Project: Kudu
          Issue Type: New Feature
            Reporter: LiFu He


There is a feature in ClickHouse that allows MergeTree table to move range 
partitions from local disks to remote storage(hdfs/s3).

[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#table_engine-mergetree-creating-a-table]

[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#mergetree-table-ttl]

If kudu supports this type of functionarility, maybe it will make the 
combination of kudu and hdfs smoother, and even integrate into the data lake, 
compete with iceburg/hudi/delta.

I have read [~granthenke]'s blog [Transparent Hierarchical Storage Management 
with Apache Kudu and 
Impala|https://blog.cloudera.com/transparent-hierarchical-storage-management-with-apache-kudu-and-impala/],
 thanks for his detailed description, but I think this feature is another 
option. 

What's your opinion?

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to