Re: [DISCUSS] Hudi data TTL

2022-10-19 Thread Bingeng Huang
Looking forward to the RFC. We can propose RFC about support TTL config using non-partition field after sagar sumit 于2022年10月19日周三 14:42写道: > +1 Very nice idea. Looking forward to the RFC! > > On Wed, Oct 19, 2022 at 10:13 AM Shiyan Xu > wrote: > > > great proposal. Partition TTL is a good st

Re: [ANNOUNCE] Apache Hudi 0.12.1 released

2022-10-19 Thread leesf
Great job! Alexey Kudinkin 于2022年10月20日周四 03:45写道: > Thanks Zhaojing for masterfully navigating this release! > > On Wed, Oct 19, 2022 at 7:46 AM Vinoth Chandar wrote: > > > Great job everyone! > > > > On Wed, Oct 19, 2022 at 07:11 zhaojing yu wrote: > > > > > The Apache Hudi team is pleased t

Re: [ANNOUNCE] Apache Hudi 0.12.1 released

2022-10-19 Thread Alexey Kudinkin
Thanks Zhaojing for masterfully navigating this release! On Wed, Oct 19, 2022 at 7:46 AM Vinoth Chandar wrote: > Great job everyone! > > On Wed, Oct 19, 2022 at 07:11 zhaojing yu wrote: > > > The Apache Hudi team is pleased to announce the release of Apache Hudi > > 0.12.1. > > > > Apache Hudi

Re: [ANNOUNCE] Apache Hudi 0.12.1 released

2022-10-19 Thread Vinoth Chandar
Great job everyone! On Wed, Oct 19, 2022 at 07:11 zhaojing yu wrote: > The Apache Hudi team is pleased to announce the release of Apache Hudi > 0.12.1. > > Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes > and Incrementals. Apache Hudi manages storage of large analytical > data

[ANNOUNCE] Apache Hudi 0.12.1 released

2022-10-19 Thread zhaojing yu
The Apache Hudi team is pleased to announce the release of Apache Hudi 0.12.1. Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Apache Hudi manages storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage) and pr

Re: [DISCUSS] Hudi data TTL

2022-10-19 Thread stream2000
Since it is marked as outdated by ttl policy, we think that it’s better to delete it anyway. Compaction & Clustering should deal with the case that the source data is already marked as deleted by ttl, otherwise there will still left some unused data in the partition. What do you think? > On O

Re: [DISCUSS] Hudi data TTL

2022-10-19 Thread Teng Huo
Nice feature! @stream2000 Just one question, can it work with compaction logs? I mean, if there are some log files already marked in a compaction plan, will they be deleted by TTL? From: sagar sumit Sent: Wednesday, October 19, 2022 2:42:36 PM To: dev@hudi.apache