Deleting Hudi Partitons

2020-10-20 Thread selvaraj periyasamy
Team , I have a COW table which has sub partition columns Date/Hour . For some of the use case , I need to totally remove free petitions (removing few hours alone) . Hudi maintains metadata info. Manually removing folders as well as in hive megastore , may mess up hudi metadata. What is the best w

20201020 Weekly Sync Minutes

2020-10-20 Thread Vinoth Chandar
https://cwiki.apache.org/confluence/display/HUDI/20201020+Weekly+Sync+Minutes Thanks Vinoth

Re: HUDI Table Primary Key - UUID or Custom For Better Performance

2020-10-20 Thread Vinoth Chandar
For now, bloom filters are not actually leveraged in the read/query path but only by the writer performing the index lookup for upserting. Hudi is write optimized like an OLTP store and read optimized like OLAP, if that makes sense. As for bloom index performance, our tuning guide and FAQ talk abo