Re: Apache Hudi 0.8.0 Released

2021-04-08 Thread Gary Li
Thanks Vinoth. The page for 0.8.0 is ready https://hudi.apache.org/docs/0.8.0-spark_quick-start-guide.html. The release note could be found here https://hudi.apache.org/releases.html Best, Gary Li On Thu, Apr 8, 2021 at 12:15 AM Vinoth Chandar wrote: > This is awesome! Thanks for sharing,

Re: [DISCUSS] Incremental computation pipeline for HUDI

2021-04-08 Thread Danny Chan
I tries to do a POC for flink locally and it works well, in the PR i add a new metadata column named "_hoodie_change_flag", but actually i found that only log format needs this flag, and the Spark may has no ability to handle the flag for incremental processing yet. So should i add the