Review Request

2022-03-09 Thread OpenInx
Hi iceberg dev I've recently revisited the flink write path to use the newly introduced writers (which is partition specific writers). All the future performance & stability optimization will be made on top of the revisited flink write path. I've just published the PR here: https://github.com/ap

Re: Change Data Capture for Iceberg

2022-03-09 Thread Yufei Gu
Hi everyone, Thanks for the joining and discussion in the sync-up last Friday. We’ve got a consensus on several items: 1. The snapshot granularity CDC generation is useful, and will cover a wide range of use cases. Sub-snapshot granularity is out of scope at this moment, which needs

Re: Hive table compatibility for Iceberg readers

2022-03-09 Thread Walaa Eldin Moustafa
The union type conversion PR is up: https://github.com/apache/iceberg/pull/4242. Thanks, Walaa. On Fri, Feb 11, 2022 at 8:53 AM Walaa Eldin Moustafa wrote: > Thanks Ryan! Yes there is an active discussion on the PR on the spec > aspect. > > On Fri, Feb 11, 2022 at 8:47 AM Ryan Blue wrote: > >