A new project focused on serialized algebra

2021-09-08 Thread Jacques Nadeau
Hey all, For some time I've been thinking that having a common serialized representation of query plans would be helpful across multiple related projects. I started working on something independently in this vein several months ago. Since then, Arrow has started exploring "Arrow IR" and in Iceberg

Iceberg community sync notes for 1 September 2021

2021-09-08 Thread Ryan Blue
Hi everyone, The notes for the Iceberg community sync last week are now updated in the agenda/notes doc . If you have anything to add, feel free to let me know or add comments to the doc.

Re: Iceberg community sync notes for 1 September 2021

2021-09-08 Thread OpenInx
Thanks for the summary, Ryan ! I would like to add the following thing into the roadmap for 0.13.0: *Flink Integration* 1. Upgrade the flink version from 1.12.1 to 1.13.2 ( https://github.com/apache/iceberg/pull/2629). Because there is a bug in flink 1.12.1 when reading nested data types (Map

Re: Iceberg community sync notes for 1 September 2021

2021-09-08 Thread OpenInx
One more thing: I think it will be great to have the parquet bloom filter feature (contributed from www.iq.com, one of the largest video websites in China) supported in iceberg 0.13.0 : 1. https://github.com/apache/iceberg/pull/2643 2. https://github.com/apache/iceberg/pull/2642 On Thu, Sep 9, 2