Re: rewrite action for collate how can we pass date range?

2023-05-23 Thread Gaurav Agarwal
On Wed, May 24, 2023, 10:41 AM Gaurav Agarwal wrote: > I have one more query we are trying to compact files currently it is > taking time as have never compacted till now this is the first time we are > trying to perform compaction after 5 months of continuously loading data > We change the forma

Orphan files

2023-05-23 Thread Gaurav Agarwal
Hello We have orphan files in the table does it impact the read performance of the data from the table if we are passing the partition column in the read query? Would like to know what is the impact of orphan files ? Thanks

Copyonwrite scan

2023-05-23 Thread Gaurav Agarwal
Hi We are getting " runtime file filtering exception the table has been concurrently modified row level operation scan snapshot id " This exception we got while trying to delete the data from the table and has copyonwrite setting for delete operation . I check the code this is mentioned as in spa

Re: 👋 Intro and question for the community

2023-05-23 Thread Anton Okolnychyi
Seems valuable to me. - Anton > On May 18, 2023, at 2:44 PM, Brian Olsen wrote: > > Hey all, > My name is Brian and I'm the new Head of Developer Relations working at > Tabular. I'd like to set up Common Room > for us to have a bit of

[DISCUSS] Default format version for new tables?

2023-05-23 Thread Anton Okolnychyi
Hi folks, Would it be appropriate for us to consider changing the default table format version for new tables from v1 to v2? I don’t think defaulting to v2 tables means all readers have to support delete files. DELETE, UPDATE, MERGE operations will only produce delete files if configured expli

[VOTE] Release Apache Iceberg 1.3.0 RC0

2023-05-23 Thread Anton Okolnychyi
Hi Everyone, I propose that we release the following RC as the official Apache Iceberg 1.3.0 release. The commit ID is 7dbdfd33a667a721fbb21c7c7d06fec9daa30b88 * This corresponds to the tag: apache-iceberg-1.3.0-rc0 * https://github.com/apache/iceberg/commits/apache-iceberg-1.3.0-rc0 * https://

Re: Meeting Minutes from 2023-05-17 Iceberg Sync

2023-05-23 Thread Péter Váry
Hi Eduard, I have joined the Iceberg-Sync google group, but I do not see the invites in my inbox or in my google calendar. What did I miss? Thanks, Peter Eduard Tudenhoefner ezt írta (időpont: 2023. máj. 18., Cs, 7:25): > Hi Iceberg Community, > Here