Re: Welcome new PMC members!

2021-11-18 Thread Rajarshi Sarkar
Congrats, Jack and Russell !! Well deserved !! Regards, Raj On Fri, Nov 19, 2021 at 7:02 AM xingbo wu wrote: > Congrats, Jack and Russell! Well deserved! > > Yan Yan 于2021年11月19日周五 上午2:25写道: > >> Congratulations, Jack and Russel! >> >> On Thu, Nov 18, 2021 at 7:58 AM Jun H. wrote: >> >>> Co

Re: Welcome new PMC members!

2021-11-18 Thread xingbo wu
Congrats, Jack and Russell! Well deserved! Yan Yan 于2021年11月19日周五 上午2:25写道: > Congratulations, Jack and Russel! > > On Thu, Nov 18, 2021 at 7:58 AM Jun H. wrote: > >> Congrats Jack and Russell! Well deserved. >> >> >> On Nov 18, 2021, at 7:12 AM, Dmitri Bourlatchkov < >> dmitri.bourlatch...@dre

Meeting Minutes from 11/17 Iceberg Sync

2021-11-18 Thread Sam Redai
Hi Everyone, Here are the minutes and video recording from our Iceberg Sync that took place on November 17th, 9am-10am PT. Please remember that anyone can join the discussion so feel free to share the Iceberg-Sync google group with anyone who is seeking

Please ignore the invitation: Sync-up on Http catalog APIs

2021-11-18 Thread Yufei Gu
Hi, Sorry for accidentally sending an invite(Sync-up on Http catalog APIs) to all. I just intended to ask Kyle some basic questions about it. My first time using google hangout. It turns out google calendar automatically grabs all people in the mail opened in gmail's UI. Quite a surprise to me. So

Re: Regarding the support of pluggable procedures in Iceberg

2021-11-18 Thread Ryan Blue
I don’t see the code where the spark extensions can find other procedure catalogs w/o the user having to configure and reference another catalog. Yes, that’s right. If other systems want to add stored procedures, then they would need to add a catalog. Is there a strong use case around adding more

Invitation: Sync-up on Http catalog APIs @ Thu 2021-11-18 2:30pm - 3:30pm (PST) (dev@iceberg.apache.org)

2021-11-18 Thread flyrain000
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:2028T223000Z DTEND:2028T233000Z DTSTAMP:2028T193752Z ORGANIZER;CN=flyrain...@gmail.com:mailto:flyrain...@gmail.com UID:3l0sckak0lkc2cb82mlpkov...@google.c

Re: Welcome new PMC members!

2021-11-18 Thread Yan Yan
Congratulations, Jack and Russel! On Thu, Nov 18, 2021 at 7:58 AM Jun H. wrote: > Congrats Jack and Russell! Well deserved. > > > On Nov 18, 2021, at 7:12 AM, Dmitri Bourlatchkov < > dmitri.bourlatch...@dremio.com> wrote: > >  > Congrats Jack and Russell > > On Wed, Nov 17, 2021 at 7:12 PM Ryan

Re: Spark Merge On Read Support

2021-11-18 Thread Yufei Gu
Hi Puneet, Agreed with Ryan, you can use Spark 2.4 to read Iceberg tables with delete files. To add to this, we are recently adding vectorized read support in Spark 3.2, which is 1.6 ~ 2 times faster than non-vectorized read(the existing solution in Spark 2.4). 1. Position delete support https://g

Re: Spark Merge On Read Support

2021-11-18 Thread Puneet Zaroo
Thanks Ryan, This is super helpful to know. Yes, the discussion about 'plans' in Spark 3.2 made me think it could be for read support. For the Presto read support, could you (or Jack) please point to the PRs that are work-in-progress. Thanks, - Puneet On Thu, Nov 18, 2021 at 8:26 AM Ryan Blue wro

Re: Spark Merge On Read Support

2021-11-18 Thread Ryan Blue
Puneet, Good question. Reading v2 tables with delete files has been supported for several versions, since before we adopted the v2 additions to the spec. You should be fine when using Spark, Flink, Hive, etc. with runtime Jars from the Iceberg project. Trino has yet to add support, but Jack has a

Re: Welcome new PMC members!

2021-11-18 Thread Jun H.
Congrats Jack and Russell! Well deserved. > On Nov 18, 2021, at 7:12 AM, Dmitri Bourlatchkov > wrote: > >  > Congrats Jack and Russell > >> On Wed, Nov 17, 2021 at 7:12 PM Ryan Blue wrote: >> Hi everyone, I want to welcome Jack Ye and Russell Spitzer to the Iceberg >> PMC. They've both bee

Re: Welcome new PMC members!

2021-11-18 Thread Dmitri Bourlatchkov
Congrats Jack and Russell On Wed, Nov 17, 2021 at 7:12 PM Ryan Blue wrote: > Hi everyone, I want to welcome Jack Ye and Russell Spitzer to the Iceberg > PMC. They've both been amazing at reviewing and helping people in the > community and the PMC has decided to invite them to join. Congratulatio

Re: Welcome new PMC members!

2021-11-18 Thread Szehon Ho
Awesome, congratulations Jack and Russell! > On 18 Nov 2021, at 09:30, Ryan Murray wrote: > > Congratulations both! Well deserved! > > On Thu, 18 Nov 2021, 09:19 Omar Al-Safi, > wrote: > Congrats both of you! > > On Thu, Nov 18, 2021 at 8:31 AM Eduard Tudenhoefner

Re: Welcome new PMC members!

2021-11-18 Thread Ryan Murray
Congratulations both! Well deserved! On Thu, 18 Nov 2021, 09:19 Omar Al-Safi, wrote: > Congrats both of you! > > On Thu, Nov 18, 2021 at 8:31 AM Eduard Tudenhoefner > wrote: > >> Congrats Jack and Russell! Very well deserved. >> >> On Thu, Nov 18, 2021, 01:12 Ryan Blue wrote: >> >>> Hi everyon

Re: Welcome new PMC members!

2021-11-18 Thread Omar Al-Safi
Congrats both of you! On Thu, Nov 18, 2021 at 8:31 AM Eduard Tudenhoefner wrote: > Congrats Jack and Russell! Very well deserved. > > On Thu, Nov 18, 2021, 01:12 Ryan Blue wrote: > >> Hi everyone, I want to welcome Jack Ye and Russell Spitzer to the Iceberg >> PMC. They've both been amazing at