Re: Extracting a partition field from something like a timestamp using Deltastreamer / Configurations?

2020-05-05 Thread Vinoth Chandar
Great! On Mon, May 4, 2020 at 5:43 PM Allen Underwood wrote: > Hi Vinoth, > > Yes I was going to set some things up in the morning. I’ll let you know > how it turns out and if it’s worth a PR I’ll get one together. > > Thanks again for your help! > > Allen > > On Mon, May 4, 2020 at 8:40 PM Vin

Re: [DISCUSS] Return schema provider as optional?

2020-05-05 Thread Vinoth Chandar
I think discussions are going on in the PR itself.. Please chime in there as well if this suits you. On Sat, May 2, 2020 at 6:01 AM Shiyan Xu wrote: > Hi all, > > In case of reading schema-inferable source like parquet, when no new data > is found, then, if i understand correctly, no schema can

Weekly Sync 20200505

2020-05-05 Thread Vinoth Chandar
Really fancy date timestamp :) Anyways, here are the notes https://cwiki.apache.org/confluence/display/HUDI/20200505+Weekly+Sync+Minutes

[DISCUSS] should we do a 0.5.3 patch set release ?

2020-05-05 Thread Bhavani Sudha
Hello all, I am wondering if we should do a 0.5.3 release by backporting all minor to medium bug fixes (that are in master already) to 0.5.2 and do a minor release ? That way we can use some time to reserve 0.6.0 release for all major features that are upcoming and/or almost there. Please share yo