Re: [VOTE] SPIP: Catalog API for view metadata

+1 (non-binding). Looking forward to this feature! On Thu, Feb 3, 2022 at 2:32 PM Ryan Blue wrote: > +1 for the SPIP. I think it's well designed and it has worked quite well > at Netflix for a long time. > > On Thu, Feb 3, 2022 at 2:04 PM John Zhuge wrote: > >> Hi Spark community, >> >> I’d

Re: [VOTE] SPIP: Catalog API for view metadata

+1 for the SPIP. I think it's well designed and it has worked quite well at Netflix for a long time. On Thu, Feb 3, 2022 at 2:04 PM John Zhuge wrote: > Hi Spark community, > > I’d like to restart the vote for the ViewCatalog design proposal (SPIP). > > The proposal is to add a ViewCatalog

[VOTE] SPIP: Catalog API for view metadata

Hi Spark community, I’d like to restart the vote for the ViewCatalog design proposal (SPIP). The proposal is to add a ViewCatalog interface that can be used to load, create, alter, and drop views in DataSourceV2. Please vote on the SPIP until Feb. 9th (Wednesday). [ ] +1: Accept the proposal

Re: [VOTE] SPIP: Catalog API for view metadata

Sure Xiao. Happy Lunar New Year! On Thu, Feb 3, 2022 at 1:57 PM Xiao Li wrote: > Can we extend the voting window to next Wednesday? This week is a holiday > week for the lunar new year. AFAIK, many members in Asia are taking the > whole week off. They might not regularly check the emails. > >

Re: [VOTE] SPIP: Catalog API for view metadata

Can we extend the voting window to next Wednesday? This week is a holiday week for the lunar new year. AFAIK, many members in Asia are taking the whole week off. They might not regularly check the emails. Also how about starting a separate email thread starting with [VOTE] ? Happy Lunar New

Re: [VOTE] Spark 3.1.3 RC3

Good catch Dongjoon :) This release candidate fails, but feel free to keep testing for any other potential blockers. I’ll roll RC4 next week with the older release scripts (but the more modern image since the legacy image didn’t have a good time with the R doc packaging). On Thu, Feb 3, 2022 at

Re: [VOTE] Spark 3.1.3 RC3

Unfortunately, -1 for 3.1.3 RC3 due to the packaging issue. It seems that the master branch release script didn't work properly for Hadoop 2 binary distribution, Holden. $ curl -s https://dist.apache.org/repos/dist/dev/spark/v3.1.3-rc3-bin/spark-3.1.3-bin-hadoop2.tgz | tar tz | grep

Re: [VOTE] SPIP: Catalog API for view metadata

+1 (binding) On Thu, Feb 3, 2022 at 2:26 PM Erik Krogen wrote: > +1 (non-binding) > > Really looking forward to having this natively supported by Spark, so that > we can get rid of our own hacks to tie in a custom view catalog > implementation. I appreciate the care John has put into various

Re: [VOTE] SPIP: Catalog API for view metadata

+1 (non-binding) Really looking forward to having this natively supported by Spark, so that we can get rid of our own hacks to tie in a custom view catalog implementation. I appreciate the care John has put into various parts of the design and believe this will provide a robust and flexible

Re: [VOTE] SPIP: Catalog API for view metadata

+1 On Thu, Feb 3, 2022 at 11:19 AM John Zhuge wrote: > Hi Spark community, > > I’d like to restart the vote for the ViewCatalog design proposal (SPIP > > ). > > The proposal is to add a

Re: [VOTE] SPIP: Catalog API for view metadata

Hi Spark community, I’d like to restart the vote for the ViewCatalog design proposal (SPIP ). The proposal is to add a ViewCatalog interface that can be used to load, create, alter, and drop views

Signalling to a MicroBatchStream

Hi all, I was hoping for some advice on creating a MicroBatchStream for MongoDB. MongoDB has a tailable cursor that listens to changes in a collection (known as a change stream). As a user watches a collection via the change stream cursor, the cursor reports a resume token that determines the