Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 (non-binding) On Wed, Feb 17, 2021 at 9:54 AM Wenchen Fan wrote: > +1 > > On Wed, Feb 17, 2021 at 1:43 PM Dongjoon Hyun > wrote: > >> +1 >> >> Bests, >> Dongjoon. >> >> >> On Tue, Feb 16, 2021 at 2:27 AM Herman van Hovell >> wrote: >> >>> +1 >>> >>> On Tue, Feb 16, 2021 at 11:08 AM Hyukjin

Re: [DISCUSS] SPIP: FunctionCatalog

Just to make sure we don’t move past, I think we haven’t decided yet: - if we’ll replace the current proposal to Wenchen’s approach as the default - if we want to have Wenchen’s approach as an optional mix-in on the top of Ryan’s proposal (SupportsInvoke) >From what I read, some

Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 On Wed, Feb 17, 2021 at 1:43 PM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > > On Tue, Feb 16, 2021 at 2:27 AM Herman van Hovell > wrote: > >> +1 >> >> On Tue, Feb 16, 2021 at 11:08 AM Hyukjin Kwon >> wrote: >> >>> +1 >>> >>> 2021년 2월 16일 (화) 오후 5:10, Prashant Sharma 님이 작성: >>>

Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 Bests, Dongjoon. On Tue, Feb 16, 2021 at 2:27 AM Herman van Hovell wrote: > +1 > > On Tue, Feb 16, 2021 at 11:08 AM Hyukjin Kwon wrote: > >> +1 >> >> 2021년 2월 16일 (화) 오후 5:10, Prashant Sharma 님이 작성: >> >>> +1 >>> >>> On Tue, Feb 16, 2021 at 1:22 PM Dongjoon Hyun >>> wrote: >>>

Re: [DISCUSS] SPIP: FunctionCatalog

Hi, Wenchen. This thread seems to get enough attention. Also, I'm expecting more and more if we have this on the `master` branch because we are developing together. > Spark SQL has many active contributors/committers and this thread doesn't get much attention yet. So, what's your ETA from

Re: [DISCUSS] SPIP: FunctionCatalog

Andrew, The proposal already includes an API for aggregate functions and I think we would want to implement those right away. Processing ColumnBatch is something we can easily extend the interfaces to support, similar to Wenchen's suggestion. The important thing right now is to agree on some

Re: [DISCUSS] SPIP: FunctionCatalog

Hello Ryan, This proposal looks very interesting. Would future goals for this functionality include both support for aggregation functions, as well as support for processing ColumnBatch-es (instead of Row/InternalRow)? Thanks Andrew On Mon, Feb 15, 2021 at 12:44 PM Ryan Blue wrote: > > Thanks

Re: [DISCUSS] SPIP: FunctionCatalog

Ye Xianjin, Transport is a UDF API that can be used to write UDFs once and have them translated to native versions of multiple engine UDFs, such as Spark, Presto, and Hive, or data source UDFs such as Avro (others could be added). To get a feel of the UDF

Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 On Tue, Feb 16, 2021 at 11:08 AM Hyukjin Kwon wrote: > +1 > > 2021년 2월 16일 (화) 오후 5:10, Prashant Sharma 님이 작성: > >> +1 >> >> On Tue, Feb 16, 2021 at 1:22 PM Dongjoon Hyun >> wrote: >> >>> Please vote on releasing the following candidate as Apache Spark version >>> 3.0.2. >>> >>> The vote is

Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 2021년 2월 16일 (화) 오후 5:10, Prashant Sharma 님이 작성: > +1 > > On Tue, Feb 16, 2021 at 1:22 PM Dongjoon Hyun > wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 3.0.2. >> >> The vote is open until February 19th 9AM (PST) and passes if a majority >> +1 PMC

Re: [VOTE] Release Spark 3.0.2 (RC1)

+1 On Tue, Feb 16, 2021 at 1:22 PM Dongjoon Hyun wrote: > Please vote on releasing the following candidate as Apache Spark version > 3.0.2. > > The vote is open until February 19th 9AM (PST) and passes if a majority +1 > PMC votes are cast, with a minimum of 3 +1 votes. > > [ ] +1 Release this