Re: [DISCUSS] SPIP: Standardize SQL logical plans

2018-07-17 Thread Ryan Blue
I just called a vote on this. I don't think we really need a shepherd if there's enough interest for a vote to pass. rb On Tue, Jul 17, 2018 at 9:00 AM Cody Koeninger wrote: > According to > > http://spark.apache.org/improvement-proposals.html > > the shepherd should be a PMC member, not

Re: [DISCUSS] SPIP: Standardize SQL logical plans

2018-07-17 Thread Cody Koeninger
According to http://spark.apache.org/improvement-proposals.html the shepherd should be a PMC member, not necessarily the person who proposed the SPIP On Tue, Jul 17, 2018 at 9:13 AM, Wenchen Fan wrote: > I don't know an official answer, but conventionally people who propose the > SPIP would

Re: [DISCUSS] SPIP: Standardize SQL logical plans

2018-07-17 Thread Wenchen Fan
I don't know an official answer, but conventionally people who propose the SPIP would call the vote and "shepherd" the project. Other people can jump in during the development. I'm interested in the new API and like to work on it after the vote passes. Thanks, Wenchen On Fri, Jul 13, 2018 at

Re: [DISCUSS] SPIP: Standardize SQL logical plans

2018-07-12 Thread Ryan Blue
Thanks! I'm all for calling a vote on the SPIP. If I understand the process correctly, the intent is for a "shepherd" to do it. I'm happy to call a vote, or feel free if you'd like to play that role. Other comments: * DeleteData API: I completely agree that we need to have a proposal for it. I

Re: [DISCUSS] SPIP: Standardize SQL logical plans

2018-07-11 Thread Wenchen Fan
Hi Ryan, Great job on this! Shall we call a vote for the plan standardization SPIP? I think this is a good idea and we should do it. Notes: We definitely need new user-facing APIs to produce these new logical plans like DeleteData. But we need a design doc for these new APIs after the SPIP

[DISCUSS] SPIP: Standardize SQL logical plans

2018-04-19 Thread Ryan Blue
Hi everyone, A few weeks ago, I wrote up a proposal to standardize SQL logical plans and a supporting design doc for data source catalog APIs

[DISCUSS] SPIP: Standardize SQL logical plans (SPARK-23521)

2018-02-26 Thread Ryan Blue
Hi everyone, As a follow-up to earlier discussion on logical plans and the v2 data sources, I’ve submitted a new SPIP, SPARK-23521 . This SPIP is based on that DataSourceV2 implementation discussion and officially proposes the recommendations.