+1 super excited about this. I think it'd make Spark a lot more usable in application development and cloud setting:
(1) Makes it easier to embed in applications with thinner client dependencies. (2) Easier to isolate user code vs system code in the driver. (3) Opens up the potential to upgrade the server side for better performance and security updates without application changes. One thing related to (2) I'd love to discuss, but at a separate thread, is whether it'd make sense to expand or work on a project to better specify system code vs user code boundary in the executors as well. Then we can really have complete system code vs user code isolation in execution. On Wed, Jun 15, 2022 at 9:21 AM, Xiao Li < [email protected] > wrote: > > +1 > > > Xiao > > beliefer < beliefer@ 163. com ( [email protected] ) > 于2022年6月14日周二 03:35写道： > > > >> +1 >> Yeah, I tried to use Apache Livy, so as we can runing interactive query. >> But the Spark Driver in Livy looks heavy. >> >> >> The SPIP may resolve the issue. >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> At 2022-06-14 18:11:21, "Wenchen Fan" < cloud0fan@ gmail. com ( >> [email protected] ) > wrote: >> >> >>> +1 >>> >>> >>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng < ruifengz@ foxmail. com ( >>> [email protected] ) > wrote: >>> >>> >>>> +1 >>>> >>>> >>>> >>>> >>>> ------------------ 原始邮件 ------------------ >>>> *发件人:* "huaxin gao" < huaxin. gao11@ gmail. com ( [email protected] ) >>>> >; >>>> *发送时间:* 2022年6月14日(星期二) 上午8:47 >>>> *收件人:* "L. C. Hsieh"< viirya@ gmail. com ( [email protected] ) >; >>>> *抄送:* "Spark dev list"< dev@ spark. apache. org ( [email protected] ) >; >>>> >>>> *主题:* Re: [VOTE][SPIP] Spark Connect >>>> >>>> >>>> +1 >>>> >>>> >>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh < viirya@ gmail. com ( >>>> [email protected] ) > wrote: >>>> >>>> >>>>> +1 >>>>> >>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun < sunchao@ apache. org ( >>>>> [email protected] ) > wrote: >>>>> > >>>>> > +1 (non-binding) >>>>> > >>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon < gurwls223@ gmail. com ( >>>>> [email protected] ) > wrote: >>>>> >> >>>>> >> +1 >>>>> >> >>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang < wgyumg@ gmail. com ( >>>>> [email protected] ) > wrote: >>>>> >>> >>>>> >>> +1. >>>>> >>> >>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia < matei. zaharia@ gmail. >>>>> com ( [email protected] ) > wrote: >>>>> >>>> >>>>> >>>> +1, very excited about this direction. >>>>> >>>> >>>>> >>>> Matei >>>>> >>>> >>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell < herman@ databricks. >>>>> com. INVALID ( [email protected] ) > wrote: >>>>> >>>> >>>>> >>>> Let me kick off the voting... >>>>> >>>> >>>>> >>>> +1 >>>>> >>>> >>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell < herman@ >>>>> >>>> databricks. >>>>> com ( [email protected] ) > wrote: >>>>> >>>>> >>>>> >>>>> Hi all, >>>>> >>>>> >>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect" >>>>> >>>>> >>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based client/server >>>>> API for Spark >>>>> >>>>> >>>>> >>>>> Please also refer to: >>>>> >>>>> >>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark >>>>> Connect - A client and server interface for Apache Spark. >>>>> >>>>> - Design doc: Spark Connect - A client and server interface for >>>>> Apache Spark. >>>>> >>>>> - JIRA: SPARK-39375 >>>>> >>>>> >>>>> >>>>> Please vote on the SPIP for the next 72 hours: >>>>> >>>>> >>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP >>>>> >>>>> [ ] +0 >>>>> >>>>> [ ] -1: I don’t think this is a good idea because … >>>>> >>>>> >>>>> >>>>> Kind Regards, >>>>> >>>>> Herman >>>>> >>>> >>>>> >>>> >>>>> >>>>> --------------------------------------------------------------------- >>>>> To unsubscribe e-mail: dev-unsubscribe@ spark. apache. org ( >>>>> [email protected] ) >>>> >>>> >>>> >>> >>> >> >> > >
smime.p7s
Description: S/MIME Cryptographic Signature
