Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-11 Thread Wenchen Fan
;>>> *From:* wangzhenhua (G) <wangzhen...@huawei.com> >>>> *Sent:* Friday, September 8, 2017 2:20:07 AM >>>> *To:* Dongjoon Hyun; 蒋星博 >>>> *Cc:* Michael Armbrust; Reynold Xin; Andrew Ash; Herman van Hövell tot >>>> Westerflier; Ryan B

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-11 Thread Wenchen Fan
om:* wangzhenhua (G) <wangzhen...@huawei.com> >>> *Sent:* Friday, September 8, 2017 2:20:07 AM >>> *To:* Dongjoon Hyun; 蒋星博 >>> *Cc:* Michael Armbrust; Reynold Xin; Andrew Ash; Herman van Hövell tot >>> Westerflier; Ryan Blue; Spark dev list; Suresh Thala

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-10 Thread Hemant Bhanawat
gjoon Hyun; 蒋星博 >> *Cc:* Michael Armbrust; Reynold Xin; Andrew Ash; Herman van Hövell tot >> Westerflier; Ryan Blue; Spark dev list; Suresh Thalamati; Wenchen Fan >> *Subject:* 答复: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path >> >> >> +1 (non-binding)

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-10 Thread vaquar khan
> *Cc:* Michael Armbrust; Reynold Xin; Andrew Ash; Herman van Hövell tot > Westerflier; Ryan Blue; Spark dev list; Suresh Thalamati; Wenchen Fan > *Subject:* 答复: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path > > > +1 (non-binding) Great to see data source API is going to

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-10 Thread Noman Khan
ubject: 答复: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path +1 (non-binding) Great to see data source API is going to be improved! best regards, -Zhenhua(Xander) 发件人: Dongjoon Hyun [mailto:dongjoon.h...@gmail.com] 发送时间: 2017年9月8日 4:07 收件人: 蒋星博 抄送: Michael Armbrust; Reynold Xin; Andr

答复: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread wangzhenhua (G)
; Suresh Thalamati; Wenchen Fan 主题: Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path +1 (non-binding). On Thu, Sep 7, 2017 at 12:46 PM, 蒋星博 <jiangxb1...@gmail.com<mailto:jiangxb1...@gmail.com>> wrote: +1 Reynold Xin <r...@databricks.com<mailto:r...@databricks.com>&g

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Dongjoon Hyun
+1 (non-binding). On Thu, Sep 7, 2017 at 12:46 PM, 蒋星博 wrote: > +1 > > > Reynold Xin 于2017年9月7日 周四下午12:04写道： > >> +1 as well >> >> On Thu, Sep 7, 2017 at 9:12 PM, Michael Armbrust >> wrote: >> >>> +1 >>> >>> On Thu, Sep 7,

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread 蒋星博
+1 Reynold Xin 于2017年9月7日 周四下午12:04写道： > +1 as well > > On Thu, Sep 7, 2017 at 9:12 PM, Michael Armbrust > wrote: > >> +1 >> >> On Thu, Sep 7, 2017 at 9:32 AM, Ryan Blue >> wrote: >> >>> +1 (non-binding) >>> >>> Thanks

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Reynold Xin
+1 as well On Thu, Sep 7, 2017 at 9:12 PM, Michael Armbrust wrote: > +1 > > On Thu, Sep 7, 2017 at 9:32 AM, Ryan Blue > wrote: > >> +1 (non-binding) >> >> Thanks for making the updates reflected in the current PR. It would be >> great to see

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Michael Armbrust
+1 On Thu, Sep 7, 2017 at 9:32 AM, Ryan Blue wrote: > +1 (non-binding) > > Thanks for making the updates reflected in the current PR. It would be > great to see the doc updated before it is finally published though. > > Right now it feels like this SPIP is focused

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Ryan Blue
+1 (non-binding) Thanks for making the updates reflected in the current PR. It would be great to see the doc updated before it is finally published though. Right now it feels like this SPIP is focused more on getting the basics right for what many datasources are already doing in API V1 combined

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Herman van Hövell tot Westerflier
+1 (binding) I personally believe that there is quite a big difference between having a generic data source interface with a low surface area and pushing down a significant part of query processing into a datasource. The later has much wider wider surface area and will require us to stabilize

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread Andrew Ash
+0 (non-binding) I think there are benefits to unifying all the Spark-internal datasources into a common public API for sure. It will serve as a forcing function to ensure that those internal datasources aren't advantaged vs datasources developed externally as plugins to Spark, and that all

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-06 Thread Suresh Thalamati
+1 (non-binding) > On Sep 6, 2017, at 7:29 PM, Wenchen Fan wrote: > > Hi all, > > In the previous discussion, we decided to split the read and write path of > data source v2 into 2 SPIPs, and I'm sending this email to call a vote for > Data Source V2 read path only. >

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-06 Thread Sameer Agarwal
+1 On Wed, Sep 6, 2017 at 8:53 PM, Xiao Li wrote: > +1 > > Xiao > > 2017-09-06 19:37 GMT-07:00 Wenchen Fan : > >> adding my own +1 (binding) >> >> On Thu, Sep 7, 2017 at 10:29 AM, Wenchen Fan wrote: >> >>> Hi all, >>> >>> In the

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-06 Thread Xiao Li
+1 Xiao 2017-09-06 19:37 GMT-07:00 Wenchen Fan : > adding my own +1 (binding) > > On Thu, Sep 7, 2017 at 10:29 AM, Wenchen Fan wrote: > >> Hi all, >> >> In the previous discussion, we decided to split the read and write path >> of data source v2 into 2

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-06 Thread Wenchen Fan
adding my own +1 (binding) On Thu, Sep 7, 2017 at 10:29 AM, Wenchen Fan wrote: > Hi all, > > In the previous discussion, we decided to split the read and write path of > data source v2 into 2 SPIPs, and I'm sending this email to call a vote for > Data Source V2 read path