Re: [VOTE] Spark 2.3.0 (RC2)

2018-01-25 Thread
I'm sorry to post -1 on this, since there is a non-trivial correctness issue that I believe we should fix in 2.3. TL;DR; of the issue: A certain pattern of shuffle+repartition in a query may produce wrong result if some downstream stages failed and trigger retry of repartition, the reason of this

Re: Kubernetes backend and docker images

2018-01-05 Thread
Agree it should be nice to have this simplification, and users can still create their custom images by copy/modifying the default one. Thanks for bring this out Marcelo! 2018-01-05 17:06 GMT-08:00 Marcelo Vanzin : > Hey all, especially those working on the k8s stuff. > >

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-07 Thread
+1 Reynold Xin 于2017年9月7日 周四下午12:04写道: > +1 as well > > On Thu, Sep 7, 2017 at 9:12 PM, Michael Armbrust > wrote: > >> +1 >> >> On Thu, Sep 7, 2017 at 9:32 AM, Ryan Blue >> wrote: >> >>> +1 (non-binding) >>> >>> Thanks

Re: Welcoming Saisai (Jerry) Shao as a committer

2017-08-28 Thread
congs! Takeshi Yamamuro 于2017年8月28日 周一下午7:11写道: > Congrats! > > On Tue, Aug 29, 2017 at 11:04 AM, zhichao wrote: > >> Congratulations, Jerry! >> >> On Tue, Aug 29, 2017 at 9:57 AM, Weiqing Yang >> wrote: >> >>>

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2

2017-08-28 Thread
+1 (Non-binding) Xiao Li 于2017年8月28日 周一下午5:38写道: > +1 > > 2017-08-28 12:45 GMT-07:00 Cody Koeninger : > >> Just wanted to point out that because the jira isn't labeled SPIP, it >> won't have shown up linked from >> >>

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2

2017-08-17 Thread
+1 (non-binding) Wenchen Fan 于2017年8月17日 周四下午9:05写道: > adding my own +1 (binding) > > On Thu, Aug 17, 2017 at 9:02 PM, Wenchen Fan wrote: > >> Hi all, >> >> Following the SPIP process, I'm putting this SPIP up for a vote. >> >> The current data source

Re: Welcoming Hyukjin Kwon and Sameer Agarwal as committers

2017-08-07 Thread
Congratulation, Hyukjin and Sameer! 2017-08-07 23:57 GMT+08:00 : > Congrats! > > 2017/08/08 0:55、Bai, Dave のメッセージ: > > > Congrats, leveled up!=) > > > >> On 8/7/17, 10:53 AM, "Matei Zaharia" wrote: > >> > >> Hi everyone, > >>

Re: [SQL] Syntax "case when" doesn't be supported in JOIN

2017-07-17 Thread
FYI there have been a related discussion here: https://github.com/apache/spark/pull/15417#discussion_r85295977 2017-07-17 15:44 GMT+08:00 Chang Chen : > Hi All > > I don't understand the difference between the semantics, I found Spark > does the same thing for GroupBy