Re: Welcoming some new Apache Spark committers

2020-07-15 Thread Yuanjian Li
Congratulations!! huaxin gao 于2020年7月16日周四 上午6:24写道: > Thanks everyone! I am looking forward to working with you all in the > future. > > On Tue, Jul 14, 2020 at 5:02 PM Hyukjin Kwon wrote: > >> Congrats! >> >> 2020년 7월 15일 (수) 오전 7:56, Takeshi Yamamuro 님이 작성: >> >>> Congrats, all! >>> >>> On W

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread huaxin gao
Thanks everyone! I am looking forward to working with you all in the future. On Tue, Jul 14, 2020 at 5:02 PM Hyukjin Kwon wrote: > Congrats! > > 2020년 7월 15일 (수) 오전 7:56, Takeshi Yamamuro 님이 작성: > >> Congrats, all! >> >> On Wed, Jul 15, 2020 at 5:15 AM Takuya UESHIN >> wrote: >> >>> Congrats an

Re: [DISCUSS] -1s and commits

2020-07-15 Thread Sean Owen
I agree with all that, and would be surprised if anyone here objects to any of that in principle. In practice, I'm sure it doesn't end up that way sometimes, even in good faith. That is, I would not be surprised if the parties involved don't even see the disconnect. What are the specific examples?

[DISCUSS] -1s and commits

2020-07-15 Thread Holden Karau
Hi Spark Development Community, Since Spark 3 has shipped I've been going through some of the PRs and I've noticed some PRs have been merged with pending -1s with technical reasons, including those from committers. I'm bringing this up because I believe we, as PMC, committers and contributors, do

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread Maxim Gekk
Congratulations, Huaxin, Jungtaek, Dilip!!! Maxim Gekk Software Engineer Databricks, Inc. On Wed, Jul 15, 2020 at 8:34 PM Felix Cheung wrote: > Welcome! > > -- > *From:* Nick Pentreath > *Sent:* Tuesday, July 14, 2020 10:21:17 PM > *To:* dev > *Cc:* Dilip Biswal

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-15 Thread Holden Karau
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326 On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ wrote: > i'm not entirely sure when the dep for R got bumped to 3.5+, but it's > breaking the k8s builds. >

R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-15 Thread shane knapp ☠
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds. i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch. this isn't a horrible task as i have most of it automated but it will still require a ~few hours o

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread Felix Cheung
Welcome! From: Nick Pentreath Sent: Tuesday, July 14, 2020 10:21:17 PM To: dev Cc: Dilip Biswal ; Jungtaek Lim ; huaxin gao Subject: Re: Welcoming some new Apache Spark committers Congratulations and welcome as Apache Spark committers! On Wed, 15 Jul 2020 at

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-07-15 Thread Wenchen Fan
Supporting Python 3.8.0 sounds like a new feature, and doesn't qualify a backport. But I'm open to other opinions. On Wed, Jul 15, 2020 at 11:24 PM Ismaël Mejía wrote: > Any chance that SPARK-29536 PySpark does not work with Python 3.8.0 > can be backported to 2.4.7 ? > This was not done for Spa

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-07-15 Thread Ismaël Mejía
Any chance that SPARK-29536 PySpark does not work with Python 3.8.0 can be backported to 2.4.7 ? This was not done for Spark 2.4.6 because it was too late on the vote process but it makes perfect sense to have this in 2.4.7. On Wed, Jul 15, 2020 at 9:07 AM Wenchen Fan wrote: > > Yea I think 2.4.7

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread Jungtaek Lim
Thanks everyone for the warm welcome and all the kind words! Looking forward to collaborate with you all. On Wed, Jul 15, 2020 at 4:17 PM Herman van Hovell wrote: > Congratulations! > > On Wed, Jul 15, 2020 at 9:00 AM angers.zhu wrote: > >> Congratulations ! >> >> angers.zhu >> angers@gmail

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread Herman van Hovell
Congratulations! On Wed, Jul 15, 2020 at 9:00 AM angers.zhu wrote: > Congratulations ! > > angers.zhu > angers@gmail.com > >

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-07-15 Thread Wenchen Fan
Yea I think 2.4.7 is good to go. Let's start! On Wed, Jul 15, 2020 at 1:50 PM Prashant Sharma wrote: > Hi Folks, > > So, I am back, and searched the JIRAS with target version as "2.4.7" and > Resolved, found only 2 jiras. So, are we good to go, with just a couple of > jiras fixed ? Shall I proce

Re: Welcoming some new Apache Spark committers

2020-07-15 Thread angers . zhu
Congratulations !