Re: [build system] jenkins down, working on it

2021-05-04 Thread shane knapp ☠
we're back and building! On Tue, May 4, 2021 at 4:03 PM shane knapp ☠ wrote: > jenkins went down some time in the past few days, and i'm currently > investigating. > > if it's been down a while, i apologize as i've been dealing w/some health > issues. > > shane > -- > Shane Knapp > Computer Guy

[build system] jenkins down, working on it

2021-05-04 Thread shane knapp ☠
jenkins went down some time in the past few days, and i'm currently investigating. if it's been down a while, i apologize as i've been dealing w/some health issues. shane -- Shane Knapp Computer Guy / Voice of Reason UC Berkeley EECS Research / RISELab Staff Technical Lead

RE: [VOTE] Release Spark 2.4.8 (RC3)

2021-05-04 Thread Liang-Chi Hsieh
Hi, Yes, RC3 fails due to an ancient bug found during this RC. I will cut RC4 soon. Thank you. Nicholas Marion wrote > Hi, > > Was it decided to fail RC3 in favor of RC4? > > > > > Regards,

RE: [VOTE] Release Spark 2.4.8 (RC3)

2021-05-04 Thread Nicholas Marion
Hi, Was it decided to fail RC3 in favor of RC4? Regards,

Re: [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API

2021-05-04 Thread Паша
I've created my own implicit withColumnsRenamed for such a purpose which just accepted a map of string→string and called rename multiple times. вт, 4 мая 2021 г. в 10:22, Yikun Jiang : > @Saurabh @Mr.Powers Thanks for the input information. > > I personal perfer to introduce the `withColumns`

Re: [apache/spark-website] Update contributing to include code of conduct section (#335)

2021-05-04 Thread Sean Owen
Just FYI - proposed update to the CoC for the project. Looks reasonable to simply adopt the ASF code of conduct, per the PR. On Tue, May 4, 2021 at 2:02 AM Jungtaek Lim wrote: > I think the rationalization is great, but why not going through dev@ > mailing list? Many contributors are

Re: [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API

2021-05-04 Thread Yikun Jiang
@Saurabh @Mr.Powers Thanks for the input information. I personal perfer to introduce the `withColumns` because it bring more friendly development experience rather than select( * ). This is the PR to add `withColumns`: https://github.com/apache/spark/pull/32431 Regards, Yikun Saurabh Chawla