Re: Welcome to Our New Apache Spark Committer and PMCs

Congrats! On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: > Congratulations! > > Prashant Sharma 于2023年10月6日周五 00:26写道： > > > > Congratulations  > > > > On Wed, 4 Oct, 2023, 8:52 pm huaxin gao, wrote: > >> > >> Congratulations! > >> > >> On Wed, Oct 4, 2023 at 7:39 AM Chao Sun wrote: > >>>

Re: Welcoming three new PMC members

Congrats everyone! On Wed, Aug 10, 2022 at 11:33 AM Yuanjian Li wrote: > Congrats everyone! > > L. C. Hsieh 于2022年8月9日 周二19:01写道： > >> Congrats! >> >> On Tue, Aug 9, 2022 at 5:38 PM Chao Sun wrote: >> > >> > Congrats everyone! >> > >> > On Tue, Aug 9, 2022 at 5:36 PM Dongjoon Hyun >> wrote:

Re: Welcome Xinrong Meng as a Spark committer

Congrats Xinrong!! On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk wrote: > Congratulations, Xinrong! > > Maxim Gekk > > Software Engineer > > Databricks, Inc. > > > On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu > wrote: > >> Congrats! >> >> On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim >> wrote: >> >>>

Re: [PSA] Please rebase and sync your master branch in your forked repository

Thanks for the work, Hyukjin. On Tue, Jun 21, 2022 at 7:59 AM Yuming Wang wrote: > Thank you Hyukjin. > > On Tue, Jun 21, 2022 at 7:46 AM Hyukjin Kwon wrote: > >> After https://github.com/apache/spark/pull/36922 gets merged, it >> requires your fork's master branch to be synced to the latest

Re: [VOTE] Release Spark 3.2.0 (RC7)

+1 (non-binding) On Mon, Oct 11, 2021 at 1:57 PM Holden Karau wrote: > +1 > > On Sun, Oct 10, 2021 at 10:46 PM Wenchen Fan wrote: > >> +1 >> >> On Sat, Oct 9, 2021 at 2:36 PM angers zhu wrote: >> >>> +1 (non-binding) >>> >>> Cheng Pan 于2021年10月9日周六 下午2:06写道： >>> +1 (non-binding)

Re: [VOTE] Release Spark 3.2.0 (RC4)

+1 (non-binding) Thanks for the work, Gengliang! Bests, Yi On Thu, Sep 23, 2021 at 10:03 PM Gengliang Wang wrote: > Starting with my +1(non-binding) > > Thanks, > Gengliang > > On Thu, Sep 23, 2021 at 10:02 PM Gengliang Wang wrote: > >> Please vote on releasing the following candidate as >>

Re: [VOTE] Release Spark 3.2.0 (RC1)

; Gengliang > > On Wed, Aug 25, 2021 at 2:50 AM Sean Owen wrote: > >> I think we'll need this revert: >> https://github.com/apache/spark/pull/33819 >> >> Between that and a few other minor but important issues I think I'd say >> -1 myself and ask for another RC.

Re: [VOTE] Release Spark 3.2.0 (RC1)

-1. I found a bug (https://issues.apache.org/jira/browse/SPARK-36558) in the push-based shuffle, which could lead to job hang. Bests, Yi On Sat, Aug 21, 2021 at 1:05 AM Gengliang Wang wrote: > Please vote on releasing the following candidate as Apache Spark version > 3.2.0. > > The vote is

[ANNOUNCE] Apache Spark 3.0.3 released

We are happy to announce the availability of Spark 3.0.3! Spark 3.0.3 is a maintenance release containing stability fixes. This release is based on the branch-3.0 maintenance branch of Spark. We strongly recommend all 3.0 users to upgrade to this stable release. To download Spark 3.0.3, head

Re: [VOTE] Release Spark 3.0.3 (RC1)

The vote passes with 12 +1s (8 binding +1s). Thanks to all who helped with the release! (* = binding) +1: - Sean Owen* - Thomas Graves* - Liang-Chi Hsieh* - Mridul Muralidharan* - Yuming Wang* - Dongjoon Hyun* - Hyukjin Kwon* - Gengliang Wang - Kent Yao - Jungtaek Lim - Takeshi Yamamuro* - Maxim

[VOTE] Release Spark 3.0.3 (RC1)

Please vote on releasing the following candidate as Apache Spark version 3.0.3. The vote is open until Jun 21th 3AM (PST) and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.0.3 [ ] -1 Do not release this package because ...

Re: Apache Spark 3.0.3 Release?

Thanks all, I'll start the RC soon. On Wed, Jun 9, 2021 at 7:07 PM Gengliang Wang wrote: > +1, thanks Yi > > Gengliang Wang > > > > > On Jun 9, 2021, at 6:03 PM, 郑瑞峰 wrote: > > +1, thanks Yi > > >

Apache Spark 3.0.3 Release?

Hi, All. Since Apache Spark 3.0.2 tag creation (Feb 16), new 119 patches (92 issues resolved) arrived at branch-3.0. Shall we make a new release, Apache Spark 3.0.3, as the 3rd release at the 3.0 line? I'd like to volunteer as the

Re: Bintray replacement for spark-packages.org

Hi wenchen, I'd like to volunteer for Apache Spark 3.0.3 release. Thanks, Yi On Fri, Apr 30, 2021 at 12:37 AM Dongjoon Hyun wrote: > I agree with Wenchen. > > I can volunteer for Apache Spark 3.1.2 release manager at least. > > Bests, > Dongjoon. > > > On Wed, Apr 28, 2021 at 10:15 AM Wenchen

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

Thanks for the great work, Hyukjin! On Wed, Apr 14, 2021 at 1:00 PM Gengliang Wang wrote: > Thanks for the amazing work, Hyukjin! > I created a PR for trial and it looks well so far: > https://github.com/apache/spark/pull/32158 > > On Wed, Apr 14, 2021 at 12:47 PM Hyukjin Kwon wrote: > >> Hi

Re: Welcoming six new Apache Spark committers

t 7:13 AM Takeshi Yamamuro < >>>>>>>>> linguin@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Congrats, all~ >>>>>>>>>> >>>>>>>>>> On Sat, Mar 27, 2021 at 7:46 AM J

K8s Integration test is unable to run because of the unavailable libs

Hi devs, It seems like the K8s Integration test is unable to run recently because of the unavailable libs: Err:20 http://security.debian.org/debian-security buster/updates/main amd64 libldap-common all 2.4.47+dfsg-3+deb10u4 404 Not Found [IP: 151.101.194.132 80] Err:21

Re: Apache Spark 3.2 Expectation

+1 to continue the incompleted push-based shuffle. -- Yi On Fri, Feb 26, 2021 at 1:26 AM Mridul Muralidharan wrote: > > > Nit: Java 17 -> should be available by Sept 2021 :-) > Adoption would also depend on some of our nontrivial dependencies > supporting it - it might be a stretch to get it

Re: I'm going to be out starting Nov 5th

Take care and stay strong, Holden! Bests, Yi On Mon, Nov 2, 2020 at 2:15 AM Driesprong, Fokko wrote: > Hope everything goes well, and see you soon Holden! Take care and stay > strong! > > Cheers, Fokko > > Op zo 1 nov. 2020 om 18:09 schreef rahul kumar : > >> >> Come back strong and healthy

Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency

+1. Thank you for the effort! Best regards, Yi On Tue, Sep 15, 2020 at 3:44 PM Wenchen Fan wrote: > +1 > > On Tue, Sep 15, 2020 at 2:42 PM Dongjoon Hyun > wrote: > >> +1 >> >> Bests, >> Dongjoon. >> >> On Mon, Sep 14, 2020 at 9:19 PM kalyan wrote: >> >>> +1 >>> >>> Will positively improve

Re: [DISCUSS] Apache Spark 3.0.1 Release

> scala> spark.udf.register("key", udf((m: Map[String, String]) => > m.keys.head.toInt)) > > res1: org.apache.spark.sql.expressions.UserDefinedFunction = > SparkUserDefinedFunction($Lambda$1958/948653928@5d6bed7b,IntegerType,List(Some(class[value[0]: >

Re: Welcoming some new Apache Spark committers

Congrats!! On Wed, Jul 15, 2020 at 8:02 AM Hyukjin Kwon wrote: > Congrats! > > 2020년 7월 15일 (수) 오전 7:56, Takeshi Yamamuro 님이 작성: > >> Congrats, all! >> >> On Wed, Jul 15, 2020 at 5:15 AM Takuya UESHIN >> wrote: >> >>> Congrats and welcome! >>> >>> On Tue, Jul 14, 2020 at 1:07 PM Bryan Cutler

Re: [DISCUSS] Apache Spark 3.0.1 Release

t; > "two")).toDF("a").createOrReplaceTempView("t") > > scala> sql("SELECT key(a) AS k FROM t GROUP BY key(a)").collect > res3: Array[org.apache.spark.sql.Row] = Array([1]) > > > Could you provide a reproducible example? > > Bests,

Re: [DISCUSS] Apache Spark 3.0.1 Release

This probably be a blocker: https://issues.apache.org/jira/browse/SPARK-32307 On Tue, Jul 14, 2020 at 11:13 PM Sean Owen wrote: > https://issues.apache.org/jira/browse/SPARK-32234 ? > > On Tue, Jul 14, 2020 at 9:57 AM Shivaram Venkataraman > wrote: > > > > Hi all > > > > Just wanted to check