Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-09 Thread Maxim Gekk
gnatures. >>>>>>> > * Built from source, with multiple profiles, to full success, for >>>>>>> Java 11 and Scala 2.13: >>>>>>> > * build/mvn -Phadoop-3 -Phadoop-cloud -Phive-thriftserver >>>>>>> -Pkubernetes

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread huaxin gao
gt;>>> > * Tests passed. >>>>>> > * Ran several examples successfully: >>>>>> > * bin/spark-submit --class org.apache.spark.examples.SparkPi >>>>>> examples/jars/spark-examples_2.12-3.3.0.jar >>>>>> >

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread huaxin gao
Thanks Dongjoon for opening a jira to track this issue. I agree this is a flaky test. I have seen the flakiness in our internal tests. I also agree this is a non-blocker because the feature is disabled by default. I will try to take a look to see if I can find the root cause. Thanks, Huaxin On

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread Prashant Singh
;>> > * bin/spark-submit --class >>>>> org.apache.spark.examples.sql.hive.SparkHiveExample >>>>> examples/jars/spark-examples_2.12-3.3.0.jar >>>>> > * bin/spark-submit >>>>> examples/src/main/python/streamin

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread Jerry Peng
rk-examples_2.12-3.3.0.jar >>>> > * bin/spark-submit >>>> examples/src/main/python/streaming/network_wordcount.py localhost >>>> > * Tested some of the issues that blocked prior release candidates: >>>> > * bin/spark-sql -e 'SE

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread Jungtaek Lim
ECT (SELECT IF(x, 1, 0)) AS a FROM (SELECT >>> true) t(x) UNION SELECT 1 AS a;' >>> > * bin/spark-sql -e "select date '2018-11-17' > 1" >>> > * SPARK-39293 ArrayAggregate fix >>> > >>> > Chris Nauroth >>>

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread Hyukjin Kwon
* bin/spark-sql -e 'SELECT (SELECT IF(x, 1, 0)) AS a FROM (SELECT >> true) t(x) UNION SELECT 1 AS a;' >> > * bin/spark-sql -e "select date '2018-11-17' > 1" >> > * SPARK-39293 ArrayAggregate fix >> > >> > Chris Nauroth >> &g

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-08 Thread Hyukjin Kwon
1:30 PM Cheng Su wrote: > >> > >> +1 (non-binding). Built and ran some internal test for Spark SQL. > >> > >> > >> > >> Thanks, > >> > >> Cheng Su > >> > >> > >> > >> From: L. C. Hsieh &g

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread Cheng Pan
>> +1 (non-binding). Built and ran some internal test for Spark SQL. >> >> >> >> Thanks, >> >> Cheng Su >> >> >> >> From: L. C. Hsieh >> Date: Tuesday, June 7, 2022 at 1:23 PM >> To: dev >> Subject: Re: [VOTE] Release Spar

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread Chris Nauroth
e 7, 2022 at 1:23 PM > *To: *dev > *Subject: *Re: [VOTE] Release Spark 3.3.0 (RC5) > > +1 > > Liang-Chi > > On Tue, Jun 7, 2022 at 1:03 PM Gengliang Wang wrote: > > > > +1 (non-binding) > > > > Gengliang > > > > On Tue, Jun 7, 2022 a

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread Cheng Su
+1 (non-binding). Built and ran some internal test for Spark SQL. Thanks, Cheng Su From: L. C. Hsieh Date: Tuesday, June 7, 2022 at 1:23 PM To: dev Subject: Re: [VOTE] Release Spark 3.3.0 (RC5) +1 Liang-Chi On Tue, Jun 7, 2022 at 1:03 PM Gengliang Wang wrote: > > +1 (non-b

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread L. C. Hsieh
+1 Liang-Chi On Tue, Jun 7, 2022 at 1:03 PM Gengliang Wang wrote: > > +1 (non-binding) > > Gengliang > > On Tue, Jun 7, 2022 at 12:24 PM Thomas Graves wrote: >> >> +1 >> >> Tom Graves >> >> On Sat, Jun 4, 2022 at 9:50 AM Maxim Gekk >> wrote: >> > >> > Please vote on releasing the following

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread Thomas Graves
+1 Tom Graves On Sat, Jun 4, 2022 at 9:50 AM Maxim Gekk wrote: > > Please vote on releasing the following candidate as Apache Spark version > 3.3.0. > > The vote is open until 11:59pm Pacific time June 8th and passes if a majority > +1 PMC votes are cast, with a minimum of 3 +1 votes. > > [ ]

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-07 Thread Martin Grigorov
Hi, [X] +1 Release this package as Apache Spark 3.3.0 Tested: - make local distribution from sources (with ./dev/make-distribution.sh --tgz --name with-volcano -Pkubernetes,volcano,hadoop-3) - create a Docker image (with JDK 11) - run Pi example on -- local -- Kubernetes with default scheduler

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-06 Thread Yikun Jiang
+1 (non-binding) 1. Verify binary checksums and signatures. 2. Check kubernetes and pyspark documentation 3. Verify K8S integration test on aarch64 4. Verify customized scheduler and volcano integration test with Volcano 1.5.1. On Mon, Jun 6, 2022 at 3:43 PM Dongjoon Hyun wrote: > +1. > > I

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-06 Thread Yuming Wang
+1. Ran and verified results through internal tests. On Mon, Jun 6, 2022 at 3:43 PM Dongjoon Hyun wrote: > +1. > > I double-checked the following additionally. > > - Run unit tests on Apple Silicon with Java 17/Python 3.9.11/R 4.1.2 > - Run unit tests on Linux with Java11/Scala 2.12/2.13 > -

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-06 Thread Dongjoon Hyun
+1. I double-checked the following additionally. - Run unit tests on Apple Silicon with Java 17/Python 3.9.11/R 4.1.2 - Run unit tests on Linux with Java11/Scala 2.12/2.13 - K8s integration test (including Volcano batch scheduler) on K8s v1.24 - Check S3 read/write with spark-shell with Scala

Re: [VOTE] Release Spark 3.3.0 (RC5)

2022-06-04 Thread Sean Owen
+1 looks good now on Scala 2.13 On Sat, Jun 4, 2022 at 9:51 AM Maxim Gekk wrote: > Please vote on releasing the following candidate as > Apache Spark version 3.3.0. > > The vote is open until 11:59pm Pacific time June 8th and passes if a > majority +1 PMC votes are cast, with a minimum of 3 +1

[VOTE] Release Spark 3.3.0 (RC5)

2022-06-04 Thread Maxim Gekk
Please vote on releasing the following candidate as Apache Spark version 3.3.0. The vote is open until 11:59pm Pacific time June 8th and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.3.0 [ ] -1 Do not release this package