[VOTE][RESULT] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Maxim Gekk
The vote passes with 16 +1s (8 binding +1s). Thanks to all who helped with the release! (* = binding) +1: Wenchen Fan (*) Herman van Hovell (*) Gengliang Wang Sean Owen (*) Tom Graves (*) Mridul Muralidharan (*) Chris Nauroth Dongjoon Hyun (*) Yuming Wang Holden Karau (*) L. C. Hsieh (*) Cheng Su

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Maxim Gekk
Hi All, Here are the results of voting for RC6. +1: Wenchen Fan (*) Herman van Hovell (*) Gengliang Wang Sean Owen (*) Tom Graves (*) Mridul Muralidharan (*) Chris Nauroth Dongjoon Hyun (*) Yuming Wang Holden Karau (*) L. C. Hsieh (*) Cheng Su Chao Sun Martin Grigorov Peter Toth Max Gekk 8

Re: Stickers and Swag

2022-06-14 Thread Qian Sun
GOOD! Could these are mailed to China? > 2022年6月14日 下午2:04,Xiao Li 写道: > > Hi, all, > > The ASF has an official store at RedBubble > that Apache Community > Development (ComDev) runs. If you are interested in buying Spark Swag, 70 > products

Re: Stickers and Swag

2022-06-14 Thread Reynold Xin
Nice! Going to order a few items myself ... On Tue, Jun 14, 2022 at 7:54 PM, Gengliang Wang < ltn...@gmail.com > wrote: > > FYI now you can find the shopping information on https:/ / spark. apache. org/ > community ( https://spark.apache.org/community ) as well :) > > > > Gengliang > > >

Re: Stickers and Swag

2022-06-14 Thread Gengliang Wang
FYI now you can find the shopping information on https://spark.apache.org/community as well :) Gengliang > On Jun 14, 2022, at 7:47 PM, Hyukjin Kwon wrote: > > Woohoo > > On Tue, 14 Jun 2022 at 15:04, Xiao Li > wrote: >

Re: Stickers and Swag

2022-06-14 Thread Hyukjin Kwon
Woohoo On Tue, 14 Jun 2022 at 15:04, Xiao Li wrote: > Hi, all, > > The ASF has an official store at RedBubble > that Apache Community > Development (ComDev) runs. If you are interested in buying Spark Swag, 70 > products featuring the Spark logo

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Pralabh Kumar
Thx for the reply @Steve Loughran @Martin . It helps . However just a minor suggestion - Should we update the documentation https://spark.apache.org/docs/latest/#downloading , which talks about java.nio.DirectByteBuffer . We can add another case , where user will get the same error

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Peter Toth
+1 Martin Grigorov ezt írta (időpont: 2022. jún. 14., K, 13:23): > Hi, > > [X] +1 Release this package as Apache Spark 3.3.0 > > Tested: > - make local distribution from sources (with ./dev/make-distribution.sh > --tgz --name with-volcano -Pkubernetes,volcano,hadoop-3) > - create a Docker

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Martin Grigorov
Hi, [X] +1 Release this package as Apache Spark 3.3.0 Tested: - make local distribution from sources (with ./dev/make-distribution.sh --tgz --name with-volcano -Pkubernetes,volcano,hadoop-3) - create a Docker image (with JDK 11) - run Pi example on -- local -- Kubernetes with default scheduler

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Steve Loughran
hadoop 3.2.x is the oldest of the hadoop branch 3 branches which gets active security patches, as was done last month. I would strongly recommend using it unless there are other compatibility issues (hive?) On Tue, 14 Jun 2022 at 05:31, Pralabh Kumar wrote: > Hi Steve / Dev team > > Thx for the

Re:Re: [VOTE][SPIP] Spark Connect

2022-06-14 Thread beliefer
+1 Yeah, I tried to use Apache Livy, so as we can runing interactive query. But the Spark Driver in Livy looks heavy. The SPIP may resolve the issue. At 2022-06-14 18:11:21, "Wenchen Fan" wrote: +1 On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng wrote: +1 -- 原始邮件

Re: [VOTE][SPIP] Spark Connect

2022-06-14 Thread Wenchen Fan
+1 On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng wrote: > +1 > > > -- 原始邮件 -- > *发件人:* "huaxin gao" ; > *发送时间:* 2022年6月14日(星期二) 上午8:47 > *收件人:* "L. C. Hsieh"; > *抄送:* "Spark dev list"; > *主题:* Re: [VOTE][SPIP] Spark Connect > > +1 > > On Mon, Jun 13, 2022 at 5:42

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Martin Grigorov
Hi Pralabh, The Dockerfile defines and ARG for the JDK version: https://github.com/apache/spark/blob/861df43e8d022f51727e0a12a7cca5e119e3c4cc/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile#L17 That means you could use --build-arg to overwrite it when building the image.

Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Jungtaek Lim
+1 (non-binding) Checked signature and checksum. Confirmed SPARK-39412 is resolved. Built source tgz with JDK 11. Thanks Max for driving the efforts of this huge release! On Tue, Jun 14, 2022 at 2:51 PM huaxin gao wrote: > +1 (non-binding) >

Stickers and Swag

2022-06-14 Thread Xiao Li
Hi, all, The ASF has an official store at RedBubble that Apache Community Development (ComDev) runs. If you are interested in buying Spark Swag, 70 products featuring the Spark logo are available: https://www.redbubble.com/shop/ap/113203780 Go