Re: Spark on Kube (virtua) coffee/tea/pop times

Hello, I am also interested, please add me to the conf. ср, 8 февр. 2023 г., 07:21 Jayabindu Singh : > Greetings everyone! > I am super new to this group and currently leading some work to deploy > spark on k8 for my company o9 Solutions. > I would love to join the discussion. > I am in PST. >

Re: Time for Spark 3.3.1 release?

lcdn.apache.org/spark/spark-3.3.0/ > > spark-3.3.0-bin-hadoop3-scala2.13.tgz > spark-3.3.0-bin-hadoop3.tgz > > [image: Screenshot 2022-09-14 at 9.03.27 AM.png] > > Dongjoon. > > On Wed, Sep 14, 2022 at 12:31 AM Denis Bolshakov < > bolshakov.de...@gmail.c

Re: Time for Spark 3.3.1 release?

3SUnFjTdf47bb94KmZHTTKE%2bBHbIT27Rog%3d%3d> >>> >> >>> >> >>> >> >>> >> Correctness issues: >>> >> >>> >> SPARK-40149: Propagate metadata columns through Project >>> >> >>> >> SPARK-40002: Don't push down limit through window using ntile >>> >> >>> >> SPARK-39976: ArrayIntersect should handle null in left expression >>> correctly >>> >> >>> >> SPARK-39833: Disable Parquet column index in DSv1 to fix a >>> correctness issue in the case of overlapping partition and data columns >>> >> >>> >> SPARK-39061: Set nullable correctly for Inline output attributes >>> >> >>> >> SPARK-39887: RemoveRedundantAliases should keep aliases that make the >>> output of projection nodes unique >>> >> >>> >> SPARK-38614: Don't push down limit through window that's using >>> percent_rank >>> >>> - >>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>> >>> -- >> John Zhuge >> > -- //with Best Regards --Denis Bolshakov e-mail: bolshakov.de...@gmail.com

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

ers > with the docker image tool, these are provided to make it easier for folks > without specific needs. In the future well hopefully have published Spark > containers tagged for different JDKs but that work has not yet been done. > > On Tue, Feb 22, 2022 at 10:51 AM Denis Bolshako

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

g from such loss, damage or destruction. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, 21 Feb 2022 at 21:09, Holden Karau >>>>>>>> wrote: >>>>>>>> >>>>>>>>> We are happy to announce the availability of Spark 3.1.3! >>>>>>>>> >>>>>>>>> Spark 3.1.3 is a maintenance release containing stability fixes. >>>>>>>>> This >>>>>>>>> release is based on the branch-3.1 maintenance branch of Spark. We >>>>>>>>> strongly >>>>>>>>> recommend all 3.1 users to upgrade to this stable release. >>>>>>>>> >>>>>>>>> To download Spark 3.1.3, head over to the download page: >>>>>>>>> https://spark.apache.org/downloads.html >>>>>>>>> >>>>>>>>> To view the release notes: >>>>>>>>> https://spark.apache.org/releases/spark-release-3-1-3.html >>>>>>>>> >>>>>>>>> We would like to acknowledge all community members for >>>>>>>>> contributing to this >>>>>>>>> release. This release would not have been possible without you. >>>>>>>>> >>>>>>>>> *New Dockerhub magic in this release:* >>>>>>>>> >>>>>>>>> We've also started publishing docker containers to the Apache >>>>>>>>> Dockerhub, >>>>>>>>> these contain non-ASF artifacts that are subject to different >>>>>>>>> license terms than the >>>>>>>>> Spark release. The docker containers are built for Linux x86 and >>>>>>>>> ARM64 since that's >>>>>>>>> what I have access to (thanks to NV for the ARM64 machines). >>>>>>>>> >>>>>>>>> You can get them from https://hub.docker.com/apache/spark (and >>>>>>>>> spark-r and spark-py) :) >>>>>>>>> (And version 3.2.1 is also now published on Dockerhub). >>>>>>>>> >>>>>>>>> Holden >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Twitter: https://twitter.com/holdenkarau >>>>>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Twitter: https://twitter.com/holdenkarau >>>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> Twitter: https://twitter.com/holdenkarau >>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>> >>>> >> >> -- >> Bjørn Jørgensen >> Vestre Aspehaug 4 >> <https://www.google.com/maps/search/Vestre+Aspehaug+4?entry=gmail=g>, >> 6010 Ålesund >> Norge >> >> +47 480 94 297 >> > -- > > > >view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > -- //with Best Regards --Denis Bolshakov e-mail: bolshakov.de...@gmail.com

Re: Moving Scala 2.12 forward one step

0.8 support, the 2.12 REPL, > etc, are not here. > > So, this still doesn't result in a working 2.12 build but it's most of the > miscellany that will be required. > > I'd like to merge it but wanted to flag it for feedback as it's not > trivial. > -- //with Best Regards --Denis Bolshakov e-mail: bolshakov.de...@gmail.com

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

e up for the next 72 hours. Please reply with your vote: >> >> +1: Yeah, let's go forward and implement the SPIP. >> +0: Don't really care. >> -1: I don't think this is a good idea because of the following >> technical reasons. >> >> Thanks! >> >> -- >> Marcelo >> >> - >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> >> -- //with Best Regards --Denis Bolshakov e-mail: bolshakov.de...@gmail.com

Re: Request for comments: Java 7 removal

update of the > Java code to take advantage of Java 8; this is more or less the baseline > change. > > We also just removed Hadoop 2.5 support. I know there was talk about > removing Python 2.6. I have no opinion on that myself, but, might be time > to revive that conversation to

spark roadmap

Hello spark devs, Does any one can provide a roadmap for the nearest two months? Or at least say when we can expect 2.1 release and which features will be added? -- //with Best Regards --Denis Bolshakov e-mail: bolshakov.de...@gmail.com