Re: [DISCUSS] Spark - How to improve our release processes

Hello, I can answer some of your common questions with other Apache projects. > Who currently has permissions for Github actions? Is there a specific owner for that today or a different volunteer each time? The Apache organization owns Github Actions, and committers (contributors with write

Re: [FYI] SPARK-47993: Drop Python 3.8

+1 On Saturday, April 27, 2024, John Zhuge wrote: > +1 > > On Fri, Apr 26, 2024 at 8:41 AM Kent Yao wrote: > >> +1 >> >> yangjie01 于2024年4月26日周五 17:16写道： >> > >> > +1 >> > >> > >> > >> > 发件人: Ruifeng Zheng >> > 日期: 2024年4月26日 星期五 15:05 >> > 收件人: Xinrong Meng >> > 抄送: Dongjoon Hyun ,

Re: [VOTE] Add new `Versions` in Apache Spark JIRA for Versioning of Spark Operator

+1 (non-binding) to using an independent version for the Spark Kubernetes Operator with a compatibility matrix with Spark versions. On Fri, Apr 12, 2024 at 5:31 AM L. C. Hsieh wrote: > Hi all, > > Thanks for all discussions in the thread of "Versioning of Spark > Operator": >

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1(non-binding) I add to the difference will it make that it will also simplify package maintenance and easily release a bug fix/new feature without needing to wait for Pyspark to release. On Mon, Apr 1, 2024 at 4:56 PM Chao Sun wrote: > +1 > > On Sun, Mar 31, 2024 at 10:31 PM Hyukjin Kwon >

Re: Scheduling jobs using FAIR pool

IMO the questions are not limited to Databricks. > The Round-Robin distribution of executors only work in case of empty executors (achievable by enabling dynamic allocation). In case the jobs (part of the same pool) requires all executors, second jobs will still need to wait. This feature in

Re: Re: [DISCUSS] Release Spark 3.5.1?

+1 On Sun, Feb 4, 2024 at 10:13 PM John Zhuge wrote: > +1 > > John Zhuge > > > On Sun, Feb 4, 2024 at 11:23 AM Santosh Pingale > wrote: > >> +1 >> >> On Sun, Feb 4, 2024, 8:18 PM Xiao Li >> wrote: >> >>> +1 >>> >>> On Sun, Feb 4, 2024 at 6:07 AM beliefer wrote: >>> +1

Re: [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

+1 for creating an official Kubernetes operator for Apache Spark On Fri, Nov 10, 2023 at 12:38 AM huaxin gao wrote: > +1 > > On Thu, Nov 9, 2023 at 3:14 PM DB Tsai wrote: > >> +1 >> >> To be completely transparent, I am employed in the same department as >> Zhou at Apple. >> >> I support this

Re: Welcome to Our New Apache Spark Committer and PMCs

Congrats to all of you! On Tue 3 Oct 2023 at 08:15, Rui Wang wrote: > Congratulations! Well deserved! > > -Rui > > > On Mon, Oct 2, 2023 at 10:32 PM Gengliang Wang wrote: > >> Congratulations to all! Well deserved! >> >> On Mon, Oct 2, 2023 at 10:16 PM Xiao Li wrote: >> >>> Hi all, >>> >>>

Re: [ANNOUNCE] Apache Spark 3.5.0 released

I installed the package, tested it with kubernetes master from Jupyter, and tested it with Spark Connect server, all looks good. On Tue, Sep 26, 2023 at 10:45 PM Yuanjian Li wrote: > FYI, we received the handling from Pypi > org yesterday, and the >