Re: [VOTE] Release Spark 3.0.3 (RC1)

+1. Docs looks good. Binary looks good. Ran simple test and some tpcds queries. Thanks for working on this! wuyi wrote > Please vote on releasing the following candidate as Apache Spark version > 3.0.3. > > The vote is open until Jun 21th 3AM (PST) and passes if a majority +1 PMC > votes are c

Re: Spark on Kubernetes scheduler variety

I think these approaches are good, but there are limitations (eg dynamic scaling) without us making changes inside of the Spark Kube scheduler. Certainly whichever scheduler extensions we add support for we should collaborate with the people developing those extensions insofar as they are interest

Re: [VOTE] Release Spark 3.0.3 (RC1)

+1  Ran through some internal tests. Thanks,Tom On Thursday, June 17, 2021, 05:11:21 AM CDT, Yi Wu wrote: Please vote on releasing the following candidate as Apache Spark version 3.0.3. The vote is open until Jun 21th 3AM (PST) and passes if a majority +1 PMC votes are cast, with a mi

Re: Spark on Kubernetes scheduler variety

Hi, Regarding your point and I quote ".. I know that one of the Spark on Kube operators supports volcano/kube-batch so I was thinking that might be a place I would start exploring..." There seems to be ongoing work on say Volcano as part of Cloud Native Computing Foundation