I'm not running on GKE. I am wondering what's the long term strategy around a Spark operator. Operators are the de-facto way to run complex deployments. The Flink community now has an official community led operator, and I was wondering if there are any similar plans for Spark.
On Fri, Apr 14, 2023, 19:51 Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Hi, > > What exactly are you trying to achieve? Spark on GKE works fine and you > can run Datapoc now on GKE > https://www.linkedin.com/pulse/running-google-dataproc-kubernetes-engine-gke-spark-mich/?trackingId=lz12GC5dRFasLiaJm5qDSw%3D%3D > > Unless I misunderstood your point. > > HTH > > > Mich Talebzadeh, > Lead Solutions Architect/Engineering Lead > Palantir Technologies Limited > London > United Kingdom > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Fri, 14 Apr 2023 at 17:42, Yuval Itzchakov <yuva...@gmail.com> wrote: > >> Hi, >> >> ATM I see the most used option for a Spark operator is the one provided >> by Google: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator >> >> Unfortunately, it doesn't seem actively maintained. Are there any plans >> to support an official Apache Spark community driven operator? >> >
