Re: [Fork] ]RE: One click to run Spark on Kubernetes

2022-02-23 Thread Mich Talebzadeh
Hi Janak, Are you talking about EKS Fargate? Thanks view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction o

RE: [Fork] ]RE: One click to run Spark on Kubernetes

2022-02-23 Thread Agarwal, Janak
Hey Mich, EMR on EKS works on both EKS-Fargate and EKS-managed/self-managed EC2 based node groups. Thanks, Janak From: Mich Talebzadeh Sent: Wednesday, February 23, 2022 10:46 AM To: Agarwal, Janak Cc: Spark dev list Subject: RE: [EXTERNAL] [Fork] ]R

Re: [Fork] ]RE: One click to run Spark on Kubernetes

2022-02-23 Thread Mich Talebzadeh
Thanks Janak, the same as GKE conventional or GKE autopilot. Putting conventional aside, why do you think customers should choose a fully managed package* for Spark*? thanks view my Linkedin profile

RE: [Fork] ]RE: One click to run Spark on Kubernetes

2022-02-23 Thread Agarwal, Janak
Mich, Not sure I follow you since I do not fully understand what GKE conventional is (which at first glance, appears to help customers to setup Kubernetes environment). EMR on EKS offers a fully managed control plane (among other benefits such as Spark UI for completed jobs) that allows custome