Re: Spark 3 pod template for the driver

2020-06-29 Thread Michel Sumbul
Hello, Adding the dev mailing list maybe there is someone here that can help to have/show a valid/accepted pod template for spark 3? Thanks in advance, Michel Le ven. 26 juin 2020 à 14:03, Michel Sumbul a écrit : > Hi Jorge, > If I set that in the spark submit command it works but I want it

Re: Spark 3 pod template for the driver

2020-06-26 Thread Michel Sumbul
Hi Jorge, If I set that in the spark submit command it works but I want it only in the pod template file. Best regards, Michel Le ven. 26 juin 2020 à 14:01, Jorge Machado a écrit : > Try to set spark.kubernetes.container.image > > On 26. Jun 2020, at 14:58, Michel Sumbul wrote: > > Hi guys, >

Re: Spark 3 pod template for the driver

2020-06-26 Thread Jorge Machado
Try to set spark.kubernetes.container.image > On 26. Jun 2020, at 14:58, Michel Sumbul wrote: > > Hi guys, > > I try to use Spark 3 on top of Kubernetes and to specify a pod template for > the driver. > > Here is my pod manifest or the driver and when I do a spark-submit with the > option:

Spark 3 pod template for the driver

2020-06-26 Thread Michel Sumbul
Hi guys, I try to use Spark 3 on top of Kubernetes and to specify a pod template for the driver. Here is my pod manifest or the driver and when I do a spark-submit with the option: --conf spark.kubernetes.driver.podTemplateFile=/data/k8s/podtemplate_driver3.yaml I got the error message that I

Spark 3 pod template for the driver

2020-06-26 Thread Michel Sumbul
Hi guys, I try to use Spark 3 on top of Kubernetes and to specify a pod template for the driver. Here is my pod manifest or the driver and when I do a spark-submit with the option: --conf spark.kubernetes.driver.podTemplateFile=/data/k8s/podtemplate_driver3.yaml I got the error message that I