Re: Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread dawn breaks
It seems that fabric8 kubernetes client can't parse the caCertFile in the default location /var/run/secrets/kubernetes.io/serviceaccount/ca.crt, and anybody give me some advices? On Wed, 13 Feb 2019 at 16:21, dawn breaks <2005dawnbre...@gmail.com> wrote: > we submit spark j

Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread dawn breaks
we submit spark job to k8s by the following command, and the driver pod got an error and exit. Anybody can help us to solve it? ./bin/spark-submit \ --master k8s://https://172.21.91.48:6443 \ --deploy-mode cluster \ --conf spark.kubernetes.authenticate.driver.serviceAccountName=spark