Re: can't kill spark job in supervise mode

Hi Duc, Are you running Spark on Mesos with cluster mode? And what's your cluster mode submission, and version of Spark are you running? Tim On Sat, Jan 30, 2016 at 8:19 AM, PhuDuc Nguyen wrote: > I have a spark job running on Mesos in multi-master and supervise mode.

Re: can't kill spark job in supervise mode

Hi Tim, Yes we are running Spark on Mesos in cluster mode with supervise flag. Submit script looks like this: spark-submit \ --conf "spark.executor.extraJavaOptions=-XX:+UseG1GC -XX:+UseCompressedOops -XX:-UseGCOverheadLimit" \ --supervise \ --deploy-mode cluster \ --class \ --master

can't kill spark job in supervise mode

I have a spark job running on Mesos in multi-master and supervise mode. If I kill it, it is resilient as expected and respawns on another node. However, I cannot kill it when I need to. I have tried 2 methods: 1) ./bin/spark-class org.apache.spark.deploy.Client kill 2)