OK, the thing is that the JVMs are not shut down when you cancel the task. Therefore no shut down hook is executed when you cancel.
You would have to execute bin/stop-cluster.sh to stop the JVM. Does that make sense? On Wed, Mar 8, 2017 at 3:34 PM, Dominik Safaric <dominiksafa...@gmail.com> wrote: > I’m not using YARN but instead of starting the cluster using > bin/start-cluster.sh > >> On 8 Mar 2017, at 15:32, Ufuk Celebi <u...@apache.org> wrote: >> >> On Wed, Mar 8, 2017 at 3:19 PM, Dominik Safaric >> <dominiksafa...@gmail.com> wrote: >>> The cluster consists of 4 workers and a master node. >> >> Are you starting the cluster via bin/start-cluster.sh or are you using >> YARN etc.? >
