There is currently no such an option. But this has been raised before in https://issues.apache.org/jira/browse/SPARK-25515.
On Tue, Oct 9, 2018 at 2:17 PM Li Gao <ligao...@gmail.com> wrote: > Hi, > > Is there an option to keep the executor pods on k8s after the job > finishes? We want to extract the logs and stats before removing the > executor pods. > > Thanks, > Li >