Hi, > as Executors terminates after their work completes.
--conf spark.kubernetes.executor.deleteOnTermination=false ? Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski "The Internals Of" Online Books <https://books.japila.pl/> Follow me on https://twitter.com/jaceklaskowski <https://twitter.com/jaceklaskowski> On Sun, Mar 7, 2021 at 5:23 PM Ranju Jain <ranju.j...@ericsson.com.invalid> wrote: > Hi, > > > > I need to save the Executors processed data in the form of part files , > but I think persistent Volume is not an option for this as Executors > terminates after their work completes. > > So I am thinking to use shared volume across executor pods. > > > > Should I go with NFS or is there any other Volume option as well to > explore? > > > > Regards > > Ranju >
