Hi I have an spark application where driver starts few tasks and In each task which is a VoidFunction , I have a long running infinite loop. I have set speculative execution to false.
Will spark kill my task after sometime (Timeout) or tasks will run infinitely? If tasks will be killed after sometime (whats that duration) and how to run tasks infinite long? Thansk
