I believe you are using something like `local[8]` as your Spark mater, which can't retry tasks. Please try `local[8, 3]` which can re-try failed tasks 3 times.
On Tue, Jul 3, 2018 at 2:42 PM assaf.mendelson <assaf.mendel...@rsa.com> wrote: > That is what I expected, however, I did a very simple test (using println > just to see when the exception is triggered in the iterator) using local > master and I saw it failed once and cause the entire operation to fail. > > Is this something which may be unique to local master (or some default > configuration which should be tested)? I can't see a specific > configuration > to handle this in the documentation. > > Thanks, > Assaf. > > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
