Re: Directory creation failed leads to job fail (should it?)

2015-06-29 Thread Max Demoulin
;>> master logs: http://pastebin.com/v3NCzm0u >>>> worker's logs: http://pastebin.com/Ninkscnx >>>> >>>> It seems that some of the executors can create the directories, but as >>>> some >>>> others are repetitively failing, the job ends

Re: Directory creation failed leads to job fail (should it?)

2015-06-29 Thread ayan guha
vely failing, the job ends up failing. Shouldn't spark >>> manage to keep working with a smallest number of executors instead of >>> failing? >>> >>> >>> >>> >>> >>> -- >>> View this message in context: >>>

Re: Directory creation failed leads to job fail (should it?)

2015-06-29 Thread Max Demoulin
working with a smallest number of executors instead of >> failing? >> >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Directory-creation-failed-leads-to-job-fail-should-it-tp23531.html >>

Re: Directory creation failed leads to job fail (should it?)

2015-06-29 Thread ayan guha
> > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Directory-creation-failed-leads-to-job-fail-should-it-tp23531.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --

Directory creation failed leads to job fail (should it?)

2015-06-29 Thread maxdml
http://apache-spark-user-list.1001560.n3.nabble.com/Directory-creation-failed-leads-to-job-fail-should-it-tp23531.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail