Re: Does YARN start new executor in place of the failed one?

2015-09-29 Thread Adrian Tanase
art new executor in place of the failed one? Hello Everyone I use Spark on YARN on EMR-4 The spark program which I run has several jobs/stages and run for about 10 hours During the execution some executors might fail for some reason. BUT I do not see that new executor are started in place of the

Does YARN start new executor in place of the failed one?

2015-09-28 Thread Alexander Pivovarov
Hello Everyone I use Spark on YARN on EMR-4 The spark program which I run has several jobs/stages and run for about 10 hours During the execution some executors might fail for some reason. BUT I do not see that new executor are started in place of the failed ones So, what I see in spark UI is th