A screenshot of the executor tab will explain it better. Usually executors are allocated when the job is started, if you have a multi-node cluster then you'll see executors launched on different nodes.
On Sat, Jun 18, 2016 at 9:04 PM, Jacek Laskowski <ja...@japila.pl> wrote: > Hi, > > This is for Spark on YARN - a 1-node cluster with Spark 2.0.0-SNAPSHOT > (today build) > > I can understand that when a stage fails a new executor entry shows up > in web UI under Executors tab (that corresponds to a stage attempt). I > understand that this is to keep the stdout and stderr logs for future > reference. > > Why are there multiple executor entries under the same executor IDs? > What are the executor entries exactly? When are the new ones created > (after a Spark application is launched and assigned the > --num-executors executors)? > > Pozdrawiam, > Jacek Laskowski > ---- > https://medium.com/@jaceklaskowski/ > Mastering Apache Spark http://bit.ly/mastering-apache-spark > Follow me at https://twitter.com/jaceklaskowski > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Cheers!
