Hi, Thanks Mich and Akhil for such prompt responses! Here's the screenshot [1] which is a part of https://issues.apache.org/jira/browse/SPARK-16047 I reported today (to have the executors sorted by status and id).
[1] https://issues.apache.org/jira/secure/attachment/12811665/spark-webui-executors.png Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Sat, Jun 18, 2016 at 6:05 PM, Akhil Das <ak...@hacked.work> wrote: > A screenshot of the executor tab will explain it better. Usually executors > are allocated when the job is started, if you have a multi-node cluster then > you'll see executors launched on different nodes. > > On Sat, Jun 18, 2016 at 9:04 PM, Jacek Laskowski <ja...@japila.pl> wrote: >> >> Hi, >> >> This is for Spark on YARN - a 1-node cluster with Spark 2.0.0-SNAPSHOT >> (today build) >> >> I can understand that when a stage fails a new executor entry shows up >> in web UI under Executors tab (that corresponds to a stage attempt). I >> understand that this is to keep the stdout and stderr logs for future >> reference. >> >> Why are there multiple executor entries under the same executor IDs? >> What are the executor entries exactly? When are the new ones created >> (after a Spark application is launched and assigned the >> --num-executors executors)? >> >> Pozdrawiam, >> Jacek Laskowski >> ---- >> https://medium.com/@jaceklaskowski/ >> Mastering Apache Spark http://bit.ly/mastering-apache-spark >> Follow me at https://twitter.com/jaceklaskowski >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> > > > > -- > Cheers! > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
