Hi, This is for Spark on YARN - a 1-node cluster with Spark 2.0.0-SNAPSHOT (today build)
I can understand that when a stage fails a new executor entry shows up in web UI under Executors tab (that corresponds to a stage attempt). I understand that this is to keep the stdout and stderr logs for future reference. Why are there multiple executor entries under the same executor IDs? What are the executor entries exactly? When are the new ones created (after a Spark application is launched and assigned the --num-executors executors)? Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
