Hello, Thanks for the question. 1) Typically the Resource Manager in YARN would print out the Aggregate Resource Allocation for the application after you have found the specific application using the application id.
2) As MapReduce, there is a parameter that is part of either the spark-defaults.conf or the application specific configuration. spark.eventLog.dir=hdfs://<hostname>:8020/user/spark/applicationHistory This is where the Spark History Server gets the information after the application is completed. 3) In the History server on Spark there are the tabs that allow you to look at the information that you need: Jobs Stages Storage Environment Executors Especially the Executors will give a bit more detailed information: Storage Memory Disk Used Hopefully that helps. Thank you. ----- Neelesh S. Salian Cloudera -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Job-History-Logs-for-spark-jobs-submitted-on-YARN-tp25946p26043.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
