assia ydroudj created SPARK-23738: ------------------------------------- Summary: Memory usage for executors Key: SPARK-23738 URL: https://issues.apache.org/jira/browse/SPARK-23738 Project: Spark Issue Type: Question Components: Spark Core, Spark Submit Affects Versions: 2.1.0 Reporter: assia ydroudj
Hi, I'm running a spark cluster with 3 nodes (one as master+ worker) and 2 other workers. each worker has one executor. Then, I execute the pagerank example implemented in spark. I need to gather the memory usage by each executor while running the application and gather them into a file to further analysis. How can I do it please? One idea in my mind is to get the PID of executor ans driver processes and then, use a linux command line to get this information..is it right? please, guide me -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org