assia ydroudj created SPARK-23738:
-------------------------------------
Summary: Memory usage for executors
Key: SPARK-23738
URL: https://issues.apache.org/jira/browse/SPARK-23738
Project: Spark
Issue Type: Question
Components: Spark Core, Spark Submit
Affects Versions: 2.1.0
Reporter: assia ydroudj
Hi,
I'm running a spark cluster with 3 nodes (one as master+ worker) and 2 other
workers. each worker has one executor. Then, I execute the pagerank example
implemented in spark. I need to gather the memory usage by each executor while
running the application and gather them into a file to further analysis.
How can I do it please?
One idea in my mind is to get the PID of executor ans driver processes and
then, use a linux command line to get this information..is it right?
please, guide me
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
