:00)
Προς: Muhib Khan , "Liu, Jialin"
Κοιν.: user@spark.apache.org
Θέμα: Re: Question about Spark cluster memory usage monitoring
Hello,
Maybe Ganglia http://ganglia.info/ might be useful for you? I have only shallow
experience with it, but it might be what you are looking for.
: Re: Question about Spark cluster memory usage monitoring
Hello,
As far as I know, there is no API provided for tracking the execution memory of
a Spark Worker node. For tracking the execution memory you will probably need
to access the MemoryManager's onHeapExecutionMemoryPool and
offHea
Hello,
As far as I know, there is no API provided for tracking the execution
memory of a Spark Worker node. For tracking the execution memory you will
probably need to access the MemoryManager's onHeapExecutionMemoryPool
and offHeapExecutionMemoryPool objects that track the memory allocated to
Hi there,
I am currently using Spark cluster to run jobs but I really need to collect the
history of actually memory usage(that’s execution memory + storage memory) of
the job in the whole cluster. I know we can get the storage memory usage
through either Spark UI Executor page or
