RE: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU

2021-03-22 Thread Ranju Jain
. Regards Ranju From: Attila Zsolt Piros Sent: Monday, March 22, 2021 11:07 AM To: Ranju Jain Cc: Mich Talebzadeh ; user@spark.apache.org Subject: Re: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU Hi Ranju! I am quite sure for your requirement "monitor

Re: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU

2021-03-21 Thread Attila Zsolt Piros
re I see all the > metrics can be viewed , but I have less idea for steps to install on > virtual server and integrate. I need to go through in detail the Grafana. > > > > Kindly suggest your views. > > > > Regards > > Ranju > > > > *From:* Attila Zsol

RE: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU

2021-03-21 Thread Ranju Jain
ebzadeh Cc: Ranju Jain ; user@spark.apache.org Subject: Re: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU Hi Ranju! You can configure Spark's metric system. Check the memoryMetrics.* of executor-metrics<https://spark.apache.org/docs/3.0.0-preview/monito

Re: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU

2021-03-20 Thread Attila Zsolt Piros
Hi Ranju! You can configure Spark's metric system. Check the *memoryMetrics.** of executor-metrics and in the component-instance-executor

Re: Can JVisual VM monitoring tool be used to Monitor Spark Executor Memory and CPU

2021-03-20 Thread Mich Talebzadeh
Hi, Have you considered spark GUI first? view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on t