Re: [ Standalone Spark Cluster ] - Track node status

Hi Rutuja, I am not certain whether such tool exists or not, However, opening a JIRA may be beneficial and would not do any harm. You may look for workaround. Now my understanding is that your need is for monitoring the health of the cluster? HTH Dr Mich Talebzadeh LinkedIn *

Re: [ Standalone Spark Cluster ] - Track node status

Thanks again Mich! If there does not exist any interface like REST API or CLI for this, I would like to open a JIRA on exposing such a REST interface in SPARK which would list all the worker nodes. Please let me know if this seems to be the right thing to do for the community. Regards, Rutuja

Re: [ Standalone Spark Cluster ] - Track node status

The other way is to log in to the individual nodes and do jps 24819 Worker And you Processes identified as worker Also you can use jmonitor to see what they are doing resource wise You can of course write a small shell script to see if Worker(s) are up and running in every node and alert if

Re: [ Standalone Spark Cluster ] - Track node status

Thank you for the quick response. So the workers section would list all the running worker nodes in the standalone Spark cluster? I was also wondering if this is the only way to retrieve worker nodes or is there something like a Web API or CLI I could use? Thanks. Regards, Rutuja On Wed, Jun 8,

Re: [ Standalone Spark Cluster ] - Track node status

check port 8080 on the node that you started start-master.sh [image: Inline images 2] HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

[ Standalone Spark Cluster ] - Track node status

Hello! I'm trying to setup a standalone spark cluster and wondering how to track status of all of it's nodes. I wonder if something like Yarn REST API or HDFS CLI exists in Spark world that can provide status of nodes on such a cluster. Any pointers would be greatly appreciated. -- *Regards,*