Yes I was looking at this. But it says I need to access the driver -
|http://<driver-node>:4040.|
I don't have a running driver Spark instance since I am submitting jobs
to Spark using the SparkLauncher class. Or maybe I am missing something
obvious. Apologies if so.
On 1/12/2016 3:21 PM, Miguel Morales wrote:
Check the Monitoring and Instrumentation API:
http://spark.apache.org/docs/latest/monitoring.html
On Wed, Nov 30, 2016 at 9:20 PM, Carl Ballantyne
<carl.ballant...@guvera.com <mailto:carl.ballant...@guvera.com>> wrote:
Hi All,
I want to get the running applications for my Spark Standalone
cluster in JSON format. The same information displayed on the web
UI on port 8080 ... but in JSON.
Is there an easy way to do this? It seems I need to scrap the HTML
page in order to get this information.
The reason I want to know this information is so I can ensure the
Spark cluster does not get too many jobs submitted at once. A
Stand alone cluster processes jobs FIFO. I would prefer to just
send back a message to the user telling them to try later then
submit a job which has to wait for other jobs to finish before
starting.
Any help appreciated. Thanks.
Cheers,
Carl
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
<mailto:user-unsubscr...@spark.apache.org>
--
*Carl Ballantyne*
Lead Reporting Developer
*Guvera Operations Pty Ltd.*
Suite 1b, 58 Kingston Drive
Helensvale, QLD, 4212
Australia
PO Box 3330
Helensvale Town Centre, QLD, 4212
*Phone *+61 (0) 7 5578 8987
*Email *carl.ballant...@guvera.com <mailto:carl.ballant...@guvera.com>
*Web *www.guveralimited.com <http://www.guveralimited.com/>
