Re: Spark Web UI in Mesos mode

2014-09-08 Thread Wonha Ryu
Hi, Spark master web UI is only for standalone clusters, where cluster resources are managed by Spark, not other resource managers. Mesos master's default port is 5050. Within Mesos, a Spark application is considered as one of many frameworks, so there's no Spark-specific support like accessing

Re: Web UI

2014-09-03 Thread Wonha Ryu
Hi Oliver, Spark standalone master and worker support '/json' endpoint in web UI, which returns some of the information in JSON format. I wasn't able to find relevant documentation, though. - Wonha On Wed, Sep 3, 2014 at 12:12 PM, Ruebenacker, Oliver A oliver.ruebenac...@altisource.com wrote:

Re: Web UI

2014-09-03 Thread Wonha Ryu
with “–master local[4]” and when I load http://localhost:4040/json I just get forwarded to http://localhost:4040/stages/, and it’s all human-readable HTML, no JSON. Best, Oliver *From:* Wonha Ryu [mailto:wonha@gmail.com] *Sent:* Wednesday, September 03, 2014 3:36 PM

Gathering Information about Standalone Cluster

2014-08-11 Thread Wonha Ryu
Hey all, Is there any kind of API to access information about resources, executors, and applications in a standalone cluster displayed in the web UI? Currently I'm using 1.0.x, but interested in experimenting with bleeding edge. Thanks, Wonha