[jira] [Commented] (SPARK-18683) REST APIs for standalone Master、Workers and Applications
[ https://issues.apache.org/jira/browse/SPARK-18683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348708#comment-17348708 ] Mayank Asthana commented on SPARK-18683: Looking through the code I found that there is a `/json` endpoint to the master ui which returns the json representation of everything on that page. However, I don't think this is documented anywhere. > REST APIs for standalone Master、Workers and Applications > > > Key: SPARK-18683 > URL: https://issues.apache.org/jira/browse/SPARK-18683 > Project: Spark > Issue Type: Improvement >Reporter: Shixiong Zhu >Priority: Major > Labels: bulk-closed > > It would be great that we have some REST APIs to access Master、Workers and > Applications information. Right now the only way to get them is using the Web > UI. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-18683) REST APIs for standalone Master、Workers and Applications
[ https://issues.apache.org/jira/browse/SPARK-18683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346739#comment-17346739 ] Mayank Asthana commented on SPARK-18683: Can we reopen this? My usecase is to have spark streaming applications running all the time, and we want to check through the REST API if these applications are still running and restart them if they are not. > REST APIs for standalone Master、Workers and Applications > > > Key: SPARK-18683 > URL: https://issues.apache.org/jira/browse/SPARK-18683 > Project: Spark > Issue Type: Improvement >Reporter: Shixiong Zhu >Priority: Major > Labels: bulk-closed > > It would be great that we have some REST APIs to access Master、Workers and > Applications information. Right now the only way to get them is using the Web > UI. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-18683) REST APIs for standalone Master、Workers and Applications
[
https://issues.apache.org/jira/browse/SPARK-18683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114806#comment-16114806
]
Bryan Cutler commented on SPARK-18683:
--
Sorry for the late response. From what I remember about SPARK-12299, at that
time the {{MasterWebUI}} implemented {{UIRoot}} and it required application
history stored as a {{SparkUI}} object to serve all REST APIs required in
{{ApiRootResource}}. With the application history removed, it couldn't serve
everything there. I tried to refactor a bit to keep the REST API as is, but it
was getting too messy and the immediate goal of the JIRA was to remove history
serving functionality, so I believe it was decided to bring it back in at a
later time if needed. So I think it is possible, but someone with more
experience in the SparkUI would need to take a look. Hope that helps.
> REST APIs for standalone Master、Workers and Applications
>
>
> Key: SPARK-18683
> URL: https://issues.apache.org/jira/browse/SPARK-18683
> Project: Spark
> Issue Type: Improvement
>Reporter: Shixiong Zhu
>
> It would be great that we have some REST APIs to access Master、Workers and
> Applications information. Right now the only way to get them is using the Web
> UI.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-18683) REST APIs for standalone Master、Workers and Applications
[ https://issues.apache.org/jira/browse/SPARK-18683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029591#comment-16029591 ] Imran Rashid commented on SPARK-18683: -- [~stanzhai] commented here https://github.com/apache/spark/pull/10991#issuecomment-301462761 that this functionality was removed in SPARK-12299. I believe that was accidental, the goal there was really just to remove the history server from the Master. I don't see any reason why the master shouldn't expose the same info it has in the UI in a rest api. [~bryanc] [~andrewor14] do you have any thoughts on adding this back from SPARK-12299? > REST APIs for standalone Master、Workers and Applications > > > Key: SPARK-18683 > URL: https://issues.apache.org/jira/browse/SPARK-18683 > Project: Spark > Issue Type: Improvement >Reporter: Shixiong Zhu > > It would be great that we have some REST APIs to access Master、Workers and > Applications information. Right now the only way to get them is using the Web > UI. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
