[
https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165364#comment-14165364
]
Daniel Darabos commented on SPARK-3644:
---------------------------------------
Hi Dev, thanks for the offer! Have you seen Kousuke's PR?
https://github.com/apache/spark/pull/2333 seems to cover a lot of ground. Maybe
he or the reviewers there can tell you how to make yourself useful!
Unrelatedly, I wanted to mention that you can disregard my earlier comments. We
cannot use XHR on these endpoints, since a different port means a different
security domain. And anyway it turned out to be really easy to use a custom
SparkListener for what we wanted to do. Sorry for the noise.
> REST API for Spark application info (jobs / stages / tasks / storage info)
> --------------------------------------------------------------------------
>
> Key: SPARK-3644
> URL: https://issues.apache.org/jira/browse/SPARK-3644
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Web UI
> Reporter: Josh Rosen
>
> This JIRA is a forum to draft a design proposal for a REST interface for
> accessing information about Spark applications, such as job / stage / task /
> storage status.
> There have been a number of proposals to serve JSON representations of the
> information displayed in Spark's web UI. Given that we might redesign the
> pages of the web UI (and possibly re-implement the UI as a client of a REST
> API), the API endpoints and their responses should be independent of what we
> choose to display on particular web UI pages / layouts.
> Let's start a discussion of what a good REST API would look like from
> first-principles. We can discuss what urls / endpoints expose access to
> data, how our JSON responses will be formatted, how fields will be named, how
> the API will be documented and tested, etc.
> Some links for inspiration:
> https://developer.github.com/v3/
> http://developer.netflix.com/docs/REST_API_Reference
> https://helloreverb.com/developers/swagger
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
