Josh Rosen created SPARK-3644:
---------------------------------
Summary: REST API for Spark application info (jobs / stages /
tasks / storage info)
Key: SPARK-3644
URL: https://issues.apache.org/jira/browse/SPARK-3644
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Reporter: Josh Rosen
This JIRA is a forum to draft a design proposal for a REST interface for
accessing information about Spark applications, such as job / stage / task /
storage status.
There have been a number of proposals to serve JSON representations of the
information displayed in Spark's web UI. Given that we might redesign the
pages of the web UI (and possibly re-implement the UI as a client of a REST
API), the API endpoints and their responses should be independent of what we
choose to display on particular web UI pages / layouts.
Let's start a discussion of what a good REST API would look like from
first-principles. We can discuss what urls / endpoints expose access to data,
how our JSON responses will be formatted, how fields will be named, etc.
Some links for inspiration:
https://developer.github.com/v3/
http://developer.netflix.com/docs/REST_API_Reference
https://helloreverb.com/developers/swagger
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
