[
https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Lin updated SPARK-16520:
----------------------------
Comment: was deleted
(was: ## What changes were proposed in this pull request?
Added a new column named "Worker" in the Executor Page of the web UI. For each
executor (except the driver), it will provide a link to the web UI of the
worker it belongs to.
This PR also retrieved worker URLs (besides worker _UI_ URLs) from
`ExecutorRunner` to `ExecutorsPage`. This would help if we want to show then on
the Executor Page later. (See
https://github.com/apache/spark/pull/14204#issuecomment-232711795)
Because the data of the URLs had not been retrieved to the executor UI (even
not in the executor), passing them have the following effects:
- The DeveloperApi `ExecutorInfo` is changed. A new argument, `workerUrl:
Map[String, String]`, is added in the constructor of that class. But it is set
to `Map.empty` by default, so calling the old API still works. The executors
for local and Mesos are stilling using call the old API.
- The JSON converter of `ExecutorInfo` is update.
- The REST API for executors has a new item call "worker", it looks like this:
```
"worker" : {
"url" : "spark://Worker@192.168.1.104:32790",
"ui_url" : "http://192.168.1.104:46445";
}
```
## How was this patch tested?
Run Spark as a "local cluster" by `./bin/spark-shell
--master=local-cluster[2,1,1024]`. Then view the Executor Page on
http://192.168.1.104:4040/executors/.
See the column "Worker" on the right of the Executors Table. For each executor,
click the hypertext link, jump to the web UI of the worker it belongs to.
Screenshot:
)
> Link executors to corresponding worker pages
> --------------------------------------------
>
> Key: SPARK-16520
> URL: https://issues.apache.org/jira/browse/SPARK-16520
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Tao Lin
> Priority: Minor
>
> In the executor page, we add links from executors to their corresponding
> worker pages. Basically, we add links to the address or executor IDs linking
> to their corresponding worker pages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
