Hi all
Spark job web ui will not be available when job is over, but it is
convenient for developer to debug with persisting job web ui. I just come up
with draft for this issue.
1. We could simply save the web page with html/xml
format(stages/executors/storages/environment) to certain location when job
finished
2. But it is not easy for user to review the job info with #1, we could
build extra job history service for developers
3. But where will we build this history service? In Driver node or Master
node?
Any suggestions about this improvement?
regards,
Andrew
