[
https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069806#comment-16069806
]
Dmitry Parfenchik commented on SPARK-21254:
-------------------------------------------
Apologies didn't notice attached ticket.
I agree, SPARK-18085 will solves problem on a larger scale (fixing the HTTP API
and major rework of the UI), while the bug identified here is specific to
frontend templating, making parsing of large number of jobs very inefficient.
Which is actually quite easy to fix (detaching grid from document before all
modifications are done). And If later implementation of SPARK-18085 will solve
the issue in a better way I think that there is still a benefit from the quick
win meanwhile.
We actually raised the issue and
[resolved|https://github.com/criteo-forks/spark/commit/a2a22f52d08ff9fb5736220853af2f31160a5ebe]
it internally in our own fork since the history page usage was unbearable and
hugely decreasing productivity on daily basis as the size grew up to 13+k rows.
I just wanted to submit PR to the master of apache/spark repo, but I was told
it won't be accepted without a ticket.
So maybe we could keep the ticket just for sake of submitting a PR?
> History UI: Taking over 1 minute for initial page display
> ---------------------------------------------------------
>
> Key: SPARK-21254
> URL: https://issues.apache.org/jira/browse/SPARK-21254
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.1.0
> Reporter: Dmitry Parfenchik
> Priority: Minor
> Attachments: screenshot-1.png
>
>
> Currently on the first page load (if there is no limit set) the whole jobs
> execution history is loaded since the begging of the time. On large amount of
> rows returned (10k+) page load time grows dramatically, causing 1min+ delay
> in Chrome and freezing the process in Firefox, Safari and IE.
> A simple inspection in Chrome shows that network is not an issue here and
> only causes a small latency (<1s) while most of the time is spend in UI
> processing the results even according to chrome devtools:
> !screenshot-1.png!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
