[
https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798178#comment-16798178
]
shahid commented on SPARK-27204:
--------------------------------
Yes. actually, for loading the UI page, SHS need to replay the entire event
log, first time. So, if the event log size is huge, it takes lot of time to
open the app UI, first time. This issue is still there, as it wasn't addressed
in SPARK-18085.
> First time Loading application page from History Server is taking time when
> event log size is huge
> --------------------------------------------------------------------------------------------------
>
> Key: SPARK-27204
> URL: https://issues.apache.org/jira/browse/SPARK-27204
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, Web UI
> Affects Versions: 2.3.3, 2.4.0
> Reporter: ABHISHEK KUMAR GUPTA
> Priority: Minor
>
> 1. Launch spark shell and submit a long running job.
> 2. Measure the loading time of Job History Page first time.
> 3. For Example Event Log Size = 18GB, With disk store, Application page
> Loading time takes first time 47 Min
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
