Hai Tao created SPARK-39232:
-------------------------------
Summary: Spark History Main Page App List Filtering
Key: SPARK-39232
URL: https://issues.apache.org/jira/browse/SPARK-39232
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.4.0
Reporter: Hai Tao
Currently Spark History Server suffers when there are large number of jobs
under the eventLog.dir. Loading the SHS main page may be very slow(showing
`Loading History Summary ...`).
The issue is because the current SHS returns all jobs in the appList KV Store
to the client browser without any filtering. This resulted massive data
transfer and slowness for SHS in a large environment. For most users, many of
the returned jobs are not in their interests.
Therefore, it could reduce the waiting time if we could add some filtering(such
as user or queue) in the SHS main page.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
