Gengliang Wang created SPARK-31967:
--------------------------------------
Summary: Application timeline rendering takes 40 seconds
Key: SPARK-31967
URL: https://issues.apache.org/jira/browse/SPARK-31967
Project: Spark
Issue Type: Improvement
Components: Web UI
Affects Versions: 3.0.1
Reporter: Gengliang Wang
In the latest master branch, I find that the job list page becomes very slow.
To reproduce in local setup:
{code:java}
spark.read.parquet("/tmp/p1").createOrReplaceTempView("t1")
spark.read.parquet("/tmp/p2").createOrReplaceTempView("t2")
(1 to 1000).map(_ => spark.sql("select * from t1, t2 where
t1.value=t2.value").show())
{code}
And that, open live UI: http://localhost:4040/
The loading time is about 40 seconds.
If we comment out the function call for `drawApplicationTimeline`, then the
loading time is around 1 second.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
