[ https://issues.apache.org/jira/browse/SPARK-31967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133058#comment-17133058 ]
Gengliang Wang edited comment on SPARK-31967 at 6/11/20, 8:38 AM: ------------------------------------------------------------------ Thanks. Also, not directly related to this topic, I don't think we need to render the timeline in the page unless the "event timeline" link is clicked..we can have follow-up improvements. was (Author: gengliang.wang): Thanks. Also, not directly related to this topic, I think we don't need to render the timeline in the page unless the "event timeline" link is clicked..we can have follow-up improvements. > Loading jobs UI page takes 40 seconds > ------------------------------------- > > Key: SPARK-31967 > URL: https://issues.apache.org/jira/browse/SPARK-31967 > Project: Spark > Issue Type: Bug > Components: Web UI > Affects Versions: 3.0.1 > Reporter: Gengliang Wang > Priority: Blocker > Attachments: load_time.jpeg, profile.png > > > In the latest master branch, I find that the job list page becomes very slow. > To reproduce in local setup: > {code:java} > spark.read.parquet("/tmp/p1").createOrReplaceTempView("t1") > spark.read.parquet("/tmp/p2").createOrReplaceTempView("t2") > (1 to 1000).map(_ => spark.sql("select * from t1, t2 where > t1.value=t2.value").show()) > {code} > And that, open live UI: http://localhost:4040/ > The loading time is about 40 seconds. > If we comment out the function call for `drawApplicationTimeline`, then the > loading time is around 1 second. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org