[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-19 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Affects Version/s: 3.3.1 > Loading of Spark UI blocks for a long time when HybridStore enabled > ---

[jira] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330 ] Zhou Yifan deleted comment on SPARK-46330: was (Author: zhouyifan279): *HybridStore#close,* may took long if there was still a lot of data waiting to be written to disk when closing. I trie

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Commented] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794589#comment-17794589 ] Zhou Yifan commented on SPARK-46330: *HybridStore#close,* may took long if there was

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Affects Version/s: 3.1.2 (was: 3.3.1) > Loading of Spark UI blocks for a

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Created] (SPARK-46329) Spark UI's loading blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-46329: -- Summary: Spark UI's loading blocks for a long time when HybridStore enabled Key: SPARK-46329 URL: https://issues.apache.org/jira/browse/SPARK-46329 Project: Spark

[jira] [Created] (SPARK-46330) Spark UI's loading blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-46330: -- Summary: Spark UI's loading blocks for a long time when HybridStore enabled Key: SPARK-46330 URL: https://issues.apache.org/jira/browse/SPARK-46330 Project: Spark

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Summary: Loading of Spark UI blocks for a long time when HybridStore enabled (was: Spark UI's loadi

[jira] [Updated] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

2023-05-07 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-43403: --- Attachment: image-2023-05-08-11-33-13-634.png > GET /history//1/jobs/ failed: java.lang.IllegalState

[jira] [Updated] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

2023-05-07 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-43403: --- Description: !image-2023-05-08-11-33-13-634.png! (was: !image-2023-05-08-11-25-18-132.png!) > GET

[jira] [Created] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

2023-05-07 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-43403: -- Summary: GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed Key: SPARK-43403 URL: https://issues.apache.org/jira/browse/SPARK-43403 Project: Spar

[jira] [Updated] (SPARK-43014) spark.app.submitTime is not right in k8s cluster mode

2023-04-03 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-43014: --- Description: If submit Spark in k8s cluster mode, `spark.app.submitTime` will be overwritten when dr

[jira] [Created] (SPARK-43014) spark.app.submitTime is not right in k8s cluster mode

2023-04-03 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-43014: -- Summary: spark.app.submitTime is not right in k8s cluster mode Key: SPARK-43014 URL: https://issues.apache.org/jira/browse/SPARK-43014 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37863) Add submitTime for Spark Application

2022-01-10 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-37863: --- Description: Spark Driver may take a long time to startup when running with cluster mode, if YARN t

[jira] [Created] (SPARK-37863) Add submitTime for Spark Application

2022-01-10 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-37863: -- Summary: Add submitTime for Spark Application Key: SPARK-37863 URL: https://issues.apache.org/jira/browse/SPARK-37863 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-37069) HiveClientImpl throws NoSuchMethodError: org.apache.hadoop.hive.ql.metadata.Hive.getWithoutRegisterFns

2021-10-20 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432206#comment-17432206 ] Zhou Yifan commented on SPARK-37069: Gently ping [~csun] > HiveClientImpl throws No