[
https://issues.apache.org/jira/browse/SPARK-33470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dino Tufekcic updated SPARK-33470:
----------------------------------
Description:
History Server starts correctly and shows "No completed applications found!"
message when /tmp/spark-events directory is empty. As soon as there is an event
log in the folder generated by a Spark streaming app (haven't tested other
apps) the History Server gets stuck showing the "Loading history summary..."
popup.
Spark version: 3.0.1 and 3.0.0. (Spark 2.4.5 works as expected (running
application shown in History Server))
Hadoop version: 2.10.0 and 2.10.1
Java version: openjdk 1.8.0_272
OS: CentOS 7.7
Command to reproduce:
{code:java}
spark-submit --class MyClass --master yarn --deploy-mode cluster --jars
/usr/local/hadoop/share/hadoop/libs/*.jar myclass.jar{code}
spark-defaults.conf:
{code:java}
spark.eventLog.dir=/tmp/spark-events
spark.eventLog.enabled=true
spark.eventLog.rolling.enabled=true
spark.ui.enabled=true
spark.yarn.stagingDir=hdfs://10.0.1.4:54310/
{code}
was:
History Server starts correctly and shows "No completed applications found!"
message when /tmp/spark-events directory is empty. As soon as there is an event
log in the folder generated by a Spark streaming app (haven't tested other
apps) the History Server gets stuck showing the "Loading history summary..."
popup.
Spark version: 3.0.1 and 3.0.0. Spark 2.4.5 works as expected (running
application shown in History Server)
Hadoop version: 2.10.0 and 2.10.1
Java version: openjdk 1.8.0_272
OS: CentOS 7.7
Command to reproduce:
{code:java}
spark-submit --class MyClass --master yarn --deploy-mode cluster --jars
/usr/local/hadoop/share/hadoop/libs/*.jar myclass.jar{code}
spark-defaults.conf:
{code:java}
spark.eventLog.dir=/tmp/spark-events
spark.eventLog.enabled=true
spark.eventLog.rolling.enabled=true
spark.ui.enabled=true
spark.yarn.stagingDir=hdfs://10.0.1.4:54310/
{code}
> HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop
> 2.10.1
> --------------------------------------------------------------------------------
>
> Key: SPARK-33470
> URL: https://issues.apache.org/jira/browse/SPARK-33470
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.0.0, 3.0.1
> Environment: Spark version: 3.0.1 and 3.0.0. Spark 2.4.5 works as
> expected (running application shown in History Server)
> Hadoop version: 2.10.0 and 2.10.1
> Java version: openjdk 1.8.0_272
> OS: CentOS 7.7
> Reporter: Dino Tufekcic
> Priority: Major
>
> History Server starts correctly and shows "No completed applications found!"
> message when /tmp/spark-events directory is empty. As soon as there is an
> event log in the folder generated by a Spark streaming app (haven't tested
> other apps) the History Server gets stuck showing the "Loading history
> summary..." popup.
> Spark version: 3.0.1 and 3.0.0. (Spark 2.4.5 works as expected (running
> application shown in History Server))
> Hadoop version: 2.10.0 and 2.10.1
> Java version: openjdk 1.8.0_272
> OS: CentOS 7.7
> Command to reproduce:
>
> {code:java}
> spark-submit --class MyClass --master yarn --deploy-mode cluster --jars
> /usr/local/hadoop/share/hadoop/libs/*.jar myclass.jar{code}
> spark-defaults.conf:
>
>
> {code:java}
> spark.eventLog.dir=/tmp/spark-events
> spark.eventLog.enabled=true
> spark.eventLog.rolling.enabled=true
> spark.ui.enabled=true
> spark.yarn.stagingDir=hdfs://10.0.1.4:54310/
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
