Thomas Graves created SPARK-8593: ------------------------------------ Summary: History Server doesn't show complete application when one attempt inprogress Key: SPARK-8593 URL: https://issues.apache.org/jira/browse/SPARK-8593 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.4.0 Reporter: Thomas Graves
The Spark history server doesn't show an application if the first attempt of the application is still inprogress. Here are the files in hdfs: -rwxrwx--- 3 tgraves hdfs 234 2015-06-24 15:49 sparkhistory/application_1433751980223_18926_1.inprogress -rwxrwx--- 3 tgraves hdfs 9609450 2015-06-24 15:51 sparkhistory/application_1433751980223_18926_2 The UI shows them if I set the showIncomplete=true. Removing the inprogress file allows it to show up when showIncomplete is false. It should be smart enough to atleast show the second successful attempt. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org