[ https://issues.apache.org/jira/browse/SPARK-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-6973. ------------------------------ Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5550 [https://github.com/apache/spark/pull/5550] > The total stages on the allJobsPage is wrong > -------------------------------------------- > > Key: SPARK-6973 > URL: https://issues.apache.org/jira/browse/SPARK-6973 > Project: Spark > Issue Type: Bug > Components: Web UI > Reporter: meiyoula > Priority: Minor > Fix For: 1.5.0 > > Attachments: allJobs.png > > > The job has two stages, map and collect stage. Both two retried two times. > The first and second time of map stage is successful, and the third time > skipped. Of collect stage, the first and second time is failed, and the third > time is successful. > On the allJobs page, the number of total stages is allStages-skippedStages. > Mostly it's wright, but here I think total stages should be 2. > The example: > Stage 0: Map Stage > Stage 1: Collect Stage > Stage: Stage 0 -> Stage 1 -> Stage 0(retry 1) -> Stage 1(retry 1) -> > Stage 0(retry 2) -> Stage 1(retry 2) > Status: Success -> Fail -> Success -> Fail > -> Skipped -> Success > Though one of Stage 0 is skipped, actually it's executed. So I think it > should be included in the total number. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org