[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5570: -- Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks, Rushabh! I committed this to trunk, branch-2, and branch-2.4. > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 0.23.9, 2.1.1-beta >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Fix For: 2.4.0 > > Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated MAPREDUCE-5570: -- Status: Open (was: Patch Available) > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 2.1.1-beta, 0.23.9 >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Attachments: patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated MAPREDUCE-5570: -- Status: Patch Available (was: Open) > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 2.1.1-beta, 0.23.9 >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated MAPREDUCE-5570: -- Attachment: patch-MapReduce-5570-v2.patch Thanks Jason for the comments. Incorporated them in the new patch. > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 0.23.9, 2.1.1-beta >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated MAPREDUCE-5570: -- Status: Patch Available (was: Open) Removed the code where its updating the finishTime. Added a test case to verify. > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 2.1.1-beta, 0.23.9 >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Attachments: patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time
[ https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated MAPREDUCE-5570: -- Attachment: patch-MapReduce-5570.patch > Map task attempt with fetch failure has incorrect attempt finish time > - > > Key: MAPREDUCE-5570 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mr-am, mrv2 >Affects Versions: 0.23.9, 2.1.1-beta >Reporter: Jason Lowe >Assignee: Rushabh S Shah > Attachments: patch-MapReduce-5570.patch > > > If a map task attempt is retroactively failed due to excessive fetch failures > reported by reducers then the attempt's finish time is set to the time the > task was retroactively failed rather than when the task attempt completed. > This causes the map task attempt to appear to have run for much longer than > it actually did. -- This message was sent by Atlassian JIRA (v6.2#6252)