[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-14 Thread Jason Lowe (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Lowe updated MAPREDUCE-5570:
--

   Resolution: Fixed
Fix Version/s: 2.4.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

Thanks, Rushabh!  I committed this to trunk, branch-2, and branch-2.4.

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 0.23.9, 2.1.1-beta
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Fix For: 2.4.0
>
> Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-14 Thread Rushabh S Shah (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rushabh S Shah updated MAPREDUCE-5570:
--

Status: Open  (was: Patch Available)

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 2.1.1-beta, 0.23.9
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Attachments: patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-14 Thread Rushabh S Shah (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rushabh S Shah updated MAPREDUCE-5570:
--

Status: Patch Available  (was: Open)

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 2.1.1-beta, 0.23.9
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-14 Thread Rushabh S Shah (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rushabh S Shah updated MAPREDUCE-5570:
--

Attachment: patch-MapReduce-5570-v2.patch

Thanks Jason for the comments.
Incorporated them in the new patch.

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 0.23.9, 2.1.1-beta
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Attachments: patch-MapReduce-5570-v2.patch, patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-12 Thread Rushabh S Shah (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rushabh S Shah updated MAPREDUCE-5570:
--

Status: Patch Available  (was: Open)

Removed the code where its updating the finishTime.
Added a test case to verify.

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 2.1.1-beta, 0.23.9
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Attachments: patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2014-03-12 Thread Rushabh S Shah (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rushabh S Shah updated MAPREDUCE-5570:
--

Attachment: patch-MapReduce-5570.patch

> Map task attempt with fetch failure has incorrect attempt finish time
> -
>
> Key: MAPREDUCE-5570
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mr-am, mrv2
>Affects Versions: 0.23.9, 2.1.1-beta
>Reporter: Jason Lowe
>Assignee: Rushabh S Shah
> Attachments: patch-MapReduce-5570.patch
>
>
> If a map task attempt is retroactively failed due to excessive fetch failures 
> reported by reducers then the attempt's finish time is set to the time the 
> task was retroactively failed rather than when the task attempt completed.  
> This causes the map task attempt to appear to have run for much longer than 
> it actually did.



--
This message was sent by Atlassian JIRA
(v6.2#6252)