[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2524: - Attachment: MAPREDUCE2524-patch-20security.txt patch for the branch-0.20-security. > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.205.0 > > Attachments: MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2524: - Attachment: MAPREDUCE2524-patch-20security.txt reattaching wit license granted. > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.205.0 > > Attachments: MAPREDUCE2524-patch-20security.txt, > MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2524: - Attachment: MAPREDUCE2524-20security-v2.patch upload new patch with changes in mapred-default.xml > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.205.0 > > Attachments: MAPREDUCE2524-20security-v2.patch, > MAPREDUCE2524-patch-20security.txt, MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-2524: - Release Note: Added a new configuration option: mapreduce.reduce.shuffle.maxfetchfailures, and removed a no longer used option: mapred.reduce.copy.backoff. Status: Patch Available (was: Open) > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.205.0 > > Attachments: MAPREDUCE2524-20security-v2.patch, > MAPREDUCE2524-patch-20security.txt, MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2524: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) +1 I committed this. Thanks, Tom! > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.205.0 > > Attachments: MAPREDUCE2524-20security-v2.patch, > MAPREDUCE2524-patch-20security.txt, MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated MAPREDUCE-2524: - Fix Version/s: 0.20.204.0 > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.204.0, 0.20.205.0 > > Attachments: MAPREDUCE2524-20security-v2.patch, > MAPREDUCE2524-patch-20security.txt, MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated MAPREDUCE-2524: - Fix Version/s: (was: 0.20.205.0) > Backport trunk heuristics for failing maps when we get fetch failures > retrieving map output during shuffle > -- > > Key: MAPREDUCE-2524 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2524 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: tasktracker >Affects Versions: 0.20.204.0 >Reporter: Thomas Graves >Assignee: Thomas Graves >Priority: Minor > Fix For: 0.20.204.0 > > Attachments: MAPREDUCE2524-20security-v2.patch, > MAPREDUCE2524-patch-20security.txt, MAPREDUCE2524-patch-20security.txt > > > The heuristics for failing maps when we get map output fetch failures during > the shuffle is pretty conservative in 20. Backport the heuristics from trunk > which are more aggressive, simpler, and configurable. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
