[jira] [Updated] (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 严金双 updated MAPREDUCE-1218: --- Priority: Major (was: Critical) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.21.0 Attachments: MAPREDUCE-1218.patch, MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 严金双 updated MAPREDUCE-1218: --- Priority: Critical (was: Major) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Priority: Critical Fix For: 0.21.0 Attachments: MAPREDUCE-1218.patch, MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated MAPREDUCE-1218: Resolution: Fixed Hadoop Flags: [Incompatible change, Reviewed] (was: [Incompatible change]) Status: Resolved (was: Patch Available) I just committed this. Thanks Scott! Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v6.1.patch Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated MAPREDUCE-1218: Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Release Note: This patch allows TaskTracker reports it's current available memory and CPU usage to JobTracker through heartbeat. The information can be used for scheduling and monitoring in the JobTracker. Hadoop Flags: [Incompatible change] Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v6.2.patch Changed the version number of InterTrackerProtocol to 30L, because this patch makes the heartbeat incompatible with the old version. Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Release Note: This patch allows TaskTracker reports it's current available memory and CPU usage to JobTracker through heartbeat. The information can be used for scheduling and monitoring in the JobTracker. This patch changes the version of InterTrackerProtocal. (was: This patch allows TaskTracker reports it's current available memory and CPU usage to JobTracker through heartbeat. The information can be used for scheduling and monitoring in the JobTracker.) Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.1.patch, MAPREDUCE-1218-v6.2.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v6.patch Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218-v6.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v5.patch Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: (was: MAPREDUCE-1218-v5.patch) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v5.patch Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218-v5.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v4.patch I have moved the CPU usage calculation and added the corresponding unit tests. Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218-v4.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v3.patch Have fixed several things according to Vinod's suggestions. Major changes including 1. Add unit tests to LinuxResourceCalculatorPlugin 2. Deprecate the original MemoryCalculatorPlugin and LinuxMemoryCalculatorPlugin and redirect their functions 3. Rename the class, functions and configurations by replacing memory with resource Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218-v3.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-v2.patch It seems that the rename script cannot be recognized by hudson. So I submit the patch again without renaming. The renaming does not affect any function. Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Open (was: Patch Available) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Status: Patch Available (was: Open) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Affects Versions: 0.22.0 Environment: linux Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218-v2.patch, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-rename.sh MAPREDUCE-1218.patch This patch allows the TaskTracker reports its real-time CPU and memory usage. Here are the changes: 1. Rename MemoryCalculatorPlugin.java - ResourceCalculatorPlugin.java and the its subclasses 2. Add CPU and available memory calculation in ResourceCalculatorPlugin and the subclasses. 3. Add these new information in TaskTrackerStatus.ResourceStatus 4. In TaskTracker.java, these information is added to TaskTrackerStatus when transmitting heartbeats Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Environment: linux Reporter: Scott Chen Assignee: Scott Chen Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: MAPREDUCE-1218-rename.sh Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Environment: linux Reporter: Scott Chen Assignee: Scott Chen Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1218: -- Attachment: (was: MAPREDUCE-1218-rename.sh) Collecting cpu and memory usage for TaskTrackers Key: MAPREDUCE-1218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1218 Project: Hadoop Map/Reduce Issue Type: Sub-task Environment: linux Reporter: Scott Chen Assignee: Scott Chen Attachments: MAPREDUCE-1218-rename.sh, MAPREDUCE-1218.patch The information can be used for resource aware scheduling. Note that this is related to MAPREDUCE-220. There the per task resource information is collected. This one collects the per machine information. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
