[
https://issues.apache.org/jira/browse/MAPREDUCE-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887613#action_12887613
]
Evan Wang commented on MAPREDUCE-220:
-------------------------------------
@Scott: I've already make a java tool for MR profiling through Linux OS tools,
which is independent from Hadoop. However, the overhead of network monitor,
tcpdump, is really high. When running gridmix2, tcpdump will cost 20% cpu in
one core. Disk monitor also encountered some problems. So, I am not so sure
that the MR performance is influenced by all that factors---cpu, memory, disk,
network. I'd like to complete my base experiment first. Could you give me some
advice about network and disk monitor?
> Collecting cpu and memory usage for MapReduce tasks
> ---------------------------------------------------
>
> Key: MAPREDUCE-220
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-220
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: task, tasktracker
> Reporter: Hong Tang
> Assignee: Scott Chen
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-220-20100616.txt, MAPREDUCE-220-v1.txt,
> MAPREDUCE-220.txt
>
>
> It would be nice for TaskTracker to collect cpu and memory usage for
> individual Map or Reduce tasks over time.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
