Enhancements and Improvement for Host monitor in a big cluster
--------------------------------------------------------------
Key: HADOOP-2123
URL: https://issues.apache.org/jira/browse/HADOOP-2123
Project: Hadoop
Issue Type: Improvement
Components: dfs, mapred
Affects Versions: 0.14.0
Reporter: Shuguang Liu
Fix For: 0.14.1
New Enhancements for HADOOP on big clusters.
I put some new commands into HADOOP based on 0.14.0 and modified some bugs
especially in the scheduling part.
Enhancements:
1. Add Some commands to make it easy to monitor the cluster.
hhosts - Display hosts status in the cluster.
hload - Display host load information including cpu usage, cpu usage and so on.
hslot - Change host available slot to improve efficiency.
hopen - Enable a host on the fly.
hclose - Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop - Bring a job specified to the top prirority on the fly.
hbot - Bring a job specified to the lowest priority on the fly.
hjobkill - Kill a job
hjobs - List job information in detailed format.
3. Enhance the task trunk dispatching method to make it more efficient when a
job has many tasks.
4. Improved job submitting efficiency asuring right priority
[ Show ยป ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big
clusters. I put some new commands into HADOOP based on 0.14.0 and modified some
bugs especially in the scheduling part. Enhancements: 1. Add Some commands to
make it easy to monitor the cluster. hhosts - Display hosts status in the
cluster. hload - Display host load information including cpu usage, cpu usage
and so on. hslot - Change host available slot to improve efficiency. hopen -
Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some
commands to improve efficiency for a "Big Cluster" htop - Bring a job specified
to the top prirority on the fly. hbot - Bring a job specified to the lowest
priority on the fly. hjobkill - Kill a job hjobs - List job information in
detailed format. 3. Enhance the task trunk dispatching method to make it more
efficient when a job has many tasks. 4. Improved job submitting efficiency
asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
