We had installed hadoop on 4 machines, and one of them has been chosen
to be master and also slaves. The rest of machines are configured as
slaves. But it is strange that we can only see 2 live nodes on web
UI:http://192.168.52.129:50070/dfshealth.jsp(master machine). When we
try to refresh the page, we found that only 2 nodes are listed and one
of them are continuing replaced by others.
After using command:bin/hadoop dfsadmin -report, we got only 2 data
nodes listed.
Another thing is we found this in the log
file(hadoop-root-namenode-datacenter5.log
---datacenter5 is the name of master):
2008-10-16 02:45:12,384 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node 192.168.49.148:50010 is replaced by
192.168.52.129:50010 with the same storageID
DS-2140035130-127.0.0.1-50010-1223898963914
.......
2008-10-16 02:45:12,432 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node 192.168.52.129:50010 is replaced by
192.168.55.104:50010 with the same storageID
DS-2140035130-127.0.0.1-50010-1223898963914
........
2008-10-16 02:45:13,380 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node 192.168.55.104:50010 is replaced by
192.168.49.148:50010 with the same storageID
DS-2140035130-127.0.0.1-50010-1223898963914
Is there any problem with our configuration or maybe we just missed some
options?
BTW, my machines are total different in hardware, such as memory, disk
and cpu.
Thx!
David
