Hi
I setup hadoop with hadoop 0.20.2
I use three virtual machines on vmware,
The three virtual machine could ssh with each other,
ERROR rise , the tasktracker on slave 192.168.164.137 and 192.168.164.138
cloud not connect to master, while the tasktracker on 192.168.164.136 seems
no error,
Cloud you help me
The conf file is set as follows,
root@ubuntu:/home/hadoop-0.20.2/conf# cat masters
192.168.164.136
root@ubuntu:/home/hadoop-0.20.2/conf# cat slaves
192.168.164.136
192.168.164.137
192.168.164.138
root@ubuntu:/home/hadoop-0.20.2/conf#
root@ubuntu:/home/hadoop-0.20.2/conf# cat core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://192.168.164.136:9100</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop-0.20.2/tmp/</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<!-- property>
<name>mapred.child.java.opts</name>
<value>-Xmx128m</value>
</property>
<property>
<name>dfs.block.size</name>
<value>5120000</value>
<description>The default block size for new files.</description>
</property -->
</configuration>
root@ubuntu:/home/hadoop-0.20.2/conf# cat mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>192.168.164.136:9101</value>
</property>
</configuration>
now ERROR rise , the tasktracker on slave 192.168.164.137 and
192.168.164.138 cloud not connect to master, while the tasktracker on
192.168.164.136 seems no error,
this is the log on 192.168.164.138,
root@ubuntu:/home/hadoop-0.20.2/logs#
root@ubuntu:/home/hadoop-0.20.2/logs# cat hadoop-root-tasktracker-ubuntu.log
2012-02-23 00:44:10,851 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host = ubuntu/127.0.1.1
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2012-02-23 00:44:16,080 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-02-23 00:44:16,199 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
Opening the listener on 50060
2012-02-23 00:44:16,205 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50060
webServer.getConnectors()[0].getLocalPort() returned 50060
2012-02-23 00:44:16,205 INFO org.apache.hadoop.http.HttpServer: Jetty bound
to port 50060
2012-02-23 00:44:16,205 INFO org.mortbay.log: jetty-6.1.14
2012-02-23 00:45:08,741 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50060
2012-02-23 00:45:08,808 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2012-02-23 00:45:08,848 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=49689
2012-02-23 00:45:08,909 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2012-02-23 00:45:08,912 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost/127.0.0.1:49689
2012-02-23 00:45:08,912 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_ubuntu:localhost/127.0.0.1:49689
2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 49689: starting
2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 49689: starting
2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 49689: starting
2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 49689: starting
2012-02-23 00:45:08,919 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 49689: starting
2012-02-23 00:47:53,638 INFO org.apache.hadoop.mapred.TaskTracker: Using
MemoryCalculatorPlugin :
org.apache.hadoop.util.LinuxMemoryCalculatorPlugin@cafb56
2012-02-23 00:47:53,641 INFO org.apache.hadoop.mapred.TaskTracker: Starting
thread: Map-events fetcher for all reduce tasks on
tracker_ubuntu:localhost/127.0.0.1:49689
2012-02-23 00:47:53,646 WARN org.apache.hadoop.mapred.TaskTracker:
TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is
disabled.
2012-02-23 00:47:53,647 INFO org.apache.hadoop.mapred.IndexCache: IndexCache
created with max memory = 10485760
2012-02-23 00:47:55,110 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 0 time(s).
2012-02-23 00:47:56,112 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 1 time(s).
2012-02-23 00:47:57,114 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 2 time(s).
2012-02-23 00:47:58,116 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 3 time(s).
2012-02-23 00:47:59,118 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 4 time(s).
2012-02-23 00:48:00,120 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 5 time(s).
2012-02-23 00:48:01,122 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 6 time(s).
2012-02-23 00:48:02,124 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 7 time(s).
2012-02-23 00:48:03,126 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 8 time(s).
2012-02-23 00:48:04,130 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: ubuntu.local/192.168.164.138:9100. Already tried 9 time(s).
2012-02-23 00:48:04,132 ERROR org.apache.hadoop.mapred.TaskTracker: Caught
exception: java.net.ConnectException: Call to
ubuntu.local/192.168.164.138:9100 failed on connection exception:
java.net.ConnectException: Connection refused
at org.apache.hadoop.ipc.Client.wrapException(Client.java:767)
at org.apache.hadoop.ipc.Client.call(Client.java:743)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy5.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
at
org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSyste
m.java:82)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1033)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1720)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2833)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:2
06)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:304)
at
org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:860)
at org.apache.hadoop.ipc.Client.call(Client.java:720)
... 15 more
