Re: NettyClient java.net.ConnectException: Connection refused
Hi Marven, did you tried to ssh from the master to the slaves? You may need to add the slave to the "known host" file. In order to do that you can use that cmf: ssh -n -o StrictHostKeyChecking=no $destinationhostname hostname Don't forget to replace $destinationhostname by the hostname of the slaves. This script can do it for all the slaves : http://pastebin.com/raw.php?i=Lj54BWZD Regards, Flavain 2015-09-04 18:53 GMT+02:00 von Domarus, Marven < marven.von.doma...@rwth-aachen.de>: > Hi everyone, > > I have already run the SimpleShortestPathsComputation on single node > pseudo-distribution and I am currently trying to run it on a 2 node cluster > on Ubuntu 14.04. > But every time I got the following Error: (Complete Logs below) > > "ERROR org.apache.giraph.master.MasterThread: masterThread: Master > algorithm failed with IllegalStateException > java.lang.IllegalStateException: connectAllAddresses: Too many failures > (1000)." > > Which seems to be the result of the NettyClient not being able to connect > with the other node on port 30001 resulting in "java.net.ConnectException: > Connection refused: rofti/192.168.0.103:30001". > I already tried to open the port on both nodes as described here: > http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAcgib35tQyROodNQrE3Se_39JsT5MiQVP=4v==x10jtouf...@mail.gmail.com%3E > and made sure that all host-names are written in only lowercase letters. > But that didn't change anything. I really appreciate any help you guys can > offer. > > Thanks, > Marven > > Output of iptables -L : > Chain INPUT (policy ACCEPT) > target prot opt source destination > ACCEPT tcp -- anywhere anywhere state NEW > tcp spt:30001 > ACCEPT tcp -- anywhere anywhere state NEW > tcp dpts:3:30010 > ACCEPT tcp -- anywhere anywhere state NEW > tcp dpt:2181 > Chain FORWARD (policy ACCEPT) > target prot opt source destination > Chain OUTPUT (policy ACCEPT) > target prot opt source destination > > > File: /etc/hosts on master(rofti-ex58-ud3r): > 127.0.0.1 localhost > 127.0.1.1 rofti-ex58-ud3r > 192.168.0.101 master > 192.168.0.103 slave rofti > > > File: conf/zoo.cfg > tickTime=2000 > dataDir=/home/hduser/mydata/zookeeper > clientPort=2181 > initLimit=5 > syncLimit=2 > server.1=192.168.0.101:2888:3888 > server.2=192.168.0.103:2888:3888 > > > Syslog logs 1: > 2015-09-04 17:43:46,416 INFO org.apache.hadoop.util.NativeCodeLoader: > Loaded the native-hadoop library > 2015-09-04 17:43:46,661 WARN > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already > exists! > 2015-09-04 17:43:46,784 INFO org.apache.hadoop.util.ProcessTree: setsid > exited with exit code 0 > 2015-09-04 17:43:46,787 INFO org.apache.hadoop.mapred.Task: Using > ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c1e6a1d > 2015-09-04 17:43:46,884 INFO org.apache.hadoop.mapred.MapTask: Processing > split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1 > 2015-09-04 17:43:46,927 INFO org.apache.giraph.graph.GraphTaskManager: > setup: Log level remains at info > 2015-09-04 17:43:46,967 INFO org.apache.giraph.graph.GraphTaskManager: > setup: Starting up BspServiceMaster (master thread)... > 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: > Path to create to halt is /_hadoopBsp/job_201509041740_0002/_haltComputation > 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: > Connecting to ZooKeeper with job job_201509041740_0002, 0 on > master:2181,slave:2181 > 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client > environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT > 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client > environment:host.name=rofti-ex58-ud3r > 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.version=1.7.0_79 > 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.vendor=Oracle Corporation > 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre > 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.class.path=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars/classes:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/attempt_201509041740_0002_m
NettyClient java.net.ConnectException: Connection refused
Hi everyone, I have already run the SimpleShortestPathsComputation on single node pseudo-distribution and I am currently trying to run it on a 2 node cluster on Ubuntu 14.04. But every time I got the following Error: (Complete Logs below) "ERROR org.apache.giraph.master.MasterThread: masterThread: Master algorithm failed with IllegalStateException java.lang.IllegalStateException: connectAllAddresses: Too many failures (1000)." Which seems to be the result of the NettyClient not being able to connect with the other node on port 30001 resulting in "java.net.ConnectException: Connection refused: rofti/192.168.0.103:30001". I already tried to open the port on both nodes as described here: http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAcgib35tQyROodNQrE3Se_39JsT5MiQVP=4v==x10jtouf...@mail.gmail.com%3E and made sure that all host-names are written in only lowercase letters. But that didn't change anything. I really appreciate any help you guys can offer. Thanks, Marven Output of iptables -L : Chain INPUT (policy ACCEPT) target prot opt source destination ACCEPT tcp -- anywhere anywhere state NEW tcp spt:30001 ACCEPT tcp -- anywhere anywhere state NEW tcp dpts:3:30010 ACCEPT tcp -- anywhere anywhere state NEW tcp dpt:2181 Chain FORWARD (policy ACCEPT) target prot opt source destination Chain OUTPUT (policy ACCEPT) target prot opt source destination File: /etc/hosts on master(rofti-ex58-ud3r): 127.0.0.1 localhost 127.0.1.1 rofti-ex58-ud3r 192.168.0.101 master 192.168.0.103 slave rofti File: conf/zoo.cfg tickTime=2000 dataDir=/home/hduser/mydata/zookeeper clientPort=2181 initLimit=5 syncLimit=2 server.1=192.168.0.101:2888:3888 server.2=192.168.0.103:2888:3888 Syslog logs 1: 2015-09-04 17:43:46,416 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2015-09-04 17:43:46,661 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2015-09-04 17:43:46,784 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0 2015-09-04 17:43:46,787 INFO org.apache.hadoop.mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c1e6a1d 2015-09-04 17:43:46,884 INFO org.apache.hadoop.mapred.MapTask: Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1 2015-09-04 17:43:46,927 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2015-09-04 17:43:46,967 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)... 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201509041740_0002/_haltComputation 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201509041740_0002, 0 on master:2181,slave:2181 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=rofti-ex58-ud3r 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.7.0_79 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars/classes:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/attempt_201509041740_0002_m_00_0/work:/usr/local/hadoop/libexec/../conf:/usr/lib/jvm/java-7-openjdk-amd64/lib/tools.jar:/usr/local/hadoop/libexec/..:/usr/local/hadoop/libexec/../hadoop-core-1.2.1.jar:/usr/local/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/hadoop/libexec/../lib/aspectjrt-1.6.11.jar:/usr/local/hadoop/libexec/../lib/aspectjtools-1.6.11.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/libexec/../lib/commons-cli-1.2.jar:/usr/local/hadoop/libexec/../lib/commons-codec-1.4.jar:/usr/local/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/usr/local/hadoop/libexec/../lib/commons-configuration-1.6.jar:/usr/local/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hadoop/libexec/../lib/commons-el-1.0.jar:/u
NettyClient java.net.ConnectException: Connection refused
Hi everyone, I have already run the SimpleShortestPathsComputation on single node pseudo-distribution and I am currently trying to run it on a 2 node cluster on Ubuntu 14.04. But every time I got the following Error: (Complete Logs below) "ERROR org.apache.giraph.master.MasterThread: masterThread: Master algorithm failed with IllegalStateException java.lang.IllegalStateException: connectAllAddresses: Too many failures (1000)." Which seems to be the result of the NettyClient not being able to connect with the other node on port 30001 resulting in "java.net.ConnectException: Connection refused: rofti/192.168.0.103:30001". I already tried to open the port on both nodes as described here: http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAcgib35tQyROodNQrE3Se_39JsT5MiQVP=4v==x10jtouf...@mail.gmail.com%3E and made sure that all host-names are written in only lowercase letters. But that didn't change anything. I really appreciate any help you guys can offer. Thanks, Marven Output of iptables -L : Chain INPUT (policy ACCEPT) target prot opt source destination ACCEPT tcp -- anywhere anywhere state NEW tcp spt:30001 ACCEPT tcp -- anywhere anywhere state NEW tcp dpts:3:30010 ACCEPT tcp -- anywhere anywhere state NEW tcp dpt:2181 Chain FORWARD (policy ACCEPT) target prot opt source destination Chain OUTPUT (policy ACCEPT) target prot opt source destination File: /etc/hosts on master(rofti-ex58-ud3r): 127.0.0.1 localhost 127.0.1.1 rofti-ex58-ud3r 192.168.0.101 master 192.168.0.103 slave rofti File: conf/zoo.cfg tickTime=2000 dataDir=/home/hduser/mydata/zookeeper clientPort=2181 initLimit=5 syncLimit=2 server.1=192.168.0.101:2888:3888 server.2=192.168.0.103:2888:3888 Syslog logs 1: 2015-09-04 17:43:46,416 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2015-09-04 17:43:46,661 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2015-09-04 17:43:46,784 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0 2015-09-04 17:43:46,787 INFO org.apache.hadoop.mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c1e6a1d 2015-09-04 17:43:46,884 INFO org.apache.hadoop.mapred.MapTask: Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1 2015-09-04 17:43:46,927 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2015-09-04 17:43:46,967 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)... 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201509041740_0002/_haltComputation 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201509041740_0002, 0 on master:2181,slave:2181 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=rofti-ex58-ud3r 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.7.0_79 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars/classes:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/attempt_201509041740_0002_m_00_0/work:/usr/local/hadoop/libexec/../conf:/usr/lib/jvm/java-7-openjdk-amd64/lib/tools.jar:/usr/local/hadoop/libexec/..:/usr/local/hadoop/libexec/../hadoop-core-1.2.1.jar:/usr/local/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/hadoop/libexec/../lib/aspectjrt-1.6.11.jar:/usr/local/hadoop/libexec/../lib/aspectjtools-1.6.11.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/libexec/../lib/commons-cli-1.2.jar:/usr/local/hadoop/libexec/../lib/commons-codec-1.4.jar:/usr/local/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/usr/local/hadoop/libexec/../lib/commons-configuration-1.6.jar:/usr/local/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hadoop/libexec/../lib/commons-el-1.0.jar:/u
NettyClient java.net.ConnectException: Connection refused
Hi everyone, I have already run the SimpleShortestPathsComputation on single node pseudo-distribution and I am currently trying to run it on a 2 node cluster on Ubuntu 14.04. But every time I got the following Error: (Complete Logs below) "ERROR org.apache.giraph.master.MasterThread: masterThread: Master algorithm failed with IllegalStateException java.lang.IllegalStateException: connectAllAddresses: Too many failures (1000)." Which seems to be the result of the NettyClient not being able to connect with the other node on port 30001 resulting in "java.net.ConnectException: Connection refused: rofti/192.168.0.103:30001". I already tried to open the port on both nodes as described here: http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAcgib35tQyROodNQrE3Se_39JsT5MiQVP=4v==x10jtouf...@mail.gmail.com%3E and made sure that all host-names are written in only lowercase letters. But that didn't change anything. I really appreciate any help you guys can offer. Thanks, Marven Output of iptables -L : Chain INPUT (policy ACCEPT) target prot opt source destination ACCEPT tcp -- anywhere anywhere state NEW tcp spt:30001 ACCEPT tcp -- anywhere anywhere state NEW tcp dpts:3:30010 ACCEPT tcp -- anywhere anywhere state NEW tcp dpt:2181 Chain FORWARD (policy ACCEPT) target prot opt source destination Chain OUTPUT (policy ACCEPT) target prot opt source destination File: /etc/hosts on master(rofti-ex58-ud3r): 127.0.0.1 localhost 127.0.1.1 rofti-ex58-ud3r 192.168.0.101 master 192.168.0.103 slave rofti File: conf/zoo.cfg tickTime=2000 dataDir=/home/hduser/mydata/zookeeper clientPort=2181 initLimit=5 syncLimit=2 server.1=192.168.0.101:2888:3888 server.2=192.168.0.103:2888:3888 Syslog logs 1: 2015-09-04 17:43:46,416 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2015-09-04 17:43:46,661 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2015-09-04 17:43:46,784 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0 2015-09-04 17:43:46,787 INFO org.apache.hadoop.mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c1e6a1d 2015-09-04 17:43:46,884 INFO org.apache.hadoop.mapred.MapTask: Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1 2015-09-04 17:43:46,927 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2015-09-04 17:43:46,967 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)... 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201509041740_0002/_haltComputation 2015-09-04 17:43:46,982 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201509041740_0002, 0 on master:2181,slave:2181 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=rofti-ex58-ud3r 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.7.0_79 2015-09-04 17:43:46,987 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre 2015-09-04 17:43:46,988 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars/classes:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/jars:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201509041740_0002/attempt_201509041740_0002_m_00_0/work:/usr/local/hadoop/libexec/../conf:/usr/lib/jvm/java-7-openjdk-amd64/lib/tools.jar:/usr/local/hadoop/libexec/..:/usr/local/hadoop/libexec/../hadoop-core-1.2.1.jar:/usr/local/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/hadoop/libexec/../lib/aspectjrt-1.6.11.jar:/usr/local/hadoop/libexec/../lib/aspectjtools-1.6.11.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/libexec/../lib/commons-cli-1.2.jar:/usr/local/hadoop/libexec/../lib/commons-codec-1.4.jar:/usr/local/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/usr/local/hadoop/libexec/../lib/commons-configuration-1.6.jar:/usr/local/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hadoop/libexec/../lib/commons-el-1.0.jar:/u
Re: java.net.ConnectException: Connection refused
Thanks Xenia.I also managed to solve the issue. Following is how I solved it. I ran netstat on all the computers of my cluster, and I ran the gripah job in parallel.I then learnt that this process runs on 127.0.0.1 while other machine tries to connect on 172.21.xx.xxx. That's why It gives the error java.net.ConnectException Then opened the /etc/hosts file, I found that the hostname of the machine was also mapped to 127.0.0.1.I removed that entry and it worked. It took me quite a while to resolve this issue. Anyway finally it worked. PuneetIIT Delhi, India On Tuesday, November 4, 2014 4:09 AM, Xenia Demetriou wrote: Hi Puneet, I am not an expert but I had the same error and I solved it by changing the hostnames of the cluster-Pcs in lowercase e.g Make iHadoop3 -> ihadoop3 -- Xenia 2014-11-02 14:08 GMT+02:00 Puneet Agarwal : I have setup a cluster of 4 computers for running my Pregel jobs. When running a job I often get the following error (given below).I followed another thread in giraph forums and learnt that this problem is because of the firewall stopping network traffic.I have stopped the firewall service on all the machines. These are machines have RHEL 5.5 and I stopped the service using the command - "service iptables stop" But I still get the same error. Can someone tell me what could be causing this service to be blocked on port 30001 on this computer? RegardsPuneet (IIT Delhi, India) Re: Problem running the PageRank example in a cluster | | | | | | | | | Re: Problem running the PageRank example in a clusterthis is the output of the command in all servers:Chain INPUT (policy ACCEPT)target prot opt source destinationACCEPT tcp -- anywhere anywhere stateNEW tcp dpts:3:30010ACCEPT tcp -- anywhere anywhere ... | | | | View on mail-archives.apache.org | Preview by Yahoo | | | | | Error===Using Netty without authentication. 2014-11-02 14:26:24,458 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with iHadoop3/172.21.208.178:30001 with 0 failures because of java.net.ConnectException: Connection refused 2014-11-02 14:26:24,458 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-11-02 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 failed, 1 failures total. 2014-11-02 14:26:24,499 WARN org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: Channel failed with remote address null java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)2014-11-02 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 failed, 1 failures total. 2014-11-02 14:26:24,499 WARN org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: Channel failed with remote address null java.net.ConnectException: Connection refusedjava.net.ConnectException: Connection refused
Re: java.net.ConnectException: Connection refused
Hi Puneet, I am not an expert but I had the same error and I solved it by changing the hostnames of the cluster-Pcs in lowercase e.g Make iHadoop3 -> ihadoop3 -- Xenia 2014-11-02 14:08 GMT+02:00 Puneet Agarwal : > I have setup a cluster of 4 computers for running my Pregel jobs. > > When running a job I often get the following error (given below). > I followed another thread in giraph forums and learnt that this problem is > because of the firewall stopping network traffic. > I have stopped the firewall service on all the machines. These are > machines have RHEL 5.5 and I stopped the service using the command - > "service iptables stop" > > But I still get the same error. > > Can someone tell me what could be causing this service to be blocked on > port 30001 on this computer? > > Regards > Puneet (IIT Delhi, India) > > Re: Problem running the PageRank example in a cluster > <http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAjjGef9QT6y_gobLzCFp=SERreJ9Rfv0zOnKpiUfED4S6=a...@mail.gmail.com%3E> > > > > > > > Re: Problem running the PageRank example in a cluster > <http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAjjGef9QT6y_gobLzCFp=SERreJ9Rfv0zOnKpiUfED4S6=a...@mail.gmail.com%3E> > this is the output of the command in all servers: Chain INPUT (policy > ACCEPT) target prot opt source destination ACCEPT tcp -- anywhere anywhere > state NEW tcp dpts:3:30010 ACCEPT tcp -- anywhere anywhere ... > View on mail-archives.apache.org > <http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3CCAAjjGef9QT6y_gobLzCFp=SERreJ9Rfv0zOnKpiUfED4S6=a...@mail.gmail.com%3E> > Preview by Yahoo > > > > > Error > === > Using Netty without authentication. > > 2014-11-02 14:26:24,458 WARN org.apache.giraph.comm.netty.NettyClient: > connectAllAddresses: Future failed to connect with > iHadoop3/172.21.208.178:30001 with 0 failures because of > java.net.ConnectException: Connection refused > 2014-11-02 14:26:24,458 INFO org.apache.giraph.comm.netty.NettyClient: Using > Netty without authentication. > 2014-11-02 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: > connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 > failed, 1 failures total. > 2014-11-02 14:26:24,499 WARN > org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: > Channel failed with remote address null > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)2014-11-02 > 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: > connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 > failed, 1 failures total. > 2014-11-02 14:26:24,499 WARN > org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: > Channel failed with remote address null > > java.net.ConnectException: Connection refusedjava.net.ConnectException: > Connection refused > > > >
java.net.ConnectException: Connection refused
I have setup a cluster of 4 computers for running my Pregel jobs. When running a job I often get the following error (given below).I followed another thread in giraph forums and learnt that this problem is because of the firewall stopping network traffic.I have stopped the firewall service on all the machines. These are machines have RHEL 5.5 and I stopped the service using the command - "service iptables stop" But I still get the same error. Can someone tell me what could be causing this service to be blocked on port 30001 on this computer? RegardsPuneet (IIT Delhi, India) Re: Problem running the PageRank example in a cluster | | | | | | | | | Re: Problem running the PageRank example in a clusterthis is the output of the command in all servers:Chain INPUT (policy ACCEPT)target prot opt source destinationACCEPT tcp -- anywhere anywhere stateNEW tcp dpts:3:30010ACCEPT tcp -- anywhere anywhere ... | | | | View on mail-archives.apache.org | Preview by Yahoo | | | | | Error===Using Netty without authentication. 2014-11-02 14:26:24,458 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with iHadoop3/172.21.208.178:30001 with 0 failures because of java.net.ConnectException: Connection refused 2014-11-02 14:26:24,458 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-11-02 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 failed, 1 failures total. 2014-11-02 14:26:24,499 WARN org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: Channel failed with remote address null java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)2014-11-02 14:26:24,459 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 1 failed, 1 failures total. 2014-11-02 14:26:24,499 WARN org.apache.giraph.comm.netty.handler.ResponseClientHandler: exceptionCaught: Channel failed with remote address null java.net.ConnectException: Connection refusedjava.net.ConnectException: Connection refused
Re: java.net.ConnectException: Connection refused
ractivate.adobe.com:22181> with poll msecs = 3000 2012-10-16 17:40:48,946 WARN org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Got ConnectException java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:432) at java.net.Socket.connect(Socket.java:529) at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:661) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:329) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:578) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.Child.main(Child.java:249) 2012-10-16 17:40:51,948 INFO org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Connect attempt 1 of 10 max trying to connect to practivate.adobe.com:22181 <http://practivate.adobe.com:22181> with poll msecs = 3000 2012-10-16 17:40:51,950 INFO org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Connected to practivate.adobe.com/127.0.0.1:22181 <http://practivate.adobe.com/127.0.0.1:22181>! 2012-10-16 17:40:51,950 INFO org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Creating my filestamp _bsp/_defaultZkManagerDir/job_201210161739_0001/_zkServer/practivate.adobe.com <http://practivate.adobe.com> 0 2012-10-16 17:40:52,031 INFO org.apache.giraph.graph.GraphMapper: setup: Starting up BspServiceMaster (master thread)... 2012-10-16 17:40:52,956 INFO org.apache.giraph.graph.BspService: BspService: Connecting to ZooKeeper with job job_201210161739_0001, 0 on practivate.adobe.com:22181 <http://practivate.adobe.com:22181> 2012-10-16 17:40:53,139 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT 2012-10-16 17:40:53,139 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name <http://host.name>=practivate.adobe.com <http://practivate.adobe.com> 2012-10-16 17:40:53,139 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_26 2012-10-16 17:40:53,140 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc. 2012-10-16 17:40:53,140 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home 2012-10-16 17:40:53,140 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/tmp/hadoop-ro/mapred/local/taskTracker/ro/jobcache/job_201210161739_0001/jars/classes:/tmp/hadoop-ro/mapred/local/taskTracker/ro/jobcache/job_201210161739_0001/jars:/tmp/hadoop-ro/mapred/local/taskTracker/ro/jobcache/job_201210161739_0001/attempt_201210161739_0001_m_00_0/work:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../conf:/System/Library/Frameworks/JavaVM.framework//Versions/1.6.0/Home//lib/tools.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/..:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../hadoop-core-1.0.3.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/asm-3.2.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/aspectjrt-1.6.5.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/aspectjtools-1.6.5.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-beanutils-1.7.0.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-beanutils-core-1.8.0.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-cli-1.2.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-codec-1.4.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-collections-3.2.1.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-configuration-1.6.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-daemon-1.0.1.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-digester-1.8.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-el-1.0.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-httpclient-3.0.1.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-io-2.1.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-lang-2.4.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3/libexec/../lib/commons-logging-1.1.1.jar:/Users/ro/Desktop/usp/iniciacao/hadoop-1.0.3
