Here is the property in hdfs-site.xml <property> <name>dfs.http.address</name> <value>pnjhadoopnn01:50070</value> </property>
Thanks, Jian On Fri, Aug 10, 2012 at 11:46 AM, Harsh J <ha...@cloudera.com> wrote: > Yes the test was to figure out if there really was a listener on > 50070. Can you check the hdfs-site.xml on the NN machine for what its > dfs.http.address may really be using for its port? > > On Fri, Aug 10, 2012 at 7:48 PM, Jian Fang > <jian.fang.subscr...@gmail.com> wrote: > > Hi Harsh, > > > > Seems the -p requires the root privilege, which I don't have. I run > > "netstat -a | grep 50070", but did not get back anything. As I said, > telnet > > did not work either. > > > > [hadoop@pnjhadoopnn01 ~]$ telnet pnjhadoopnn01 50070 > > Trying xx.xx.xx.xx... > > telnet: connect to address xx.xx.xx.xx: Connection refused > > telnet: Unable to connect to remote host: Connection refused > > > > [hadoop@pnjhadoopnn01 ~]$ telnet localhost 50070 > > Trying 127.0.0.1... > > telnet: connect to address 127.0.0.1: Connection refused > > telnet: Unable to connect to remote host: Connection refused > > > > Thanks, > > > > Jian > > > > On Fri, Aug 10, 2012 at 1:50 AM, Harsh J <ha...@cloudera.com> wrote: > >> > >> Jian, > >> > >> From your NN, can you get us the output "netstat -anp | grep 50070"? > >> > >> On Fri, Aug 10, 2012 at 9:29 AM, Jian Fang > >> <jian.fang.subscr...@gmail.com> wrote: > >> > Thanks Harsh. But there is no firewall there, the two clusters are on > >> > the > >> > same networks. I cannot telnet to the port even on the same machine. > >> > > >> > > >> > On Thu, Aug 9, 2012 at 6:00 PM, Harsh J <ha...@cloudera.com> wrote: > >> >> > >> >> Hi Jian, > >> >> > >> >> HFTP is always-on by default. Can you check and make sure that the > >> >> firewall isn't the cause of the connection refused on port 50070 on > >> >> the NN and ports 50075 on the DNs here? > >> >> > >> >> On Fri, Aug 10, 2012 at 1:47 AM, Jian Fang > >> >> <jian.fang.subscr...@gmail.com> wrote: > >> >> > Hi, > >> >> > > >> >> > We have a hadoop cluster of version 0.20.2 in production. Now we > have > >> >> > another new Hadoop cluster using cloudera's CDH3U4. We like to run > >> >> > distcp to > >> >> > copy files between the two clusters. Since the hadoop versions are > >> >> > different, we have to use hftp protocol to copy files based on the > >> >> > hadoop > >> >> > document here: > >> >> > http://hadoop.apache.org/common/docs/r0.20.2/distcp.html#cpver. > >> >> > > >> >> > The problem is that I cannot access files via hftp from the current > >> >> > production 0.20.2 cluster even though I can see the following > setting > >> >> > from > >> >> > job tracker UI. > >> >> > > >> >> > dfs.http.address pnjhadoopnn01:50070 > >> >> > > >> >> > I tried to telnet this port, but got "connection refused" error. > >> >> > Seems > >> >> > the > >> >> > hftp service is not actually running. Could someone tell me how to > >> >> > enable > >> >> > the hftp service in the 0.20.2 hadoop cluster so that I can run > >> >> > distcp? > >> >> > > >> >> > Thanks in advance, > >> >> > > >> >> > John > >> >> > >> >> > >> >> > >> >> -- > >> >> Harsh J > >> > > >> > > >> > >> > >> > >> -- > >> Harsh J > > > > > > > > -- > Harsh J >