Re: Datanodes using public ip, why?

2013-07-17 Thread Ben Kim
Hi
Thank you all for the comments

setting dfs.datanode.dns.interface and having private ip's in slaves ans
masters file didn't work.
So as Alex said I changed all public ip mapping to hostnames on /etc/hosts
file, and all datanodes now communicate through private network.

but im not fully content since on some situations I would want hostnames to
be mapped to public ips, and hadoop still communication through private
network. I don't understand why dfs.datanode.dns.interface has no effect.


One interesting thing i found is that if I change dfs.default.name to
public ip from private one, all datanodes now report themselves with public
ips.
so confusing. why?

btw, im using hadoop 1.0.3, without nameserver and firewalls

Thank you
Ben





On Fri, Jul 12, 2013 at 12:29 PM, Alex Levin ale...@gmail.com wrote:

 make sure that your hostnames resolved ( dns or/and hosts files ) with
 private IPs.

 if you have records in the nodes hosts files like
 public IP hosname

 remove (or comment) them

 Alex
 On Jul 11, 2013 2:21 AM, Ben Kim benkimkim...@gmail.com wrote:

 Hello Hadoop Community!

 I've setup datanodes with private network by adding private hostname's to
 the slaves file.
 but it looks like when i lookup on the webUI datenodes are registered
 with public hostnames.

 are they actually networking with public network?

 all datanodes have eth0 with public address and eth1 with private address.

 what am i missing?

 Thanks a whole lot

 *Benjamin Kim*
 *benkimkimben at gmail*




-- 

*Benjamin Kim*
*benkimkimben at gmail*


Re: Datanodes using public ip, why?

2013-07-11 Thread Thanh Do
have you tried playing with this config parameter

dfs.datanode.dns.interface

?


On Thu, Jul 11, 2013 at 4:20 AM, Ben Kim benkimkim...@gmail.com wrote:

 Hello Hadoop Community!

 I've setup datanodes with private network by adding private hostname's to
 the slaves file.
 but it looks like when i lookup on the webUI datenodes are registered with
 public hostnames.

 are they actually networking with public network?

 all datanodes have eth0 with public address and eth1 with private address.

 what am i missing?

 Thanks a whole lot

 *Benjamin Kim*
 *benkimkimben at gmail*



Re: Datanodes using public ip, why?

2013-07-11 Thread Alex Levin
make sure that your hostnames resolved ( dns or/and hosts files ) with
private IPs.

if you have records in the nodes hosts files like
public IP hosname

remove (or comment) them

Alex
On Jul 11, 2013 2:21 AM, Ben Kim benkimkim...@gmail.com wrote:

 Hello Hadoop Community!

 I've setup datanodes with private network by adding private hostname's to
 the slaves file.
 but it looks like when i lookup on the webUI datenodes are registered with
 public hostnames.

 are they actually networking with public network?

 all datanodes have eth0 with public address and eth1 with private address.

 what am i missing?

 Thanks a whole lot

 *Benjamin Kim*
 *benkimkimben at gmail*