Re: Datanodes using public ip, why?

2013-07-17 Thread Ben Kim
) with private IPs. if you have records in the nodes hosts files like public IP hosname remove (or comment) them Alex On Jul 11, 2013 2:21 AM, Ben Kim benkimkim...@gmail.com wrote: Hello Hadoop Community! I've setup datanodes with private network by adding private hostname's to the slaves file

Datanodes using public ip, why?

2013-07-11 Thread Ben Kim
Hello Hadoop Community! I've setup datanodes with private network by adding private hostname's to the slaves file. but it looks like when i lookup on the webUI datenodes are registered with public hostnames. are they actually networking with public network? all datanodes have eth0 with public

Re: Decommissioning a datanode takes forever

2013-01-22 Thread Ben Kim
is for blk_4844131893883391179_3440513. How would I delete the block? it's not showing as corrupted block on fsck. :( BEN On Tue, Jan 22, 2013 at 9:28 AM, Ben Kim benkimkim...@gmail.com wrote: Hi Varun, Thnk you for the reponse No there doesnt seem to be any corrupted blocks in my cluster. I

Re: Decommissioning a datanode takes forever

2013-01-22 Thread Ben Kim
. maybe someone else can figure it out when I come back tomorrow :) Best regards, Ben On Tue, Jan 22, 2013 at 5:38 PM, Ben Kim benkimkim...@gmail.com wrote: UPDATE: WARN with edit log had nothing to do with the current problem. However replica placement warnings seem to be suspicious. Please

Re: Decommissioning a datanode takes forever

2013-01-21 Thread Ben Kim
There isn't any WARN or ERROR in the decommissioning datanode log Ben On Mon, Jan 21, 2013 at 3:05 PM, varun kumar varun@gmail.com wrote: Hi Ben, Are there any corrupted blocks in your hadoop cluster. Regards, Varun Kumar On Mon, Jan 21, 2013 at 8:22 AM, Ben Kim benkimkim...@gmail.com wrote

Hadoop topology not working (all servers belongs to default rack)

2012-06-27 Thread Ben Kim
Hi I got my topology script from http://wiki.apache.org/hadoop/topology_rack_awareness_scripts I checked that the script works correctly. But, in the hadoop cluster, all my servers get assigned to the default rack. I'm using hadoop 1.0.3, but had experienced same problem with 1.0.0 version.