Re: Disc not equally utilized in hdfs data nodes

2013-09-05 Thread Harsh J
Please share your hdfs-site.xml. HDFS needs to be configured to use all 4 disk mounts - it does not auto-discover and use all drives today. On Thu, Sep 5, 2013 at 10:48 PM, Viswanathan J jayamviswanat...@gmail.com wrote: Hi, The data which are storing in data nodes are not equally utilized in

Disc not equally utilized in hdfs data nodes

2013-09-05 Thread Viswanathan J
Hi, The data which are storing in data nodes are not equally utilized in all the data directories. We having 4x1 TB drives, but huge data storing in single disc only at all the nodes. How to balance for utilize all the drives. This causes the hdfs storage size becomes high very soon even though

Re: Disc not equally utilized in hdfs data nodes

2013-09-05 Thread Harsh J
The spaces may be a problem if you are using the older 1.x releases. Please try to specify the list without spaces, and also check if all of these paths exist and have some DN owned directories under them. Please also keep the lists in CC/TO when replying. Clicking Reply-to-all usually helps do

Re: Disc not equally utilized in hdfs data nodes

2013-09-05 Thread Viswanathan J
Thanks Harsh. Hope I don't have space in my list which I specified in the last mail. Thanks, V On Sep 5, 2013 11:20 PM, Harsh J ha...@cloudera.com wrote: The spaces may be a problem if you are using the older 1.x releases. Please try to specify the list without spaces, and also check if all