Re: NN + secondary got full, even though data nodes had plenty of space

2009-08-12 Thread Mayuran Yogarajah
Todd Lipcon wrote: Hi Mayuran, Do you do all of your uploads of data into your Hadoop cluster from node001 and node002? If so, keep in mind that one of your replicas will always be written on localhost in the case that it is part of the cluster. You should consider running the rebalancer to ev

Re: NN + secondary got full, even though data nodes had plenty of space

2009-08-12 Thread Mayuran Yogarajah
Amandeep Khurana wrote: Is your NN doubling up as a DN? If its not, I wonder how the NN is full... Yes both NN and secondary are doubling as DN, sorry I should have mentioned this earlier. M On 8/11/09, Mayuran Yogarajah wrote: I have a 6 node cluster running Hadoop 0.18.3. I'm trying

Re: NN + secondary got full, even though data nodes had plenty of space

2009-08-12 Thread Todd Lipcon
Hi Mayuran, Do you do all of your uploads of data into your Hadoop cluster from node001 and node002? If so, keep in mind that one of your replicas will always be written on localhost in the case that it is part of the cluster. You should consider running the rebalancer to even up your space usag

Re: NN + secondary got full, even though data nodes had plenty of space

2009-08-12 Thread Amandeep Khurana
Is your NN doubling up as a DN? If its not, I wonder how the NN is full... On 8/11/09, Mayuran Yogarajah wrote: > I have a 6 node cluster running Hadoop 0.18.3. I'm trying to figure out > how the data was spread out like this: > > node001 94.15% > node002 94.16% > node003

NN + secondary got full, even though data nodes had plenty of space

2009-08-11 Thread Mayuran Yogarajah
I have a 6 node cluster running Hadoop 0.18.3. I'm trying to figure out how the data was spread out like this: node001 94.15% node002 94.16% node003 48.22% node004 47.85% node005 48.12% node006 43.18% Node 001 (NN) and node 002( secondary NN) bo