RE: DataNode stops cleaning disk?

2009-03-17 Thread Igor Bolotin
block is not one of them) and trace it in NameNode log 3) take jstack of the datanode in this state. Since you still have over-replicated blocks, you probably has more datanodes in early stages of this problem. Igor Bolotin wrote: > Caught this issue again on one of the clusters. DF and DU si

RE: DataNode stops cleaning disk?

2009-03-17 Thread Igor Bolotin
ginal Message- From: Igor Bolotin Sent: Monday, March 09, 2009 2:50 PM To: core-user@hadoop.apache.org Subject: RE: DataNode stops cleaning disk? My mistake about 'current' directory - that's the one that consumes all the disk space and 'du' on that directory matche

RE: DataNode stops cleaning disk?

2009-03-09 Thread Igor Bolotin
first email - everything works perfectly well (another application of Murphy law). Thanks, Igor -Original Message- From: Raghu Angadi [mailto:rang...@yahoo-inc.com] Sent: Thursday, March 05, 2009 12:06 PM To: core-user@hadoop.apache.org Subject: Re: DataNode stops cleaning disk? Igor Bolotin w

RE: DataNode stops cleaning disk?

2009-03-05 Thread Igor Bolotin
t') - Does 'du' of this directory match with what is reported to NameNode (shown on webui) by this DataNode. - Is there anything else taking disk space on the machine? Raghu. Igor Bolotin wrote: > Normally I dislike writing about problems without being able to provide > some mo

DataNode stops cleaning disk?

2009-03-05 Thread Igor Bolotin
Normally I dislike writing about problems without being able to provide some more information, but unfortunately in this case I just can't find anything. Here is the situation - DFS cluster running Hadoop version 0.19.0. The cluster is running on multiple servers with practically identical hard