RE: We are looking to the root of the problem that caused us IOException

2011-04-06 Thread Guy Doulberg
Great, Thanks From: Ted Dunning [mailto:tdunn...@maprtech.com] Sent: Wednesday, April 06, 2011 10:55 AM To: common-user@hadoop.apache.org Cc: Guy Doulberg Subject: Re: We are looking to the root of the problem that caused us IOException yes. At least periodically. You now have a situation

Re: We are looking to the root of the problem that caused us IOException

2011-04-06 Thread Ted Dunning
yes. At least periodically. You now have a situation where the age distribution of blocks in each datanode is quite different. This will lead to different evolution of which files are retained and that is likely to cause imbalances again. It will also cause the performance of your system to be

RE: We are looking to the root of the problem that caused us IOException

2011-04-05 Thread Guy Doulberg
@hadoop.apache.org Cc: Guy Doulberg Subject: Re: We are looking to the root of the problem that caused us IOException YOu can configure the balancer to use higher bandwidth. That can speed it up by 10x On Tue, Apr 5, 2011 at 2:54 AM, Guy Doulberg mailto:guy.doulb...@conduit.com>> wrote: We are runni

Re: We are looking to the root of the problem that caused us IOException

2011-04-05 Thread Ted Dunning
YOu can configure the balancer to use higher bandwidth. That can speed it up by 10x On Tue, Apr 5, 2011 at 2:54 AM, Guy Doulberg wrote: > We are running the blancer, but it takes a lot of time... in this time the > cluster not working >

RE: We are looking to the root of the problem that caused us IOException

2011-04-05 Thread Guy Doulberg
Message- From: elton sky [mailto:eltonsky9...@gmail.com] Sent: Tuesday, April 05, 2011 10:18 AM To: common-user@hadoop.apache.org Subject: Re: We are looking to the root of the problem that caused us IOException check the FAQ ( http://wiki.apache.org/hadoop/FAQ#What_does_

Re: We are looking to the root of the problem that caused us IOException

2011-04-05 Thread elton sky
check the FAQ ( http://wiki.apache.org/hadoop/FAQ#What_does_.22file_could_only_be_replicated_to_0_nodes.2C_instead_of_1.22_mean.3F ) On Tue, Apr 5, 2011 at 4:53 PM, Guy Doulberg wrote: > Hey guys, > > We are trying to figure out why many of our Map/Reduce job on the cluster > are failing. > In lo