Re: Fixing Mis-replicated blocks

2011-10-21 Thread John Meagher
In this case everything should be 3. I was hoping there was a quicker way. The -w option should help so this doesn't need to be run again. On Thu, Oct 20, 2011 at 20:26, Jeff Bean wrote: > Do setrep -w on the increase to force the new replica before decreasing > again. > > Of course, the little

Re: Fixing Mis-replicated blocks

2011-10-20 Thread Jeff Bean
Do setrep -w on the increase to force the new replica before decreasing again. Of course, the little script only works if the replication factor is 3 on all the files. If it's a variable amount you should use the java API to get the existing factor and then increase by one and then decrease. Jeff

Fixing Mis-replicated blocks

2011-10-20 Thread John Meagher
After a hardware move with an unfortunate mis-setup rack awareness script our hadoop cluster has a large number of mis-replicated blocks. After about a week things haven't gotten better on their own. Is there a good way to trigger the name node to fix the mis-replicated blocks? Here's what I'm u