You are correct.
The default 1mb/sec is too low.
1gb/sec is too high.
I changed it to 10mb/sec and its humming along.
Thanks.
Taeho Kang wrote:
> By setting "dfs.balance.bandwidthPerSec" to 1GB/sec, each datanode is able
> to utilize up to 1GB/sec for block balancing. It seems to be too high as
>
By setting "dfs.balance.bandwidthPerSec" to 1GB/sec, each datanode is able
to utilize up to 1GB/sec for block balancing. It seems to be too high as
even a gigabit ethernet can't handle that much data per sec.
When you get timeouts, it probably means your network is saturated. Maybe
you were runnin
I'm trying to re balance my cluster as I've added to more nodes.
When I run balancer with the default threshold I am seeing timeouts in
the logs:
2008-07-18 09:50:46,636 INFO org.apache.hadoop.dfs.Balancer: Decided to
move block -8432927406854991437 with a length of 128 MB bytes from
10.11.6.234:5
