DataBlockScanner's rate limit

2013-08-01 Thread Davey Yan
, there is no parameter to change the rate limit. It seams to be 1MB to 8MB always. -- Davey Yan

Re: DataBlockScanner's rate limit

2013-08-01 Thread Davey Yan
. Depending on what the outage caused, it is likely that you are missing a mount and perhaps blocks of files with a single replica. Run an fsck to identify what files these are and if they used a single replication factor? On Fri, Aug 2, 2013 at 7:25 AM, Davey Yan davey@gmail.com wrote: I

Re: Datanodes shutdown and HBase's regionservers not working

2013-02-27 Thread Davey Yan
to find the issue? JM 2013/2/25 Davey Yan davey@gmail.com: Hi Nicolas, I think i found what led to shutdown of all of the datanodes, but i am not completely certain. I will return to this mail list when my cluster returns to be stable. On Mon, Feb 25, 2013 at 8:01 PM, Nicolas Liochon nkey

Re: Datanodes shutdown and HBase's regionservers not working

2013-02-25 Thread Davey Yan
:10 AM, Davey Yan davey@gmail.com wrote: Hey guys, We have a cluster with 5 nodes(1 NN and 4 DNs) running for more than 1 year, and it works fine. But the datanodes got shutdown twice in the last month. When the datanodes got shutdown, all of them became Dead Nodes in the NN web admin UI

Re: Datanodes shutdown and HBase's regionservers not working

2013-02-25 Thread Davey Yan
But... there was no log like network unreachable. On Mon, Feb 25, 2013 at 6:07 PM, Nicolas Liochon nkey...@gmail.com wrote: I agree. Then for HDFS, ... The first thing to check is the network I would say. On Mon, Feb 25, 2013 at 10:46 AM, Davey Yan davey@gmail.com wrote: Thanks

Re: Datanodes shutdown and HBase's regionservers not working

2013-02-25 Thread Davey Yan
:44 PM, Davey Yan davey@gmail.com wrote: But... there was no log like network unreachable. On Mon, Feb 25, 2013 at 6:07 PM, Nicolas Liochon nkey...@gmail.com wrote: I agree. Then for HDFS, ... The first thing to check is the network I would say. On Mon, Feb 25, 2013 at 10:46