When using HFileOutputFormat, HMaster often crashes.
I guess this critical problem is caused by the timeout of Zookeeper.
Does anyone know what may have caused this? How might I prevent this
from happening again?
HBase Version : 0.90.3, r1100350
Hadoop Version : 0.20.3-SNAPSHOT, r1057313
Some
Yes. Your master is timing out against your zk. Whats going on? ZK
nodes have MR running on them? Your master is doing long GC pauses?
St.Ack
On Tue, Jun 28, 2011 at 7:46 PM, Gan, Xiyun wrote:
> When using HFileOutputFormat, HMaster often crashes.
>
> I guess this critical problem is caused by
Thanks Stack.
Yeah, I have M/R job on Zookeeper nodes. Does it necessary to separate
zk nodes and tasktrackers?
On Wed, Jun 29, 2011 at 11:24 AM, Stack wrote:
> Yes. Your master is timing out against your zk. Whats going on? ZK
> nodes have MR running on them? Your master is doing long GC pau
I'm just guessing the MR job is vampiring i/o from the zk processes.
Can you check?
St.Ack
On Tue, Jun 28, 2011 at 8:29 PM, Gan, Xiyun wrote:
> Thanks Stack.
>
> Yeah, I have M/R job on Zookeeper nodes. Does it necessary to separate
> zk nodes and tasktrackers?
>
> On Wed, Jun 29, 2011 at 11:24 A
I use HFileOutputFormat.configureIncrementalLoad() to run a MR job,
which lasts about 10 minutes.
On Wed, Jun 29, 2011 at 11:53 AM, Stack wrote:
> I'm just guessing the MR job is vampiring i/o from the zk processes.
> Can you check?
> St.Ack
>
> On Tue, Jun 28, 2011 at 8:29 PM, Gan, Xiyun wrote:
