Guys,
Any clues why the corrupted image could happen.
regards
macf
On Wed, Jun 29, 2011 at 9:11 AM, mac fang wrote:
> HI, Todd,
>
> we use the 0.21 version. I think we used the 'kill -9'. The possible timing
> is when startup or checkpoint.
>
> regards
> macf
&
> > number, may be 1 billion or more, OutOfMemoryError happens before
> > EOFException.
> >
> > How can we provide the validity of FSImage file?
> >
> > --regards
> > Denny Ye
> >
> > On Tue, Jun 28, 2011 at 4:44 PM, mac fang wrote:
> >
>
Hi, Team,
What we found when we use the Hadoop is, the FSImage often currupts when we
do start/stop the Hadoop cluster. The reason we think might be around the
write to the outputstream: the NameNode may be killed when it saveNamespace,
then the FsImage file doesn't complete writing. Currently i s
Zookeeper.
> >
> > -dhruba
> >
> > On Tue, Jan 25, 2011 at 6:12 PM, Harsh J wrote:
> >
> >> This is a good approach, is used by many to mask the NameNode address
> >> for the DataNodes; and is also good to use while using BackupNode
> >>
s a good approach, is used by many to mask the NameNode address
> for the DataNodes; and is also good to use while using BackupNode
> (Even Facebook does this).
>
> On Wed, Jan 26, 2011 at 7:38 AM, mac fang wrote:
> > Hi, guys,
> >
> > Do we have any plan to enable VIP
Hi, guys,
Do we have any plan to enable VIP between NameNode and DataNodes, I mean
multiple NameNodes and we use a VIP stands before the NNs. Then DNs only
need to connect to the VIP. I don't know if it is valuable we have this impl
in our hdsf and if there has any issues?
Any hints are valuable
Hi, guys, one question about Backup Node,
The code in Backup Node shows us the NamespaceID of BN must be same as NN,
but when I start BackupNode, I have to do Namenode.format - which means the
NamespaceID is a new one. Then I need to remove the ID and replace with the
one of NN. Does it necessary?
Hi, all,
I am NOT sure if there any plan or issues of integrating Zookeeper and
NameNode to resolve the Single Point issue of NameNode. With it, the
DataNodes dont need to be restarted. I think this can improve the
availability of the whole cluster. I heard there is a plan for JobTracker
and Task
Hi, guys,
Since i am quite new in using the Hadoop, currently i face one problem about
the NameNode HA. Below is the case
1. We are using Hadoop 0.21
2. We manage about 1 NameNode, 1 Backup node and 100 datanodes
Current issue:
if the namenode crashed, it switched to the backup node. However we
