Yes, checkpoints are helpful when your original NN image goes corrupt (very
very rare, if you use dual or more dfs.name.dir points to be safe).
On 27-Dec-2011, at 12:33 PM, praveenesh kumar wrote:
> Cool.
> I just did that..
> So now I am seeing my fsimage file on SNN's hadoop.tmp.dir...
> So in
Cool.
I just did that..
So now I am seeing my fsimage file on SNN's hadoop.tmp.dir...
So incase my NN went down.. I can take this image file from SNN and paste
it at NN's *dfs.name.dir/current/fsimage *
and I can have NN up based on last snapshot that SNN had, right ?
Thanks,
Praveenesh
On Tue,
The link Uma passed already covered that question:
http://www.cloudera.com/blog/2009/02/multi-host-secondarynamenode-configuration/
[dfs.http.address in hdfs-site.xml pointing to NN_HOST:50070 should do.]
Also, if you are using the tarball start/stop scripts, putting in the hostname
for SNN in
Thanks..But, my 1st question is still unanswered.
I have a 8 DN/TT machines and 1 NN machine.
I want to set one of my DN/TT machine as SNN.
How I have to configure my conf/*.xml files to achieve this ?
Thanks,
Praveenesh
On Mon, Dec 26, 2011 at 8:44 PM, Harsh J wrote:
> (Answering beyond Uma's r
hello all,
I have a running hadoop 0.21.0 cluster, since 0.22 is the stable version
and we don't use Kerberos. just want to be sure, has anybody upgrade from
hadoop 0.21 to 0.22 siccessfully?
any hint would be greatly appreciated!
--
best wishes.
Steven
Bccing common-user and ccing mapred-user. Please use the correct
mailing lists for your questions.
You can use -Dstream.map.output.field.separator=
for specifying the seperator.
The link below should have more information.
http://hadoop.apache.org/common/docs/r0.20.205.0/streaming.html#Custom
Hi Uma,
Thanks a lot. At last it is running without errors. Thank you very much for
your suggestion.
On 26 December 2011 20:04, Uma Maheswara Rao G wrote:
> Hey Humayun,
> Looks your hostname still not resoling properly. even though you
> configured hostnames as master, slave...etc, it is getti
(Answering beyond Uma's reply)
> Can a DN also act as SNN, any pros and cons of having this configuration ?
You can run SNN on a regular slave box if you can't have a dedicate a box, it
shouldn't be an issue for small clusters -- Do ensure its disk configuration is
proper, and its allocated nea
Hey Praveenesh,
You can start secondary namenode also by just giving the option ./hadoop
secondarynamenode
DN can not act as seconday namenode. The basic work for seconday namenode is to
do checkpointing and getting the edits insync with Namenode till last
checkpointing period. DN is to s
Hey Humayun,
Looks your hostname still not resoling properly. even though you configured
hostnames as master, slave...etc, it is getting humayun as hostname.
just edit /etc/HOSTNAME file with correct hostname what you are expecting here.
To confirm whether it is resolving properly or not, you ca
Hey people,
How can we setup another machine in the cluster as Secondary Namenode
in hadoop 0.20.205 ?
Can a DN also act as SNN, any pros and cons of having this configuration ?
Thanks,
Praveenesh
HI:
In streming MR program, I use /bin/cat as a mapper and set reducer=NONE,
but the outputs all end with a tab separator. How do I configure the
streaming MR program to remove the ending separator?
Thanks.
12 matches
Mail list logo