Take a look at the 2.7.3 docs on rolling upgrade for HDFS:
http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html
I don't think there's similar existing docs for YARN, but your cluster
description sounds like you're only using HDFS anyways.
On Fri, Jul 28, 2
Hi,
Can you give me a step by step process to upgrade Hadoop version from 2.5.1
to 2.7.3 (Running Hbase 1.2.5)
We have a cluster setup of
3 Journalnodes
1 active and 1 Backup namenode
15 datanodes
Please let know the process how to *upgrade without downtime*
--
*REGARDS*
*KRISHNA V*
*c
Backing up one of them is sufficient, but do check if both their
contents are same and backup the more recent one (a mount may lag
behind if it had a failure earlier, for ex.).
On Mon, May 19, 2014 at 3:39 PM, ch huang wrote:
> hi,maillist:
> i want to upgrade my cluster ,in doc,one of st
hi,maillist:
i want to upgrade my cluster ,in doc,one of step is backup
namenode dfs.namenode.name.dir
directory,i have 2 directories defined in hdfs-site.xml,should i backup
them all ,or just one of them?
dfs.namenode.name.dir
file:///data/namespace/1,file:///data/nam
Hello Norbert,
In 2.x, the upgrade process on the DN disk layout happens with greater
parallelism, and the overall DN upgrade is also a distributed task, so
you can expect it to complete very fast - certainly less than an hour
tops.
On Fri, Mar 21, 2014 at 12:54 PM, norbi wrote:
> Hi List,
>
> w
Hi List,
we are using a hadoop cluster (v 0.20.2) and want to upgrade to cloudera
4.6 (hadoop 2.0).
Configured Capacity: 969329209806848 (881.6 TB)
Present Capacity: 969146545811532 (881.43 TB)
DFS Remaining: 219694195171526 (199.81 TB)
DFS Used: 749452350640006 (681.62 TB)
DFS Used%: 77.33%
U
Thanks Harsh, if I upgrade the cluster with Apache hadoop can I install or
untar the hadoop stable source folder directly and will this work?
Or do I need to run upgrade and finalizeupgrade commands?
Thanks,
Viswa.J
On Aug 23, 2013 10:26 PM, "Harsh J" wrote:
> CDH4 is perfectly stable and is in
Thanks Harsh for your answers.
I asked that namenode layout version id doesn't conflict.
-Viswa.J
On Aug 23, 2013 10:12 PM, "Harsh J" wrote:
> Hi,
>
> On Fri, Aug 23, 2013 at 10:05 PM, Viswanathan J
> wrote:
> > Hi,
> >
> > We are planning to upgrade our production hdfs cluster from 1.0.4 to
>
Hi,
On Fri, Aug 23, 2013 at 10:05 PM, Viswanathan J
wrote:
> Hi,
>
> We are planning to upgrade our production hdfs cluster from 1.0.4 to 1.2.1
>
> So if I directly upgrade the cluster, it won't affect the edits, fsimage and
> checkpoints?
Yes, an upgrade won't affect those.
> Also after upgrad
Hi,
We are planning to upgrade our production hdfs cluster from 1.0.4 to 1.2.1
So if I directly upgrade the cluster, it won't affect the edits, fsimage
and checkpoints?
Also after upgrade is it will read the blocks, files from the data nodes
properly?
Is the version id conflict occurs with NN?
Actually, 1.2.1 is out (and marked stable). I see no reason not to upgrade.
http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As far as performance goes, when I upgraded our cluster from 1.0.4 to
1.1.2, our small jobs (that took about 1 min each) were taking about 20-30s
less time. So ther
Regards, Viswanathan J.
Like Hars said, the release notes described every bug fix, minor or
major improvements with the link to the related JIRA for each one.
Just a simple question? Why not upgrade directly to 1.2.0?
There are lot of good improvements and bug fixes here too.
See the Release note
The link Jitendra provided lists all the changes exhaustively. What
are you exactly looking for beyond that? For Performance related
changes, they are probably noted, so just search the same page for
Performance.
On Fri, Aug 9, 2013 at 7:41 PM, Viswanathan J
wrote:
> I have seen these release not
I have seen these release notes already, any other comment on this upgrade
regarding MR Job processing and any performance improvement.
On Aug 9, 2013 6:27 PM, "Jitendra Yadav" wrote:
> Please refer Hadoop 1.1.2 release notes.
>
> http://hadoop.apache.org/docs/r1.1.2/releasenotes.html
>
> On Fri,
Please refer Hadoop 1.1.2 release notes.
http://hadoop.apache.org/docs/r1.1.2/releasenotes.html
On Fri, Aug 9, 2013 at 5:41 PM, Viswanathan J wrote:
> Hi,
>
> Planning to upgrade hadoop from 1.0.3 to 1.1.2, what are the key features
> or advantages.
>
Hi,
Planning to upgrade hadoop from 1.0.3 to 1.1.2, what are the key features
or advantages.
On 11/22/2012 08:55 PM, yogesh dhari wrote:
Hi All,
I am trying to upgrade hadoop-0.20.2 to hadoop-1.0.4.
I used command
*hadoop namenode -upgrade*
after that if I start cluster by command
*Start-all.sh
the TT and DN doesn't starts.*
Which steps did you follow to perform the upgrade proces
38:/opt/hadoop-1.0.4$ stop-all.sh
> stopping jobtracker
> yogesh@localhost's password:
> localhost: no tasktracker to stop
> stopping namenode
> yogesh@localhost's password:
> localhost: no datanode to stop
> yogesh@localhost's password:
> localhost: stopping secondarynamenode
>
stop
stopping namenode
yogesh@localhost's password:
localhost: no datanode to stop
yogesh@localhost's password:
localhost: stopping secondarynamenode
Please suggest
Thanks & Regards
Yogesh Kumar
From: ha...@cloudera.com
Date: Thu, 22 Nov 2012 15:18:14 +0530
Subject: Re: HADOOP
ut any loss of data..
>
> I am attaching screen shot..
>
> Please have a look
>
>
> Thanks & Regards
> Yogesh Kumar
>
>
>
>
>
>
>
>
> --
> From: ha...@cloudera.com
> Date: Thu, 22 Nov 2012 14:14:00 +0530
> Subj
Upgrade
> for version -32 has been completed. Upgrade is not finalized.
>
> Please suggest
>
> Regards
> Yogesh Kumar
>
>
>
>
> --
> From: mahesw...@huawei.com
> To: user@hadoop.apache.org
> Subject: RE: HADOOP UPGRADE ISSUE
> Date: Thu, 22 Nov 2012 07:05:51 +000
se suggest
Regards
Yogesh Kumar
From: mahesw...@huawei.com
To: user@hadoop.apache.org
Subject: RE: HADOOP UPGRADE ISSUE
Date: Thu, 22 Nov 2012 07:05:51 +
start-all.sh will not carry any arguments to pass to nodes.
Start with start-dfs.sh
or start directly namenode with upgrade option
To: hadoop helpforoum
Subject: HADOOP UPGRADE ISSUE
Hi All,
I am trying upgrading apache hadoop-0.20.2 to hadoop-1.0.4.
I have give same dfs.name.dir, etc as same in hadoop-1.0.4' conf files as were
in hadoop-0.20.2.
Now I am starting dfs n mapred using
start-all.sh -upgrade
but namenod
23 matches
Mail list logo
