Re: finalize upgrade

2007-12-16 Thread Torsten Curdt
On 14.12.2007, at 23:35, Konstantin Shvachko wrote: Well, from the output it looks like that has been run. At least I cannot see any sign telling me I still need to run it ...still was the previous directory on the name node. The way it works in pre 0.16 is that you start the cluster, and

Re: finalize upgrade

2007-12-14 Thread Konstantin Shvachko
Well, from the output it looks like that has been run. At least I cannot see any sign telling me I still need to run it ...still was the previous directory on the name node. The way it works in pre 0.16 is that you start the cluster, and issue: hadoop dfsadmin -finalizeUpgrade I've just ru

Re: finalize upgrade

2007-12-14 Thread Torsten Curdt
On 14.12.2007, at 19:41, Konstantin Shvachko wrote: Sorry, it looks like the UI and report feature will appear only in 0.16. It is related to HADOOP-1604. In general you are not supposed to remove any directories manually. That's why I am so careful :) You should just use finalizeUpgrade.

Re: finalize upgrade

2007-12-14 Thread Konstantin Shvachko
Sorry, it looks like the UI and report feature will appear only in 0.16. It is related to HADOOP-1604. In general you are not supposed to remove any directories manually. You should just use finalizeUpgrade. The way it works in pre 0.16 is that you start the cluster, and issue: hadoop dfsadmin -fi

Re: finalize upgrade

2007-12-14 Thread Torsten Curdt
Can anyone confirm? On 13.12.2007, at 09:46, Torsten Curdt wrote: No sign of 'upgrade still needs to be finalized' or something ...so I assume removing the 'previous' dir is safe then? On 12.12.2007, at 21:18, Konstantin Shvachko wrote: 2) Is there a way of finding out whether finalize stil

Re: finalize upgrade

2007-12-13 Thread Torsten Curdt
No sign of 'upgrade still needs to be finalized' or something ...so I assume removing the 'previous' dir is safe then? On 12.12.2007, at 21:18, Konstantin Shvachko wrote: 2) Is there a way of finding out whether finalize still needs to be run? Yes, you can see it on the name-node web UI, a

Re: finalize upgrade

2007-12-12 Thread Eric Guillemot
unsubscribe - Original Message - From: "Konstantin Shvachko" <[EMAIL PROTECTED]> To: Sent: Wednesday, December 12, 2007 12:18 PM Subject: Re: finalize upgrade 2) Is there a way of finding out whether finalize still needs to be run? Yes, you can see it on the name-

Re: finalize upgrade

2007-12-12 Thread Konstantin Shvachko
2) Is there a way of finding out whether finalize still needs to be run? Yes, you can see it on the name-node web UI, and by running hadoop dfsadmin -report

Re: finalize upgrade

2007-12-12 Thread Colin Evans
I just found this problem today after upgrading to 0.15. I just deleted the "previous" directory on all of our machines with no bad consequences so far. Torsten Curdt wrote: Hey guys, triggered by a post on the mailing list I also checked our 0.14 cluster and although we really though we

Re: finalize upgrade

2007-12-12 Thread Doug Cutting
Joydeep Sen Sarma wrote: it consumes real space though. we were disk full on the drive hosting control/tmp data and got space back once the finalizeUpgrade finished .. Is that perhaps because it still holds data that's since been deleted? Doug

RE: finalize upgrade

2007-12-12 Thread Joydeep Sen Sarma
: finalize upgrade Torsten Curdt wrote: > 1) I thought that the data is actually not duplicated ...so why is it so > big? I think it is a directory of hard links. Doug

Re: finalize upgrade

2007-12-12 Thread Doug Cutting
Torsten Curdt wrote: 1) I thought that the data is actually not duplicated ...so why is it so big? I think it is a directory of hard links. Doug

finalize upgrade

2007-12-12 Thread Torsten Curdt
Hey guys, triggered by a post on the mailing list I also checked our 0.14 cluster and although we really though we did the finalize after the upgrade we also have a big "previous" dir there. A couple of things I am wondering here... 1) I thought that the data is actually not duplicated ..