Hm, I think this will affect search.cpan.org as it uses the CPAN mirror on that
machine when it goes to format docs. I will check.
Graham.
On Sat, Apr 08, 2000 at 06:17:07PM +0200, Andreas J. Koenig wrote:
> >>>>> On Wed, 5 Apr 2000 16:34:27 -0400, "Kurt D. Starsinic" <[EMAIL PROTECTED]> said:
>
> > On Wed, Apr 05, 2000 at 02:40:32PM +0200, Andreas Koenig wrote:
> >> I believe, the CPAN/authors/id/ directory needs a gentle cleanup.
> >> Currently there is no simple algorithm to generate the directory of an
> >> author from the userid. The only way to find out that JHI has the
> >> directory JHI/ is by trying which of JHI/ and J/JH/JHI/ exists.
> >>
> >> It would be a simple job to make the transition with backwards
> >> compatibility like so (tested):
> >>
> >> use File::Path qw(mkpath);
> >> opendir DIR, "."; # from authors/id
> >> for (readdir DIR){
> >> next if /^\./ or length($_)==1;
> >> my $targ = substr($_,0,1) . "/" . substr($_,0,2);
> >> mkpath $targ;
> >> rename $_, "$targ/$_";
> >> symlink "$targ/$_", $_;
> >> }
> >>
> >> But that will cause a huge avalanche of mirror traffic (both for
> >> mirror and rsync). So I suppose we'd have a sleep 3600 after each loop
> >> so that the job takes 12 days until all 290 directories are relocated.
> >>
> >> The question is: do you see any other problems I am not seeing? Is
> >> sleep 3600 OK? Is the whole idea sound? If nobody has objections, I'll
> >> start tomorrow by relocating my own directory, wait a week and if no
> >> problems are reported run the job with the sleep 3600. Otherwise,,,
> >>
> >> Opinions?
>
> > The idea is very good, Andreas. It would probably be a good idea _not_
> > to run it when the update daemons are running, or you might get very
> > confusing glitches in the moment between the rename and the symlink.
>
> Excellent point. I have now tried to avoid that kind of race by first
> duplicating the directory with rsync, then let all the indexes adjust
> to the new directory and only after an hour remove the old directory.
> This is roughly the following in pseudocode:
>
> for (readdir DIR){
> next if /^\./ or length($_)==1 or -l $_;
> my $targ = substr($_,0,1) . "/" . substr($_,0,2);
> mkpath $targ;
> system rsync, "-va", $_, "$targ/";
> # Now actively care for all indexes to be updated;
> sleep 3600;
> rmtree $_;
> symlink "$targ/$_", $_;
> }
>
> I have started with my own CPAN directory now and am watching for
> glitches to show up (or better to not show up:)
>
> Elaine, I will have to adjust the CPAN backup stuff when we are
> through the process as we do not want to end up with duplicates. I
> will probably even have to adjust a bit earlier to safe diskspace.
>
> --
> andreas
>
