Re: Mirrors not updating
> On Tue, 23 Feb 2010 19:26:52 +, David Cantrell > said: > I don't mind lag, as my testers only fire up once a day, and even then > they only fire up when I'm around - I don't let them run entirely > unattended. RECENT typically covered about a week of uploads. > RECENT.recent currently has three uploads in it, or about an hour's worth. RECENT.recent is only the first step into the protocol that I made up for File::Rsync::Mirror::Recent that allows pull replication with high frequency. If you do not want speed, don't use it. But you can still use the timestamp as an indicator whether upstream is uptodate. -- andreas
Re: Mirrors not updating
David Golden wrote: > On Tue, Feb 23, 2010 at 9:34 AM, Chris 'BinGOs' Williams > wrote: >> On Tue, Feb 23, 2010 at 10:57:06AM +, David Cantrell wrote: >>> /RECENT is what I've been feeding my testers from for ages. >> /RECENT is a symlink as far as I can see from my CPAN mirror >> lrwxrwxrwx 1 537 537 20 Feb 23 03:36 RECENT -> indices/RECENT-print > authors/RECENT.recent is really the key file for having the most > up-to-date distributions > modules/RECENT.recent covers the 02packages.details.txt file, but that > updates via cronjob, not on demand as distributions are indexed, so it > can lag anyway. I don't mind lag, as my testers only fire up once a day, and even then they only fire up when I'm around - I don't let them run entirely unattended. RECENT typically covered about a week of uploads. RECENT.recent currently has three uploads in it, or about an hour's worth. -- David Cantrell | Bourgeois reactionary pig Compromise: n: lowering my standards so you can meet them
Re: Mirrors not updating
On Tue, Feb 23, 2010 at 9:34 AM, Chris 'BinGOs' Williams wrote: > On Tue, Feb 23, 2010 at 10:57:06AM +, David Cantrell wrote: >> On Mon, Feb 22, 2010 at 08:55:44PM -0500, David Golden wrote: >> > On Mon, Feb 22, 2010 at 7:03 PM, David Cantrell >> > wrote: >> > > Is PAUSE having problems, or the fast updatey thing, or something else, >> > > or am I just being Teh Dum? >> > You're checking the wrong file. >> > $ HEAD http://cpan.hexten.net/authors/RECENT.recent | grep ^Last-Modified >> > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT >> > $ HEAD http://cpan.cpantesters.org/authors/RECENT.recent | grep >> > ^Last-Modified >> > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT >> >> /RECENT is what I've been feeding my testers from for ages. > > /RECENT is a symlink as far as I can see from my CPAN mirror > > lrwxrwxrwx 1 537 537 20 Feb 23 03:36 RECENT -> indices/RECENT-print And indices just contains du-k.gz, find-ls,gz and ls-lR.gz -- none of which necessarily get updated often. authors/RECENT.recent is really the key file for having the most up-to-date distributions modules/RECENT.recent covers the 02packages.details.txt file, but that updates via cronjob, not on demand as distributions are indexed, so it can lag anyway. -- David
Re: Mirrors not updating
On Tue, Feb 23, 2010 at 10:57:06AM +, David Cantrell wrote: > On Mon, Feb 22, 2010 at 08:55:44PM -0500, David Golden wrote: > > On Mon, Feb 22, 2010 at 7:03 PM, David Cantrell > > wrote: > > > Is PAUSE having problems, or the fast updatey thing, or something else, > > > or am I just being Teh Dum? > > You're checking the wrong file. > > $ HEAD http://cpan.hexten.net/authors/RECENT.recent | grep ^Last-Modified > > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT > > $ HEAD http://cpan.cpantesters.org/authors/RECENT.recent | grep > > ^Last-Modified > > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT > > /RECENT is what I've been feeding my testers from for ages. /RECENT is a symlink as far as I can see from my CPAN mirror lrwxrwxrwx 1 537 537 20 Feb 23 03:36 RECENT -> indices/RECENT-print Cheers, -- Chris Williams aka BinGOs PGP ID 0x4658671F http://www.gumbynet.org.uk == pgpARiRtS8xkj.pgp Description: PGP signature
Re: Mirrors not updating
On Mon, Feb 22, 2010 at 08:55:44PM -0500, David Golden wrote: > On Mon, Feb 22, 2010 at 7:03 PM, David Cantrell wrote: > > Is PAUSE having problems, or the fast updatey thing, or something else, > > or am I just being Teh Dum? > You're checking the wrong file. > $ HEAD http://cpan.hexten.net/authors/RECENT.recent | grep ^Last-Modified > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT > $ HEAD http://cpan.cpantesters.org/authors/RECENT.recent | grep ^Last-Modified > Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT /RECENT is what I've been feeding my testers from for ages. -- David Cantrell | London Perl Mongers Deputy Chief Heretic What is the difference between hearing aliens through the fillings in your teeth and hearing Jesus in your heart?
Re: Mirrors not updating
On 23 Feb 2010, at 00:03, David Cantrell wrote: > $ date > Tue Feb 23 00:02:25 GMT 2010 > $ HEAD http://cpan.cpantesters.org/RECENT|grep ^Last-Modified > Last-Modified: Sun, 21 Feb 2010 03:35:27 GMT > $ HEAD http://cpan.hexten.net/RECENT|grep ^Last-Modified > Last-Modified: Sun, 21 Feb 2010 03:35:27 GMT > > Is PAUSE having problems, or the fast updatey thing, or something else, > or am I just being Teh Dum? Hmm. This line from my Nagios status: FILE_AGE OK: /usr/share/cpan/modules/02packages.details.txt is 2963 seconds old and 6163988 bytes Leads me to suspect that the fast mirroring engine is doing its thing correctly. So dunno :) -- Andy Armstrong, Hexten
Re: Mirrors not updating
On Mon, Feb 22, 2010 at 7:03 PM, David Cantrell wrote: > Is PAUSE having problems, or the fast updatey thing, or something else, > or am I just being Teh Dum? You're checking the wrong file. $ HEAD http://cpan.hexten.net/authors/RECENT.recent | grep ^Last-Modified Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT $ HEAD http://cpan.cpantesters.org/authors/RECENT.recent | grep ^Last-Modified Last-Modified: Tue, 23 Feb 2010 01:54:02 GMT -- David