It's time for Spring cleaning again. If you have ancient versions of
modules sitting around in your PAUSE directory, consider letting them
retire to BackPAN (http://backpan.cpan.org). They don't disappear from
the world, but they don't inflate CPAN either. You don't have to do
anything, but many mi
I think that Andreas's concept of treating these mirrors as a database is good.
Checkpoint logical log replay is better than a simple rsync for large numbers
of files.
The replication problem for databases is well-understood and open-source code
for it is available from at least Postgresql.
On Sun, Mar 28, 2010 at 12:57:36AM +, Ben Morrow wrote:
> I would say that any time you think 'I need to ask the user a question
> during installation' it is probably a mistake. Set up your main Bugzilla
> distribution so that it runs tests against any available databases (this
> in itself isn
On Sun, 28 Mar 2010, Dana Hudes wrote:
Why is rsync a problem? Where is the bottleneck in the protocol or the code
implementing it?
Specifics!
SAR is antiquated doesn't give the info you really need. Using a linux system?
Use procallator and feed resulting collected data to ORCA. Better yet, u
While major mirror can use HTTP1.1 if no proxy, Squid poxies don't do 1.1 on
other than experimental basis.
As to whether wget does use it or not I will have to check
Don't assume either way
--Original Message--
From: Aristotle Pagaltzis
To: module-authors@perl.org
Sent: Mar 28, 2010 1
Hi Elaine,
Elaine Ashton wrote:
On Mar 28, 2010, at 12:48 PM, Randy Kobes wrote:
Jarkko and I were talking about it this morning - as he's not in
favour of pruning - while trying to think of a way around the size
problem and he reminded me of the idea that, if I recall correctly
was Adreas' sugg
Orcallator, procallator and friends aren't shiny new toys
Adrian Cockroft wrote initial version of orcallator in the early 90s for his
book "Solaris Performance Tuning. The 2nd edition is I think 1998.
The current version of ORCA (processes the collected data) is from I believe
2007 or so
www.
Using http for this is inefficient
It makes for slower file transfer because you keep rerunning path mtu probes
and tcp slow start It makes extra socket handles opening and closing
Between major mirrors you don't have proxies (maybe NAT and firewall with
stateful multilayer inspection but th
On Sun, 28 Mar 2010, Dana Hudes wrote:
I agree with Elaine
I can't get rsync through the firewall at work. Not even tunneled.
For CPAN I use CPAN::Mini. It uses http and it does the job though it does
force the local CPAN to blead. My local solution to other things we need such
as Blastwave (w
On Sun, 28 Mar 2010, Dana Hudes wrote:
Use of wget and http to download an entire site means numerous TCP opens and
HTTP GET requests. The entire point of rsync is that it knows there are
numerous downloads. It does ONE open. This allows TCP slow start to ramp up
That wasn't exactly what I w
On Sun, 28 Mar 2010, Andreas J. Koenig wrote:
Says the author of a module named Paranoid. A lovely coincidence.
:-) As they say, just because you may be paranoid, it doesn't mean that no
one's out to get you.
If you want to study the CPAN "checkpointed logs" solution running on
the very CPAN
On Sun, 28 Mar 2010, Andy Armstrong wrote:
We're nearly there if A == a CPAN::Mini style mirror, B == the current mirror
pruned and C == backpan.
So the actions to make that happen are:
* give the current clients specific support for this
* generate a master mini mirror that other mini mirror
On Sun, 28 Mar 2010, Elaine Ashton wrote:
I do very much like Tim's proposal for giving old modules a push to BackPAN
since, with proper communication of the changes to the authors along with a way
to mark exceptions, this would rid CPAN of a lot of cruft that should be on
BackPan anyway.
I
On Sun, 28 Mar 2010, Nicholas Clark wrote:
Are you running a large public mirror site, where you don't even have
knowledge of who is mirroring from you?
(Not even knowledge, let alone channels of communication with, let alone
control over)
Because (as I see it, not having done any of this) the
On Sun, 28 Mar 2010, dhu...@hudes.org wrote:
The entire point of rsync is to send only changes.
Therefore once your mirror initially syncs the old versions of modules is
not the issue. Indeed, removing the old versions would present additional
burden on synchronization! The ongoing burden is the
15 matches
Mail list logo
