cvs commit: apache-site/info how-to-mirror.html
brian 99/03/09 19:27:23 Modified:info how-to-mirror.html Log: Rsync is now preferred to cvsup, based on my experience it's easier to set up and much more portable. Also, start the path towards closing FTP by discouraging its use for mirroring. Revision ChangesPath 1.15 +15 -34apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.14 retrieving revision 1.15 diff -u -r1.14 -r1.15 --- how-to-mirror.html1998/12/30 18:47:59 1.14 +++ how-to-mirror.html1999/03/10 03:27:22 1.15 @@ -48,10 +48,7 @@ Run your mirroring software between midnight and 4am Pacific Standard Time (8am-noon GMT) when traffic to www.apache.org is at its lowest. - Consider also making the "dist" subdirectory available via FTP. It is not - particularly helpful to mirror the complete web site for FTP, since many - pages use server-side includes, and directories get listed rather than - serving up "index.html". + Consider also making the "dist" subdirectory. Mirroring Techniques @@ -61,6 +58,20 @@ +Use Rsync. Rsync is similar to cvsup, but (in theory) more widely +ported, and uses hashes rather than CVS versions to watch for +differences. You can find details on rsync at http://rsync.samba.org/";> http://rsync.samba.org/. You +might want to call it using the following arguments, for example: + +rsync -rtvz --delete --exclude incoming +dev.apache.org::apache-site /local/path/to/mirror + +You can also just do a rsync dev.apache.org:: to get a +list of rsync modules available. + + + Use the "CVSup" package. This is a package which uses the versioning scheme in CVS to determine exactly which parts of which files changed between accesses, and is thus by far the most efficient @@ -92,23 +103,6 @@ -Use the "rsync 2.0" anonymous access option. Rsync is similar to -cvsup, but (in theory) more widely ported, and uses hashes rather than -CVS versions to watch for differences. You can find details on rsync -at http://samba.anu.edu.au/rsync";> -http://samba.anu.edu.au/rsync and http://sunsite.auc.dk/SunSITE/rsync";> -http://sunsite.auc.dk/SunSITE/rsync. You might want to call it -using the following arguments: - -rsync -rtvz --delete --exclude incoming -dev.apache.org::apache-site /local/path/to/mirror - -You can also just do a rsync dev.apache.org:: to get a -list of rsync modules available. - - - Use the http://www.apache.org/docs/mod/mod_proxy.html";>proxy module in Apache to "pass-through" requests to the central Apache web site. @@ -122,19 +116,6 @@ Every request which then comes into this server will be passed along to www.apache.org, unless the object is already in your local cache and is less than 24 hours old. - - - -Use the FTP-based "mirror.pl" package, available at -http://sunsite.org.uk/packages/mirror/";> -http://sunsite.org.uk/packages/mirror/ -as well as at -ftp://ftp.debian.org/debian/stable/source/net/";> -ftp://ftp.debian.org/debian/stable/source/net/. When you set this -up, make sure your configuration has "mode_copy=true" to ensure -permissions preservation. If you use this, point the package at -ftp://ftp.apache.org/apache/. There is also "Wget", a package -available from most GNU mirrors.
cvs commit: apache-site/info how-to-mirror.html
brian 98/12/30 10:48:01 Modified:info how-to-mirror.html Log: Added a formalized contact for mirror submissions. Revision ChangesPath 1.14 +1 -1 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.13 retrieving revision 1.14 diff -u -r1.13 -r1.14 --- how-to-mirror.html1998/07/10 01:19:14 1.13 +++ how-to-mirror.html1998/12/30 18:47:59 1.14 @@ -148,7 +148,7 @@ Inform us! Once the site is set up, send mail to mailto:[EMAIL PROTECTED]">[EMAIL PROTECTED] to let us know +HREF="mailto:[EMAIL PROTECTED]">[EMAIL PROTECTED] to let us know it's been set up, and we'll add it to the list of mirrors. Please be patient if it takes a little while to respond.
cvs commit: apache-site/info how-to-mirror.html
brian 98/07/09 18:19:18 Modified:info how-to-mirror.html Log: 1) forgot a line in the default config file 2) define a new cvsup "module", which includes everything on the web site; the module "apache-site" didn't have the documentation tree or the dist/ directory. Revision ChangesPath 1.13 +2 -1 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.12 retrieving revision 1.13 diff -u -r1.12 -r1.13 --- how-to-mirror.html1998/07/10 00:11:31 1.12 +++ how-to-mirror.html1998/07/10 01:19:14 1.13 @@ -77,7 +77,8 @@ *default host=dev.apache.org *default base=(wherever you want) *default prefix=(wherever you want) -apache-site +*default release=cvs +apache-fullsite
cvs commit: apache-site/info how-to-mirror.html
dgaudet 98/07/09 17:11:32 Modified:info how-to-mirror.html Log: -a is unsafe, use -rt... and include the path Revision ChangesPath 1.12 +2 -2 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.11 retrieving revision 1.12 diff -u -r1.11 -r1.12 --- how-to-mirror.html1998/07/09 23:36:09 1.11 +++ how-to-mirror.html1998/07/10 00:11:31 1.12 @@ -100,8 +100,8 @@ http://sunsite.auc.dk/SunSITE/rsync. You might want to call it using the following arguments: -rsync -avz --delete --exclude incoming -dev.apache.org::apache-site +rsync -rtvz --delete --exclude incoming +dev.apache.org::apache-site /local/path/to/mirror You can also just do a rsync dev.apache.org:: to get a list of rsync modules available.
cvs commit: apache-site/info how-to-mirror.html
dgaudet 98/07/09 16:36:10 Modified:info how-to-mirror.html Log: typos Revision ChangesPath 1.11 +2 -2 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.10 retrieving revision 1.11 diff -u -r1.10 -r1.11 --- how-to-mirror.html1998/07/09 23:29:12 1.10 +++ how-to-mirror.html1998/07/09 23:36:09 1.11 @@ -94,8 +94,8 @@ Use the "rsync 2.0" anonymous access option. Rsync is similar to cvsup, but (in theory) more widely ported, and uses hashes rather than CVS versions to watch for differences. You can find details on rsync -at http:///samba.anu.edu.au/rsync";> -http:///samba.anu.edu.au/rsync and http://samba.anu.edu.au/rsync";> +http://samba.anu.edu.au/rsync and http://sunsite.auc.dk/SunSITE/rsync";> http://sunsite.auc.dk/SunSITE/rsync. You might want to call it using the following arguments:
cvs commit: apache-site/info how-to-mirror.html
brian 98/07/09 16:29:13 Modified:info how-to-mirror.html Log: Updated with "cvsup" and "rsync" information. Revision ChangesPath 1.10 +91 -36apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.9 retrieving revision 1.10 diff -u -r1.9 -r1.10 --- how-to-mirror.html1998/06/21 23:45:51 1.9 +++ how-to-mirror.html1998/07/09 23:29:12 1.10 @@ -11,44 +11,102 @@ ALINK="#FF" > - + How to Become a Mirror of the Apache Web Site +Apache has over 150 different mirror sites around the world. If you +are in a part of the world which seems poory served by any existing +mirror, we would encourage you to set up a local mirror of the +www.apache.org web site for you and others in your part of the world to +use. So that others may find it, we'll list it on our "mirrors" web +page, too. + Requirements -It is easy to become a mirror. There are only a couple of -requirements: +We have a few requirements for those wishing to run a mirror: - You must carry the complete site. + You must carry the complete site, with no "local" changes. You must do an update-check at least twice a week. You must subscribe to the mailing list for mirror maintainers. + Set the configuration DocumentIndex index.html. + Enable server-side includes, i.e. Options Includes or + Options IncludesNoExec. -Note that the site, as of this writing (June 1998) is approximately 65 megabytes. +Note that the site, as of this writing (June 1998) is approximately 65 +megabytes. -More requirements may be placed at some point in the future, but for now that's all there is. There are a couple things which are highly recommended: +More requirements may be placed at some point in the future, but for +now that's all there is. There are a couple things which are highly +recommended: Run your mirroring software between midnight and 4am Pacific Standard Time (8am-noon GMT) when traffic to www.apache.org is at its lowest. - Consider setting up both a web site and FTP site, at least for the /dist - directory. + Consider also making the "dist" subdirectory available via FTP. It is not + particularly helpful to mirror the complete web site for FTP, since many + pages use server-side includes, and directories get listed rather than + serving up "index.html". +Mirroring Techniques + +There are a couple different ways to mirror the Apache web site. Here +is the list of ways we make available, in order of decreasing preference: + + + +Use the "CVSup" package. This is a package which uses the +versioning scheme in CVS to determine exactly which parts of which +files changed between accesses, and is thus by far the most efficient +mechanism for transferring files. The best place to find out more +about CVSup is at the CVSup FAQ, at http://www.polstra.com/projects/freeware/CVSup/faq.html";> +http://www.polstra.com/projects/freeware/CVSup/faq.html. There +are binaries for Linux, *BSD, Solaris, SunOS, Alpha/OSF-1, HPPA-10.20, +and Irix 6. + +After you've set up the client binary, use the following as a "supfile": + + +*default host=dev.apache.org +*default base=(wherever you want) +*default prefix=(wherever you want) +apache-site + + + + +Of course, you can also fetch the Apache 1.2 and 1.3 CVS trees +(apache-1.2 or apache-1.3), just the docs +for each of those (apache-1.2-docs or +apache-1.3-docs), the binary distributions +(apache-dist) and even the mod_perl CVS tree +(modperl). + + + +Use the "rsync 2.0" anonymous access option. Rsync is similar to +cvsup, but (in theory) more widely ported, and uses hashes rather than +CVS versions to watch for differences. You can find details on rsync +at http:///samba.anu.edu.au/rsync";> +http:///samba.anu.edu.au/rsync and http://sunsite.auc.dk/SunSITE/rsync";> +http://sunsite.auc.dk/SunSITE/rsync. You might want to call it +using the following arguments: -Strategy +rsync -avz --delete --exclude incoming +dev.apache.org::apache-site -There are a couple different ways to mirror a remote web site: +You can also just do a rsync dev.apache.org:: to get a +list of rsync modules available. - + Use the http://www.apache.org/docs/mod/mod_proxy.html";>proxy module @@ -64,37 +122,34 @@ to www.apache.org, unless the object is already in your local cache and is less than 24 hours old. -Use the FTP-based "mirror.pl" package, available at http://sunsite.org.uk/packages/mirror/";>http://sunsite.org.uk/packages/mirror/ -as well as at ftp://ftp.debian.org/debian/stable/s
cvs commit: apache-site/info how-to-mirror.html
brian 98/06/21 16:45:51 Modified:info how-to-mirror.html Log: note suggested by a few mirror maintainers. Revision ChangesPath 1.9 +4 -0 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.8 retrieving revision 1.9 diff -u -r1.8 -r1.9 --- how-to-mirror.html1998/06/15 21:30:54 1.8 +++ how-to-mirror.html1998/06/21 23:45:51 1.9 @@ -30,6 +30,10 @@ You must subscribe to the mailing list for mirror maintainers. +Note that the site, as of this writing (June 1998) is approximately 65 megabytes. + + + More requirements may be placed at some point in the future, but for now that's all there is. There are a couple things which are highly recommended:
cvs commit: apache-site/info how-to-mirror.html
brian 98/06/15 14:30:55 Modified:info how-to-mirror.html Log: New URL. Revision ChangesPath 1.8 +1 -1 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.7 retrieving revision 1.8 diff -u -r1.7 -r1.8 --- how-to-mirror.html1998/05/20 15:20:51 1.7 +++ how-to-mirror.html1998/06/15 21:30:54 1.8 @@ -61,7 +61,7 @@ and is less than 24 hours old. Use the FTP-based "mirror.pl" package, available at ftp://src.doc.ic.ac.uk/computing/archiving/mirror";>ftp://src.doc.ic.ac.uk/computing/archiving/mirror, +HREF="http://sunsite.org.uk/packages/mirror/";>http://sunsite.org.uk/packages/mirror/ as well as at ftp://ftp.debian.org/debian/stable/source/net/";>ftp://ftp.debian.org/debian/stable/source/net/. If you use this, point the package at ftp://ftp.apache.org/apache/. There is also
cvs commit: apache-site/info how-to-mirror.html
brian 98/03/30 01:54:29 Modified:info how-to-mirror.html Log: Add mention of "Wget". Revision ChangesPath 1.6 +2 -1 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.5 retrieving revision 1.6 diff -u -r1.5 -r1.6 --- how-to-mirror.html1997/08/13 21:48:43 1.5 +++ how-to-mirror.html1998/03/30 09:54:28 1.6 @@ -64,7 +64,8 @@ HREF="ftp://src.doc.ic.ac.uk/computing/archiving/mirror";>ftp://src.doc.ic.ac.uk/computing/archiving/mirror, as well as at ftp://ftp.debian.org/debian/stable/source/net/";>ftp://ftp.debian.org/debian/stable/source/net/. -If you use this, point the package at ftp://ftp.apache.org/apache/. +If you use this, point the package at ftp://ftp.apache.org/apache/. There is also +"Wget", a package available from most GNU mirrors. We do not recommend the use of Web spiders, or HTTP equivalents to the
cvs commit: apache-site/info how-to-mirror.html
brian 97/08/13 14:48:44 Modified:info how-to-mirror.html Log: No longer require CGI to be running on various mirrors, but it really is necessary to use server-side includes for headers and footers. Revision ChangesPath 1.5 +2 -4 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.4 retrieving revision 1.5 diff -u -r1.4 -r1.5 --- how-to-mirror.html1997/08/03 16:12:00 1.4 +++ how-to-mirror.html1997/08/13 21:48:43 1.5 @@ -77,14 +77,12 @@ There are some other requirements for serving files obtained via FTP: - There are a few CGI scripts; make sure you have Options ExecCGI enabled. - We are very scrupulous about the CGI scripts distributed, and will ensure - there are no security holes in them. - Make sure /usr/local/bin/perl exists - it can be perl 4 or 5. Make sure your mirror.pl script has "mode_copy=true" to ensure permissions preservation. Set the configuration DocumentIndex index.html index.cgi, or DocumentIndex index if Options MultiViews is set. + Please enable server-side includes, i.e. Options Includes or + Options IncludesNoExec. Inform us!
cvs commit: apache-site/info how-to-mirror.html
brian 97/06/13 02:06:04 Modified:info how-to-mirror.html Log: New conditions for serving up mirrors. Revision ChangesPath 1.3 +15 -0 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.2 retrieving revision 1.3 diff -C3 -r1.2 -r1.3 *** how-to-mirror.html1997/04/03 13:34:15 1.2 --- how-to-mirror.html1997/06/13 09:06:02 1.3 *** *** 59,64 --- 59,79 time it is checked, which is a very inefficient mechanism for seeing what's been updated on an entire site. + + + There are some other requirements for serving files obtained via FTP: + + + There are a few CGI scripts; make sure you have Options ExecCGI enabled. + We are very scrupulous about the CGI scripts distributed, and will ensure + there are no security holes in them. + Make sure /usr/local/bin/perl exists - it can be perl 4 or 5. + Make sure your mirror.pl script has "mode_copy=true" to ensure + permissions preservation. + Set the configuration DocumentIndex index.html index.cgi, or + DocumentIndex index if Options MultiViews is set. + + Inform us! Once the site is set up, send mail to
cvs commit: apache-site/info how-to-mirror.html
[EMAIL PROTECTED]97/04/03 05:34:16 Modified:info how-to-mirror.html Log: Mentioned the mirrors mailing list. Revision ChangesPath 1.2 +7 -0 apache-site/info/how-to-mirror.html Index: how-to-mirror.html === RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.1 retrieving revision 1.2 diff -C3 -r1.1 -r1.2 *** how-to-mirror.html1997/03/25 04:43:17 1.1 --- how-to-mirror.html1997/04/03 13:34:15 1.2 *** *** 14,19 --- 14,20 You must carry the complete site. You must do an update-check at least twice a week. + You must subscribe to the mailing list for mirror maintainers. More requirements may be placed at some point in the future, but for now that's all there is. There are a couple things which are highly recommended: *** *** 63,68 --- 64,75 Once the site is set up, send mail to mailto:[EMAIL PROTECTED]">[EMAIL PROTECTED] to let us know it's been set up, and we'll add it to the list of mirrors. + + + + The mailing list for mirror maintainers can be joined by sending mail + to "[EMAIL PROTECTED]" with the words "subscribe mirrors" in the + body of the message.
