brian 98/07/09 16:29:13
Modified: info how-to-mirror.html Log: Updated with "cvsup" and "rsync" information. Revision Changes Path 1.10 +91 -36 apache-site/info/how-to-mirror.html Index: how-to-mirror.html =================================================================== RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v retrieving revision 1.9 retrieving revision 1.10 diff -u -r1.9 -r1.10 --- how-to-mirror.html 1998/06/21 23:45:51 1.9 +++ how-to-mirror.html 1998/07/09 23:29:12 1.10 @@ -11,44 +11,102 @@ ALINK="#FF0000" > <DIV ALIGN="CENTER"> -<IMG - SRC="../images/apache_sub.gif" - ALT="[APACHE DOCUMENTATION]" -> +<IMG SRC="../images/apache_sub.gif" ALT="[APACHE DOCUMENTATION]"> </DIV> <H1 ALIGN="CENTER">How to Become a Mirror of the Apache Web Site</H1> +Apache has over 150 different mirror sites around the world. If you +are in a part of the world which seems poory served by any existing +mirror, we would encourage you to set up a local mirror of the +www.apache.org web site for you and others in your part of the world to +use. So that others may find it, we'll list it on our "mirrors" web +page, too. + <H2>Requirements</H2> -It is easy to become a mirror. There are only a couple of -requirements: +We have a few requirements for those wishing to run a mirror: <UL> - <LI>You must carry the complete site. + <LI>You must carry the complete site, with no "local" changes. <LI>You must do an update-check at least twice a week. <LI>You must subscribe to the mailing list for mirror maintainers. + <LI>Set the configuration <CODE>DocumentIndex index.html</CODE>. + <LI>Enable server-side includes, i.e. <CODE>Options Includes</CODE> or + <CODE>Options IncludesNoExec</CODE>. </UL> -Note that the site, as of this writing (June 1998) is approximately 65 megabytes. +Note that the site, as of this writing (June 1998) is approximately 65 +megabytes. <P> -More requirements may be placed at some point in the future, but for now that's all there is. There are a couple things which are highly recommended: +More requirements may be placed at some point in the future, but for +now that's all there is. There are a couple things which are highly +recommended: <UL> <LI>Run your mirroring software between midnight and 4am Pacific Standard Time (8am-noon GMT) when traffic to www.apache.org is at its lowest. - <LI>Consider setting up both a web site and FTP site, at least for the /dist - directory. + <LI>Consider also making the "dist" subdirectory available via FTP. It is not + particularly helpful to mirror the complete web site for FTP, since many + pages use server-side includes, and directories get listed rather than + serving up "index.html". </UL> +<H2>Mirroring Techniques</H2> + +There are a couple different ways to mirror the Apache web site. Here +is the list of ways we make available, in order of decreasing preference: + +<OL> + +<LI>Use the "CVSup" package. This is a package which uses the +versioning scheme in CVS to determine exactly which parts of which +files changed between accesses, and is thus by far the most efficient +mechanism for transferring files. The best place to find out more +about CVSup is at the CVSup FAQ, at <A +HREF="http://www.polstra.com/projects/freeware/CVSup/faq.html"> +http://www.polstra.com/projects/freeware/CVSup/faq.html</A>. There +are binaries for Linux, *BSD, Solaris, SunOS, Alpha/OSF-1, HPPA-10.20, +and Irix 6. + +<P>After you've set up the client binary, use the following as a "supfile": + +<BLOCKQUOTE><PRE> +*default host=dev.apache.org +*default base=(wherever you want) +*default prefix=(wherever you want) +apache-site +</BLOCKQUOTE></PRE> + +<P> + +Of course, you can also fetch the Apache 1.2 and 1.3 CVS trees +(<CODE>apache-1.2</CODE> or <CODE>apache-1.3</CODE>), just the docs +for each of those (<CODE>apache-1.2-docs</CODE> or +<CODE>apache-1.3-docs</CODE>), the binary distributions +(<CODE>apache-dist</CODE>) and even the mod_perl CVS tree +(<CODE>modperl</CODE>). + +<P> + +<LI>Use the "rsync 2.0" anonymous access option. Rsync is similar to +cvsup, but (in theory) more widely ported, and uses hashes rather than +CVS versions to watch for differences. You can find details on rsync +at <A HREF="http:///samba.anu.edu.au/rsync"> +http:///samba.anu.edu.au/rsync</A> and <A +HREF="http://sunsite.auc.dk/SunSITE/rsync"> +http://sunsite.auc.dk/SunSITE/rsync</A>. You might want to call it +using the following arguments: -<H2>Strategy</H2> +<P><UL><CODE>rsync -avz --delete --exclude incoming +dev.apache.org::apache-site</CODE></UL> -There are a couple different ways to mirror a remote web site: +<P>You can also just do a <CODE>rsync dev.apache.org::</CODE> to get a +list of rsync modules available. -<UL> +<P> <LI>Use the <A HREF="http://www.apache.org/docs/mod/mod_proxy.html">proxy module</A> @@ -64,37 +122,34 @@ to www.apache.org, unless the object is already in your local cache and is less than 24 hours old. -<LI>Use the FTP-based "mirror.pl" package, available at <A -HREF="http://sunsite.org.uk/packages/mirror/">http://sunsite.org.uk/packages/mirror/</A> -as well as at <A -HREF="ftp://ftp.debian.org/debian/stable/source/net/">ftp://ftp.debian.org/debian/stable/source/net/</A>. -If you use this, point the package at ftp://ftp.apache.org/apache/. There is also -"Wget", a package available from most GNU mirrors. -</UL> +<P> +<LI>Use the FTP-based "mirror.pl" package, available at +<A HREF="http://sunsite.org.uk/packages/mirror/"> +http://sunsite.org.uk/packages/mirror/</A> +as well as at +<A HREF="ftp://ftp.debian.org/debian/stable/source/net/"> +ftp://ftp.debian.org/debian/stable/source/net/</A>. When you set this +up, make sure your configuration has "mode_copy=true" to ensure +permissions preservation. If you use this, point the package at +ftp://ftp.apache.org/apache/. There is also "Wget", a package +available from most GNU mirrors. + +</OL> + We do not recommend the use of Web spiders, or HTTP equivalents to the "mirror.pl" package, as every object needs to get a HEAD request every time it is checked, which is a very inefficient mechanism for seeing -what's been updated on an entire site. - -<P> - -There are some other requirements for serving files obtained via FTP: - -<UL> - <LI>Make sure your mirror.pl script has "mode_copy=true" to ensure - permissions preservation. - <LI>Set the configuration <CODE>DocumentIndex index.html index.cgi</CODE>, or - <CODE>DocumentIndex index</CODE> if <CODE>Options MultiViews</CODE> is set. - <LI>Please enable server-side includes, i.e. <CODE>Options Includes</CODE> or - <CODE>Options IncludesNoExec</CODE>. -</UL> +what's been updated on an entire site. Also, the last option, +mirroring using FTP, may disappear at some point in the future, so we +strongly suggest you investigate those other mirroring options. <H2>Inform us!</H2> Once the site is set up, send mail to <A HREF="mailto:[EMAIL PROTECTED]">[EMAIL PROTECTED]</A> to let us know -it's been set up, and we'll add it to the list of mirrors. +it's been set up, and we'll add it to the list of mirrors. Please be +patient if it takes a little while to respond. <P>