Re: more mirror questions
In message <[EMAIL PROTECTED]> you write: |It would be nice if mirror had a remote_tiimezone key that could be |set. That would allow the mirror sites to all have the same real time |on the files (as opposed to the difference between ftp.ion.com.au and |ftp.tower.net.au above). I've forwarded your message to the [EMAIL PROTECTED] mailing list. Hope it's OK with you. (the mirror-people mailing list is a developers forum, *not* a users forum). Cheers, --Amos --Amos Shapira | "Of course Australia was marked for 133 Shlomo Ben-Yosef st.| glory, for its people had been chosen Jerusalem 93 805| by the finest judges in England." ISRAEL [EMAIL PROTECTED] | -- Anonymous
Re: more mirror questions
On Mon, 6 May 1996 [EMAIL PROTECTED] wrote: > Bernd> Hi, perhpas somebody can help me. How do I tell mirror the Tiezone > Bernd> of the Remote Host? If I want to mirror master, ftp and a german > Bernd> site mirror alway compares different times. Any good solutions? > > That has been bugging me as well when I switched from ftp.debian.org to some > other mirror during the hick-ups at ftp.debian.org. It would be really nice > if we could store files dates in UTC (GMT) rather than in localtime. If we > can't persuade mirror(1) (haven't checked man page or code), maybe someone > could hack a script that "touch"es files with the info from the debian/ls-laR > file. Opinions? Just run mirror with the -T timestamp option when you change the site you're mirroring. The -T option doesn't transfer files, it only touches the dates of existing local files to make then match the remote site. I think that's what you're looking for. It's certainly what *I* was looking for when i switched mirrors :-) Craig
Re: more mirror questions
I just did some quick checking on the timestamp of the same file at 1/2 dozen sites... the target being "debian-manual.txt"; Mar 6 15:46 -> ftp.tower.net.au (GMT +8 hrs) Mar 6 23:46 -> ftp.debian.org Mar 6 23:46 -> ftp.ion.com.au(GMT +10 hrs) Mar 6 22:46 -> ftp.lh.umu.se Mar 7 06:46 -> ftp.caldera.com Mar 6 18:46 -> tsx-11.mit.edu So if one does not do a "mirror -T site" first then you stand the distinct possibility of re-fetching or losing all your current files if you do not check first. I can't really afford the overhead of of "mirror -n site" then a "mirror -T site" then the actual mirror run itself.. and that would cause 3 lots of global "ls -ltR" execs on the remote site, quite expensive. Anyone have some ideas or suggestions about streamlining this process ? --markc
Re: more mirror questions
> I just did some quick checking on the timestamp of the same file at 1/2 > dozen sites... the target being "debian-manual.txt"; > > Mar 6 15:46 -> ftp.tower.net.au (GMT +8 hrs) > Mar 6 23:46 -> ftp.debian.org > Mar 6 23:46 -> ftp.ion.com.au(GMT +10 hrs) > Mar 6 22:46 -> ftp.lh.umu.se > Mar 7 06:46 -> ftp.caldera.com > Mar 6 18:46 -> tsx-11.mit.edu > > So if one does not do a "mirror -T site" first then you stand the distinct > possibility of re-fetching or losing all your current files if you do not > check first. I can't really afford the overhead of of "mirror -n site" then > a "mirror -T site" then the actual mirror run itself.. and that would cause > 3 lots of global "ls -ltR" execs on the remote site, quite expensive. Anyone > have some ideas or suggestions about streamlining this process ? It would be nice if mirror had a remote_tiimezone key that could be set. That would allow the mirror sites to all have the same real time on the files (as opposed to the difference between ftp.ion.com.au and ftp.tower.net.au above). -- Buddha Buck [EMAIL PROTECTED] "She was infatuated with their male prostitutes, whose members were like those of donkeys and whose seed came in floods like that of stallions." -- Ezekiel 23:20
Re: more mirror questions
Rick Macdonald wrote: > > On Mon, 6 May 1996 [EMAIL PROTECTED] wrote: > > > Bernd> Hi, perhpas somebody can help me. How do I tell mirror the Tiezone > > Bernd> of the Remote Host? If I want to mirror master, ftp and a german > > Bernd> site mirror alway compares different times. Any good solutions? > > > > That has been bugging me as well when I switched from ftp.debian.org to some > > other mirror during the hick-ups at ftp.debian.org. It would be really nice > > if we could store files dates in UTC (GMT) rather than in localtime. > > Over the last few days my mirror started retransferring everything again. > I didn't bother to figure out why; I finally went and added the > get_newer=false parameter to my setup. > > New files and files whose _sizes_ change still get transferred. > > I just hope that people stick to the "rule" never to update a file > without incrementing the version number in the file name. I'd like to retract my own suggestion. It occured to me that there are many non-.deb files such as Packages, Contents and the floppy_disk files. These don't have names with version numbers. These files can be updated without changing the file sizes. This is especially true with the floppy_disk files since they are always split on a size of 1474560. Setting the time stamps of these files with -T will lose. So, for me this is still an issue. Any more ideas? -- ...RickM...
Re: more mirror questions
On Mon, 6 May 1996 [EMAIL PROTECTED] wrote: > Bernd> Hi, perhpas somebody can help me. How do I tell mirror the Tiezone > Bernd> of the Remote Host? If I want to mirror master, ftp and a german > Bernd> site mirror alway compares different times. Any good solutions? > > That has been bugging me as well when I switched from ftp.debian.org to some > other mirror during the hick-ups at ftp.debian.org. It would be really nice > if we could store files dates in UTC (GMT) rather than in localtime. If we > can't persuade mirror(1) (haven't checked man page or code), maybe someone > could hack a script that "touch"es files with the info from the debian/ls-laR > file. Opinions? Over the last few days my mirror started retransferring everything again. I didn't bother to figure out why; I finally went and added the get_newer=false parameter to my setup. New files and files whose _sizes_ change still get transferred. I just hope that people stick to the "rule" never to update a file without incrementing the version number in the file name. ...RickM...
Re: more mirror questions
[EMAIL PROTECTED] wrote: > That has been bugging me as well when I switched from ftp.debian.org to some > other mirror during the hick-ups at ftp.debian.org. It would be really nice > if we could store files dates in UTC (GMT) rather than in localtime. If we > can't persuade mirror(1) (haven't checked man page or code), maybe someone > could hack a script that "touch"es files with the info from the debian/ls-laR > file. Opinions? I've been plagued by this too, and have lost all 455 megs a week ago because of careless and frustrated swapping of source archives without checking first. Lesson learnt, I now do a mirror -T first to sync the timestamps. # man mirror use_timelocal Time-stamp files to local time zone. If false, the time zone is set to offset 0 (compatible with older versions of mirror). [true] I've tried the above but haven't done enough consistant checking to peg down just how it works. I'd also be interested in any suggestions. I exclude debian-bugs and -lists and I notice that when mirror does the compares with a mirror -d -d that it takes quite a long time to go thru all the files in debian-lists... just to figure out to ignore them. Would the below option skip over any exclude_patt dirs altogether ? recurse_hard Have to generate remote ls by doing cwd and ls for each subdirectory. In this case remote_dir must be absolute (begin with a /) not relative. Use the pwd command in ftp to find the path for the start of the remote archive area. (Not available if remote_fs is vms.) [false] -- Mark Constable (+61 7 55275724) mailto:[EMAIL PROTECTED] http://vv.com.au/mc
Re: more mirror questions
Bernd> Hi, perhpas somebody can help me. How do I tell mirror the Tiezone Bernd> of the Remote Host? If I want to mirror master, ftp and a german Bernd> site mirror alway compares different times. Any good solutions? That has been bugging me as well when I switched from ftp.debian.org to some other mirror during the hick-ups at ftp.debian.org. It would be really nice if we could store files dates in UTC (GMT) rather than in localtime. If we can't persuade mirror(1) (haven't checked man page or code), maybe someone could hack a script that "touch"es files with the info from the debian/ls-laR file. Opinions? -- Dirk Eddelb"uttel http://qed.econ.queensu.ca/~edd
more mirror questions
Hi, perhpas somebody can help me. How do I tell mirror the Tiezone of the Remote Host? If I want to mirror master, ftp and a german site mirror alway compares different times. Any good solutions? Greetings Bernd -- (OO) -- [EMAIL PROTECTED] -- ( .. ) [EMAIL PROTECTED],ka.sub.org} http://home.pages.de/~eckes/ o--o *plush* 2048/93600EFD [EMAIL PROTECTED] +4972573817 *plush* (OO) If privacy is outlawed only Outlaws have privacy
