--follow-ftp overriding no host spanning
Since the option is --span-hosts the default would seem to be not to span. However, when I enabled --follow-ftp I noticed my crawl was going to foreign (not from the domain I specified) ftp sites. Even explicitly adding the --no-span-hosts option did not change this behavior. I'm using version 1.10.1. Thanks, Tim -- Tim Larson a Contract Staffing Specialists consultant with West Corporation, Interactive TeleServices
Re: Checking for broken links
Why don't you use an html link checker like 'lintlink' (www.linklint.org)? Jonathan - Original Message - From: "David Walker" <[EMAIL PROTECTED]> To: Cc: <[EMAIL PROTECTED]> Sent: Sunday, October 16, 2005 1:13 PM Subject: Checking for broken links Hi I am trying to use wget to check for broken links on a web site as follows: wget --spider --recursive -np -owesc.log http://www.wesc.ac.uk/ but I get back a message "www.wesc.ac.uk/index.html: No such file or directory". Can anyone tell me how to fix this, or else suggest another way of using wget to check for broken links. Thanks David
Re: brief report on NTLM buffer overflow
Daniel Stenberg wrote: On Fri, 14 Oct 2005, Noèl Köthe wrote: The last paragraph says something like: "Notable is the fast time of reaction of the Open Source developer: two days ago the problem was reported, yesterday corrected packages were produced and details of the vulnerability were published." Just want to give you very possitive feedback and say thanks.:) I mailed Hrvoje the patch roughly 50 minutes after the notification (and he forwarded it to Mauro). Wget 1.10.2 was relased less than 14 hours after the first mail brought our attention to this problem. Both Hrvoje and Mauro acted swiftly and promptly. Nice going guys! i was notified of the vulnerability by hrvoje and daniel. when i received the security report daniel had aready sent us the bugfix. it took me no more than 30 minutes to include the patch in our stable branch and release wget 1.10.2. thanks again, daniel. -- Aequam memento rebus in arduis servare mentem... Mauro Tortonesi http://www.tortonesi.com University of Ferrara - Dept. of Eng.http://www.ing.unife.it GNU Wget - HTTP/FTP file retrieval tool http://www.gnu.org/software/wget Deep Space 6 - IPv6 for Linuxhttp://www.deepspace6.net Ferrara Linux User Group http://www.ferrara.linux.it
downloading files partly with wget
Hi, I use wget do download a lot of mp3s from one site. However, only small percent of them are interesting. So I'd like to make wget download only first 300 kb of each file. Is it possible? Nota bene: I am not subscribe to this list. If you answer this post, please add my address in CC. -- piotr sobolewski [EMAIL PROTECTED] http://www.rozrywka.jawsieci.pl/wstep_wolny/ echo Gra w pomidora ver. 1.0; while (read); do echo pomidor; done
RE: brief report on NTLM buffer overflow
> From: Daniel Stenberg [mailto:[EMAIL PROTECTED] > Sent: Friday, October 14, 2005 8:20 PM > > I mailed Hrvoje the patch roughly 50 minutes after the > notification (and he > forwarded it to Mauro). Wget 1.10.2 was relased less than 14 > hours after the > first mail brought our attention to this problem. > > Both Hrvoje and Mauro acted swiftly and promptly. Nice going guys! > > (The plan was originally to coordinate the security fix > release with vendors > and between the curl and wget projects, but due to mistakes did the > notification accidentally become public immediately and we > had to work really > fast to reduce the impact.) Not so swiftly on my side, I just dropped in again after a longer offline interval. Sorry guys Heiko -- -- PREVINET S.p.A. www.previnet.it -- Heiko Herold [EMAIL PROTECTED] [EMAIL PROTECTED] -- +39-041-5907073 ph -- +39-041-5907472 fax
RE: wget 1.10.2 released
Windows MSVC binary at http://xoomer.virgilio.it/hherold/ Heiko Herold -- -- PREVINET S.p.A. www.previnet.it -- Heiko Herold [EMAIL PROTECTED] [EMAIL PROTECTED] -- +39-041-5907073 ph -- +39-041-5907472 fax > -Original Message- > From: Mauro Tortonesi [mailto:[EMAIL PROTECTED] > Sent: Thursday, October 13, 2005 11:59 AM > To: wget@sunsite.dk > Subject: wget 1.10.2 released > > > hi to everybody, > > i have just uploaded the wget 1.10.2 tarball on ftp.gnu.org: > > ftp://ftp.gnu.org/gnu/wget/wget-1.10.2.tar.gz > > you can find the GPG signature of the tarball at these URLs: > > ftp://ftp.gnu.org/gnu/wget/wget-1.10.2.tar.gz.sig > > and the GPG key i have used for the signature at this URL: > > http://www.tortonesi.com/GNU-GPG-Key.txt > > the key fingerprint is: > > pub 1024D/7B2FD4B0 2005-06-02 Mauro Tortonesi (GNU Wget Maintainer) > Key fingerprint = 1E90 AEA8 D511 58F0 94E5 B106 7220 24E9 7B2F D4B0 > > the MD5 checksum of the tarball is: > > 795fefbb7099f93e2d346b026785c4b8 wget-1.10.2.tar.gz > > > the 1.10.2 release features minor improvements in SSL support > and fixes > a remotely exploitable buffer overflow. all wget users are strongly > encouraged to upgrade. > > > -- > Aequam memento rebus in arduis servare mentem... > > Mauro Tortonesi http://www.tortonesi.com > > University of Ferrara - Dept. of Eng.http://www.ing.unife.it > GNU Wget - HTTP/FTP file retrieval tool > http://www.gnu.org/software/wget > Deep Space 6 - IPv6 for Linuxhttp://www.deepspace6.net > Ferrara Linux User Group http://www.ferrara.linux.it >
