Re: bug in connect.c

2004-02-04 Thread Hrvoje Niksic
francois eric [EMAIL PROTECTED] writes: after some test: bug is when: ftp, with username and password, with bind address specifyed bug is not when: http, ftp without username and password looks like memory leaks. so i made some modification before bind: src/connect.c: -- ... /*

skip robots

2004-02-04 Thread chatiman
I onced used the skip robots directive in the wgetrc file. But I can't find it anymore in wget 1.9.1 documentation. Did it disapeared from the doc or from the program ? Please answer me, as I'm not subscribed to this list

Strange behavior

2004-02-04 Thread chatiman
I'm trying to download a directory recursively with wget -rL http://site/dir/script.php wget retrieves all the pages looking like http://site/dir/script.php?param1=value1 but not the following : http://site/dir/script.php?param1=value1page=pageno What's wrong ? Please reply me directly as I'm

Re: skip robots

2004-02-04 Thread Jens Rösner
use robots = on/off in your wgetrc or wget -e robots = on/off URL in your command line Jens PS: One note to the manual editor(s?): The -e switch could be (briefly?) mentioned also at the wgetrc commands paragraph. I think it would make sense to mention it there again without clustering the

Recursive

2004-02-04 Thread Jeffrey Rosenfeld
I am using wget to retrieve large amounts of genetic sequence from various sites. In order to make this more efficient, I am using time stamping, but for some reason the time-stamping does not seem to work for one of my queries. This query : wget --non-verbose --timestamping

Re: skip robots

2004-02-04 Thread Hrvoje Niksic
Jens Rösner [EMAIL PROTECTED] writes: PS: One note to the manual editor(s?): The -e switch could be (briefly?) mentioned also at the wgetrc commands paragraph. I think it would make sense to mention it there again without clustering the manual too much. Currently it is only mentioned in

Re: Recursive

2004-02-04 Thread Hrvoje Niksic
I don't see any obvious reason why timestamping would work in one case, but not in the other. One possible explanation might be that the second server does not provide correct time-stamping data. Debug output (with the `-d' switch) might shed some light on this.