Re: -N option gives proxy error
Sorry that was a typing error, the orginal URL was with a (double) // ie. wget -R *ia64*, *mips* ftp://ftp.iitm.ac.in/debian/main/ and wget -N -R *ia64*, *mips* ftp://ftp.iitm.ac.in/debian/main/ I am attatching the debugged log for the second command that gives the proxy error. I have tried it from the command line with the '-N' and the '--timestamping' option and from the wgetrc file using 'timestamping=on' but the proxy server gives error whenever timestamping is turned on. anselm almeida NIO, Goa On Sat, 02 Feb 2002, you wrote: On 2002-02-09 14:35 +0530, Anselm Almeida wrote: If I use wget -R *ia64*, *mips* ftp:/ftp.iitm.ac.in/debian/main/ I am able to download the files But If I use wget -N -R *ia64*, *mips* ftp:/ftp.iitm.ac.in/debian/main/ I get the following, connecting to darya.nio.org:9000 ... connected Proxy request sent, awaitung response ... 500 Error from proxy 2 Mime-version:1.0 3 Proxy-agent: Netscape-Proxy/3.5 4 Content type:text/html Does it change anything if you replace ftp:/ by ftp:// in the URLs ? -- André Majorel [EMAIL PROTECTED] http://www.teaser.fr/~amajorel/ -- arabhi:anselm~/tmp3$ wget -N --debug -R *ia64*,*mips* ftp://ftp.iitm.ac.in/debian/pool/ DEBUG output created by Wget 1.5.3 on linux-gnu. parseurl (ftp://ftp.iitm.ac.in/debian/pool/;) - host ftp.iitm.ac.in - opath debian/pool/ - dir debian/pool - file - ndir debian/pool parseurl (http://darya.nio.org:9000/;) - host darya.nio.org - port 9000 - opath - dir - file - ndir --15:01:04-- ftp://ftp.iitm.ac.in:21/debian/pool/ = `debian/pool/index.html' Connecting to darya.nio.org:9000... Created fd 3. connected! ---request begin--- HEAD ftp://ftp.iitm.ac.in:21/debian/pool/ HTTP/1.0 User-Agent: Wget/1.5.3 Host: ftp.iitm.ac.in:21 Accept: */* Proxy-Authorization: Basic YW5zZWxtOkJhYmwwMGcxcmw= From: [EMAIL PROTECTED] Accept-Language: en ---request end--- Proxy request sent, awaiting response... HTTP/1.0 500 Error from proxy Mime-version: 1.0 Proxy-agent: Netscape-Proxy/3.5 Content-type: text/html Closing fd 3 15:01:04 ERROR 500: Error from proxy. FINISHED --15:01:04-- Downloaded: 0 bytes in 0 files
using wget
Hi, I'm new to wget. I use the following command to get files from the site wget ftp://ftp.iitm.ac.in/debian and have set my .wgetrc file with the following tries=20 reclevel=5 passive_ftp = on http_proxy = http://anselm:[EMAIL PROTECTED]:9000/ ftp_proxy= http://anselm:[EMAIL PROTECTED]:9000/ # above password changed ! use_proxy = on dot_style = default noclobber = on glob=on continue = on robots = on no_parent = on wait = 60 dirstruct = on add_hostdir = off recursive = on follow_ftp = on simple_host_check=on add_hostdir=off 1.I have a have a very slow link to the Internet through a proxy. When the connection breaks, wget will go on to get the next file instead of trying for the same file (before the connection broke). eg. Connecting to darya.nio.org:9000... Connection to darya.nio.org:9000 refused. --12:36:14-- ftp://ftp.iitm.ac.in:21/debian/pool/main/libr = `debian/pool/main/libr' Connecting to darya.nio.org:9000... Connection to darya.nio.org:9000 refused. --12:37:14-- ftp://ftp.iitm.ac.in:21/debian/pool/main/libs = `debian/pool/main/libs' Connecting to darya.nio.org:9000... Connection to darya.nio.org:9000 refused. --12:38:14-- ftp://ftp.iitm.ac.in:21/debian/pool/main/libt = `debian/pool/main/libt' Connecting to darya.nio.org:9000... Connection to darya.nio.org:9000 refused. --12:39:14-- ftp://ftp.iitm.ac.in:21/debian/pool/main/libu = `debian/pool/main/libu' 2. Also, if the connection is bad 0 bytes are downloaded and wget goes on to download the next file and in the directory structure I get a lot of files with 0 bytes downloaded, whereas I would have expected wget to keep on trying to get the file till it is completely downloaded! please see enclosed file text3. 3.The third thing is that if I restart wget again to continue the download, after the connection is broken, it justs skips the files which have been partially downloaded and downloads only the new files which have not been downloaded. I suspect, I am not using wget's options properly and I will be grateful for any leads. Thanks in advance. I'm using wget 1.5.3. Anselm an/dists/woody/main/source/net/dhcpcd_1.3.17pl2.orig.tar.gz' Connecting to darya.nio.org:9000... connected! Proxy request sent, awaiting response... 200 document follows Length: unspecified [application/octet-stream] 0K - 10:07:10 (0.00 B/s) - `debian/dists/woody/main/source/net/dhcpcd_1.3.17pl2.orig.tar.gz' saved [0] --10:08:10-- ftp://ftp.iitm.ac.in:21/debian/dists/woody/main/source/net/epic4-script-splitfire_1.6.orig.tar.gz = `debian/dists/woody/main/source/net/epic4-script-splitfire_1.6.orig.tar.gz' Connecting to darya.nio.org:9000... connected! Proxy request sent, awaiting response... 200 document follows Length: unspecified [application/octet-stream] 0K - 10:14:00 (0.00 B/s) - `debian/dists/woody/main/source/net/epic4-script-splitfire_1.6.orig.tar.gz' saved [0] --10:15:00-- ftp://ftp.iitm.ac.in:21/debian/dists/woody/main/source/net/epic_3.004.orig.tar.gz = `debian/dists/woody/main/source/net/epic_3.004.orig.tar.gz' Connecting to darya.nio.org:9000... connected! Proxy request sent, awaiting response... 500 Internal Error 10:15:20 ERROR 500: Internal Error. --10:16:20-- ftp://ftp.iitm.ac.in:21/debian/dists/woody/main/source/net/fakebo_0.4.1.orig.tar.gz = `debian/dists/woody/main/source/net/fakebo_0.4.1.orig.tar.gz' Connecting to darya.nio.org:9000... connected! Proxy request sent, awaiting response... 200 document follows Length: unspecified [application/octet-stream] 0K - 10:21:44 (0.00 B/s) - `debian/dists/woody/main/source/net/fakebo_0.4.1.orig.tar.gz' saved [0] --10:22:44-- ftp://ftp.iitm.ac.in:21/debian/dists/woody/main/source/net/fmirror_0.8.4beta.orig.tar.gz = `debian/dists/woody/main/source/net/fmirror_0.8.4beta.orig.tar.gz' Connecting to darya.nio.org:9000... connected! Proxy request sent, awaiting response... 200 document follows Length: unspecified [application/octet-stream] 0K - .. .. ..
