RE: Flash
There is a way, I've added it to my own copy of wget. But I'm still in the progress of cleaning up my source code. Currently it could cause crashes with invalid flash/shockwave files. I've tried my implementation on a couple of sites and the tests were very successful. If there's much interest maybe I can submit my wip code? -Original Message- From: Terence Tirella [mailto:[EMAIL PROTECTED] Sent: Monday, July 21, 2003 3:23 PM To: wget Mailing List (E-mail) Subject: Flash Is there a way to use wget to search for flash or shockwave files? I've been trying to do this and can't seem to figure it out. Thanks, Terence
RE: WELCOME to wget@sunsite.dk
Hi and tx, The site at http://132.163.4.101:14 is not technically an NTP site. It is generated via an NTP device. For instance, if I click View/Source, I get the following: 52842 03-07-22 08:59:41 50 0 0 905.4 UTC(NIST) * If there are no html headers, even though I can reach it by http can I use wget? yes I appreciate the difference between free software, not freeware however I was originally going to post this to 24hoursupport.helpdesk where they would not have heard of wget I fear, so pls forgive my syntax. Some background: On a separate note. I am a midrange programmer (AS/400) and our machine is firewalled, not on the web etc etc. So I use wget (and blat) via *REXEC on a PC to visit the www and scrape stuff and send emails (blat). I can only issue batch commands ie no GUI interaction so wget is perfect. In fact, it is beyond perfect. I have seen a lot of 400 and PC software and wget (and blat) impress my socks off. Congrat's to all involved. Craig -Original Message- From: Nicolas Schodet [mailto:[EMAIL PROTECTED] Sent: Tuesday, 22 July 2003 5:36 AM To: [EMAIL PROTECTED] Subject: Re: WELCOME to [EMAIL PROTECTED] * Mr. Wilson [EMAIL PROTECTED] [030718 14:56]: I am running the wget (freeware batch web scraping) program on the NTP time server at free software, not freeware and can not scrape this site. I have tried with the proxy setting both on and off but I get the following error code. ( wget -Oh.txt -Yoff http://132.163.4.101:14 ) gives Connecting to 132.163.4.101:14... connected! HTTP request sent, fetching headers... done. 22:23:21 ERROR -1: Malformed status line. I have 2 questions: 1: even if the ntp site above has no html headers etc, why doesn't this work? 2: how can I make it work. GNU Wget is a [1]free software package for retrieving files using [2]HTTP, HTTPS and FTP. [1] GNU Wget is free software, not freeware, see the page below to learn the difference : http://www.gnu.org/philosophy/free-sw.html [2] GNU Wget only retrieves files using HTTP, HTTPS and FTP. Your date server is likely to use NTP, so wget can not connect to it to retrieve the date. You can use ntpd or ntpdate to connect to this server. Ni. -- Pouvez-vous faire confiance à votre ordinateur ? http://www.gnu.org/philosophy/can-you-trust.fr.html
'non printable' character handling
Hi, I am using Debian Sarge, wget is 1.8.2. I try to download a single deb file with wget as of: wget http://www.lsc.hu/debian/pool/main/gcc-3.2-base_1%3a3.2.3-0pre9_i386.deb The output is: -- cut -- --09:01:12-- http://www.lsc.hu/debian/pool/main/gcc-3.2-base_1%3a3.2.3-0pre9_i386.deb = `gcc-3.2-base_1%3A3.2.3-0pre9_i386.deb' Resolving www.lsc.hu... done. Connecting to www.lsc.hu[195.56.172.131]:80... connected. HTTP request sent, awaiting response... 404 Not Found 09:01:12 ERROR 404: Not Found. -- cut -- As you can see, %3a, which is a ':' changed into %3A and that's why the web server can not find it. It should be left untouched as %3a; as well as possibly the other %xy characters as well. Thanks, GCS
RE: WELCOME to wget@sunsite.dk
Did you know you can get ntp software (server/client) for windows ? See http://www.ntp.org , get the source and compile it or grab a binary from the links page http://www.ntp.org/links.html . Then install the server on a windows or unix pc with access to the internet, configured in order to syncronize the clock with a free public ntp server on the internet - a good list is here: http://www.eecis.udel.edu/~mills/ntp/clock2a.html . Then sync the as400 clock to that pc (periodically with ntpdate or if possible in the proper way, with another ntp server installed on the as400 and configured in order to sync to the pc (if ntp is availble on the as400, that is). Heiko -- -- PREVINET S.p.A. www.previnet.it -- Heiko Herold [EMAIL PROTECTED] -- +39-041-5907073 ph -- +39-041-5907472 fax -Original Message- From: Mr. Wilson [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 22, 2003 11:54 AM To: [EMAIL PROTECTED] Subject: RE: WELCOME to [EMAIL PROTECTED] You can use ntpd or ntpdate to connect to this server. At first glance (I will do a bigger read later) this will not help me. The reason it will not help and why I use wget is this: I am in charge of various aspects of a mid-range computer called an AS/400 (IBM) due to company policy this machine is allowed NO direct connection to the outside world, no VPN, no www, no HTML server etc. I have been asked by the auditors to automate a 'check' on the system time so that it is accurate. I am allowed access to a PC that has www access via *REXEC (note: PC control and access is monitored by a separate division). I am allowed to run commands to the www (once they are approved by PC Admin) as long as they have NO effect on the PC involved. OK, still with me :) this means that a program like wget is perfect. It allows me to issue commands via *REXEC to scrape sites and bring back that info to the 400 in a text file. I then write a string extractor and compare the time etc. Thus my question. I apologise for being verbose but perhaps an example of how wget is used by me in the bureaucratic world of computer management would be of interest to you all. -Original Message- From: Nicolas Schodet [mailto:[EMAIL PROTECTED] Sent: Tuesday, 22 July 2003 5:36 AM To: [EMAIL PROTECTED] Subject: Re: WELCOME to [EMAIL PROTECTED] * Mr. Wilson [EMAIL PROTECTED] [030718 14:56]: I am running the wget (freeware batch web scraping) program on the NTP time server at http://132.163.4.101:14 and can not scrape this site. I have tried with the proxy setting both on and off but I get the following error code. ( wget -Oh.txt -Yoff http://132.163.4.101:14 ) gives Connecting to 132.163.4.101:14... connected! HTTP request sent, fetching headers... done. 22:23:21 ERROR -1: Malformed status line. I have 2 questions: 1: even if the ntp site above has no html headers etc, why doesn't this work? 2: how can I make it work. GNU Wget is a [1]free software package for retrieving files using [2]HTTP, HTTPS and FTP. [1] GNU Wget is free software, not freeware, see the page below to learn the difference : http://www.gnu.org/philosophy/free-sw.html [2] GNU Wget only retrieves files using HTTP, HTTPS and FTP. Your date server is likely to use NTP, so wget can not connect to it to retrieve the date. You can use ntpd or ntpdate to connect to this server. Ni. -- Pouvez-vous faire confiance a votre ordinateur ? http://www.gnu.org/philosophy/can-you-trust.fr.html
RE: WELCOME to wget@sunsite.dk
Hey Harold, tx, some more cool sites for me to go check. HOWEVER :( I am not allowed to modify the time (or anything) on the PC or install new software. All I am allowed is rexec (sorry *REXEC was 400 jargon) access as long as it has no impact on the PC. A GUI (ie windows software) means installation on the PC, may mean human interaction etc. Therefore no go. The company (big) I work for has separated out responsibility to various 'groups' (for security). 400 people have no access to PC's (via computer that is!) except where the PC is used as a conduit with no effect on the PC. Therefore no PC=no Unix=no NTP software=no etc. Yes, you are correct in that the 400 is NTP aware. However, I am not allowed access to the www from the 400 directly. (Also, the PC guru people have 0 access to the 400 even tho. some of them know more than me.) The more I type this, the more I realise how 'silly' it sounds and the more I fear I am getting off topic. HOWVER :) now you understand why I think wget is so very very cool. All my problems re: getting www access are solved with this so cool program...except one. -Original Message- From: Herold Heiko [mailto:[EMAIL PROTECTED] Sent: Tuesday, 22 July 2003 8:31 PM To: 'Mr. Wilson'; [EMAIL PROTECTED] Subject: RE: WELCOME to [EMAIL PROTECTED] Did you know you can get ntp software (server/client) for windows ? See http://www.ntp.org , get the source and compile it or grab a binary from the links page http://www.ntp.org/links.html . Then install the server on a windows or unix pc with access to the internet, configured in order to syncronize the clock with a free public ntp server on the internet - a good list is here: http://www.eecis.udel.edu/~mills/ntp/clock2a.html . Then sync the as400 clock to that pc (periodically with ntpdate or if possible in the proper way, with another ntp server installed on the as400 and configured in order to sync to the pc (if ntp is availble on the as400, that is). Heiko -- -- PREVINET S.p.A. www.previnet.it -- Heiko Herold [EMAIL PROTECTED] -- +39-041-5907073 ph -- +39-041-5907472 fax -Original Message- From: Mr. Wilson [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 22, 2003 11:54 AM To: [EMAIL PROTECTED] Subject: RE: WELCOME to [EMAIL PROTECTED] You can use ntpd or ntpdate to connect to this server. At first glance (I will do a bigger read later) this will not help me. The reason it will not help and why I use wget is this: I am in charge of various aspects of a mid-range computer called an AS/400 (IBM) due to company policy this machine is allowed NO direct connection to the outside world, no VPN, no www, no HTML server etc. I have been asked by the auditors to automate a 'check' on the system time so that it is accurate. I am allowed access to a PC that has www access via *REXEC (note: PC control and access is monitored by a separate division). I am allowed to run commands to the www (once they are approved by PC Admin) as long as they have NO effect on the PC involved. OK, still with me :) this means that a program like wget is perfect. It allows me to issue commands via *REXEC to scrape sites and bring back that info to the 400 in a text file. I then write a string extractor and compare the time etc. Thus my question. I apologise for being verbose but perhaps an example of how wget is used by me in the bureaucratic world of computer management would be of interest to you all. -Original Message- From: Nicolas Schodet [mailto:[EMAIL PROTECTED] Sent: Tuesday, 22 July 2003 5:36 AM To: [EMAIL PROTECTED] Subject: Re: WELCOME to [EMAIL PROTECTED] * Mr. Wilson [EMAIL PROTECTED] [030718 14:56]: I am running the wget (freeware batch web scraping) program on the NTP time server at http://132.163.4.101:14 and can not scrape this site. I have tried with the proxy setting both on and off but I get the following error code. ( wget -Oh.txt -Yoff http://132.163.4.101:14 ) gives Connecting to 132.163.4.101:14... connected! HTTP request sent, fetching headers... done. 22:23:21 ERROR -1: Malformed status line. I have 2 questions: 1: even if the ntp site above has no html headers etc, why doesn't this work? 2: how can I make it work. GNU Wget is a [1]free software package for retrieving files using [2]HTTP, HTTPS and FTP. [1] GNU Wget is free software, not freeware, see the page below to learn the difference : http://www.gnu.org/philosophy/free-sw.html [2] GNU Wget only retrieves files using HTTP, HTTPS and FTP. Your date server is likely to use NTP, so wget can not connect to it to retrieve the date. You can use ntpd or ntpdate to connect to this server. Ni. -- Pouvez-vous faire confiance a votre ordinateur ? http://www.gnu.org/philosophy/can-you-trust.fr.html
Re: WELCOME to wget@sunsite.dk
* Post, Mark K [EMAIL PROTECTED] [030722 16:57]: This works: telnet 132.163.4.101 14 | tail -n 1 outfile But so does wget http://tycho.usno.navy.mil/cgi-bin/timer.pl if we want to bring this back to being on topic. :) [...] The cgi script on tycho.usno.navy.mil is served by a http server. Telnet does not work with it (unless you type the appropriate lines). If the telnet method works for 132.163.4.101:14, it is not HTTP. Ni. -- Microsoft est-il le Grand Satan ? http://www.gnu.org/philosophy/microsoft.fr.html
Regarding wget...
Hello, i'm extremely sorry to bother you. But there's a problem with my wget 1.8.2. When it's trying to connect to a site that is down, it will pause for EXACTLY 3 minutes and 10 seconds every single time, for dead links. I tried changing the -T setting, but same thing everytime, which then made me wonder whether it is a timeout setting or something else i don't know about. Is there any hope for me in solving this problem? thank you very much!
RE: WELCOME to wget@sunsite.dk
didn't think of telnet :( but on topic: wget http://tycho.usno.navy.mil/cgi-bin/timer.pl works perfectly. Tx, muchly appreciated -Original Message- From: Post, Mark K [mailto:[EMAIL PROTECTED] Sent: Wednesday, 23 July 2003 12:58 AM To: 'Nicolas Schodet'; Mr. Wilson Cc: [EMAIL PROTECTED] Subject: RE: WELCOME to [EMAIL PROTECTED] This works: telnet 132.163.4.101 14 | tail -n 1 outfile But so does wget http://tycho.usno.navy.mil/cgi-bin/timer.pl if we want to bring this back to being on topic. :) Mark Post -Original Message- From: Nicolas Schodet [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 22, 2003 8:12 AM To: Mr. Wilson Cc: [EMAIL PROTECTED] Subject: Re: WELCOME to [EMAIL PROTECTED] * Mr. Wilson [EMAIL PROTECTED] [030722 11:14]: The site at http://132.163.4.101:14 is not technically an NTP site. It is generated via an NTP device. For instance, if I click View/Source, I get the following: 52842 03-07-22 08:59:41 50 0 0 905.4 UTC(NIST) * If there are no html headers, even though I can reach it by http can I use wget? [...] If the Status Line is malformed, I think it is not http. Try using telnet or netcat to connect to it, It may be sufficient to retrieve the informations you want. $ telnet 132.163.4.101 14 Ni. -- Pourquoi les logiciels ne doivent pas avoir de propriétaire : http://www.gnu.org/philosophy/why-free.fr.html
