one bug?
Hello I'm getting a file from https://mfi-assets.ecb.int/dla/EA/ea_all_050303.txt: wget https://mfi-assets.ecb.int/dla/EA/ea_all_050303.txt and I get a file like this: ÿþISIN_CODE OTHER_REG_NUMBER CLASSIFICATION LIQUIDITY_CLASS TYPE REFERENCE_MARKET PRICE_SPECIFICATION. the problem is that if I open the file from Ultra-edit or other text-editor I can read the same file without ÿþ at the start of the file but if i open the file with text-editor vi from unix I read the file with ÿþ at the start of the file. Is there any way to get the file without ÿþ at the start of the file althought I would open the file with text editor vi? Thanks
Re: Making "passive ftp" default
On Thursday 03 March 2005 05:23 pm, you wrote: > With today's prevalence of NAT, I believe that passive FTP should be > made default. > > On the systems without NAT, both types should work, and on systems > that use NAT only passive FTP will work. This makes it the obvious > choice to be the default. I believe web browsers have been doing the > same for a while now. > > What do others think about a switch? Mauro? i strongly agree on this point. -- Aequam memento rebus in arduis servare mentem... Mauro Tortonesi University of Ferrara - Dept. of Eng.http://www.ing.unife.it Institute of Human & Machine Cognition http://www.ihmc.us Deep Space 6 - IPv6 for Linuxhttp://www.deepspace6.net Ferrara Linux User Group http://www.ferrara.linux.it
Re: Making "passive ftp" default
Hallo !
Sie schrieben am Freitag, den 04. Mïrz 2005:
> With today's prevalence of NAT, I believe that passive FTP should be
> made default.
>
> On the systems without NAT, both types should work, and on systems
> that use NAT only passive FTP will work. This makes it the obvious
> choice to be the default. I believe web browsers have been doing the
> same for a while now.
>
> What do others think about a switch? Mauro?
Btw: here's the patch we're using.
--
Karsten Hopp <[EMAIL PROTECTED]> GPG 1024D/70ABD02C
Fingerprint D2D4 3B6B 2DE4 464C A432 210A DFF8 A140 70AB D02C
Red Hat Deutschland, Hauptstaetter Str.58
70178 Stuttgart, Tel.+49-711-96437-0, Fax +49-711-96437-111
diff -urN wget-1.8.2/src/init.c wget-1.8.2_save/src/init.c
--- wget-1.8.2/src/init.c 2003-06-25 12:15:56.0 +0200
+++ wget-1.8.2_save/src/init.c 2003-06-25 12:15:39.0 +0200
@@ -261,6 +261,7 @@
#endif
opt.use_robots = 1;
+ opt.ftp_pasv = 1;
opt.remove_listing = 1;
opt.dot_bytes = 1024;
diff -urN wget-1.8.2/src/main.c wget-1.8.2_save/src/main.c
--- wget-1.8.2/src/main.c 2003-06-25 12:15:56.0 +0200
+++ wget-1.8.2_save/src/main.c 2003-06-25 12:12:22.0 +0200
@@ -213,7 +213,8 @@
FTP options:\n\
-nr, --dont-remove-listing don\'t remove `.listing\' files.\n\
-g, --glob=on/off turn file name globbing on or off.\n\
- --passive-ftp use the \"passive\" transfer mode.\n\
+ --passive-ftp use the \"passive\" transfer mode (default).\n\
+ --active-ftp use the \"active\" transfer mode.\n\
--retr-symlinks when recursing, get linked-to files (not
dirs).\n\
\n"), stdout);
fputs (_("\
@@ -254,6 +255,7 @@
static struct option long_options[] =
{
/* Options without arguments: */
+{ "active-ftp", no_argument, NULL, 181 },
{ "background", no_argument, NULL, 'b' },
{ "backup-converted", no_argument, NULL, 'K' },
{ "continue", no_argument, NULL, 'c' },
@@ -419,6 +421,9 @@
case 165:
setval ("randomwait", "on");
break;
+ case 181:
+ setoptval ("passiveftp", "off");
+ break;
case 'b':
setval ("background", "on");
break;
--- wget-1.9.1/doc/wget.texi.pasv 2004-01-22 20:37:33.0 +0100
+++ wget-1.9.1/doc/wget.texi2004-01-22 20:37:37.0 +0100
@@ -1234,11 +1234,19 @@
system-specific. This is why it currently works only with Unix @sc{ftp}
servers (and the ones emulating Unix @code{ls} output).
[EMAIL PROTECTED] active ftp
[EMAIL PROTECTED] --active-ftp
+Use the @dfn{active} @sc{ftp} retrieval scheme, in which the server
+initiates the data connection. Firewalls often deny incoming data
+connections, therefore @dfn{passive} @sc{ftp} is the default in this
+version of Wget.
+
@cindex passive ftp
@item --passive-ftp
Use the @dfn{passive} @sc{ftp} retrieval scheme, in which the client
initiates the data connection. This is sometimes required for @sc{ftp}
-to work behind firewalls.
+to work behind firewalls. @dfn{passive} @sc{ftp} is the default in this
+version of Wget.
@cindex symbolic links, retrieving
@item --retr-symlinks
Re: Making "passive ftp" default
Hallo ! Sie schrieben am Freitag, den 04. Mïrz 2005: > With today's prevalence of NAT, I believe that passive FTP should be > made default. > > On the systems without NAT, both types should work, and on systems > that use NAT only passive FTP will work. This makes it the obvious > choice to be the default. I believe web browsers have been doing the > same for a while now. > > What do others think about a switch? Mauro? That's the default on Red Hat Linux / Fedora Core for some releases now. Not even one objection from customers so far. +1 Karsten -- Karsten Hopp <[EMAIL PROTECTED]> GPG 1024D/70ABD02C Fingerprint D2D4 3B6B 2DE4 464C A432 210A DFF8 A140 70AB D02C Red Hat Deutschland, Hauptstaetter Str.58 70178 Stuttgart, Tel.+49-711-96437-0, Fax +49-711-96437-111
RE: one bug?
Jesus Legido wrote: > I'm getting a file from https://mfi-assets.ecb.int/dla/EA/ea_all_050303.txt: The problem is not with wget. The file on the server starts with 0xFF 0xFE. Put the following into an HTML file (say temp.html) on your hard drive, open it in your web browser, right click on the link and do a "Save As..." to your hard drive. You will get the same thing as wget downloaded. ea.txthttps://mfi-assets.ecb.int/dla/EA/ea_all_050303.txt">ea.txt>
Re: Making "passive ftp" default
Thanks for the pointer. Note that a `--active-ftp' is not necessary in the CVS version because every --option has the equivalent --no-option. This means that people who don't want passive FTP can specify `--no-passive-ftp', or `--passive-ftp=no'.
RE: Making "passive ftp" default
> From: Karsten Hopp [mailto:[EMAIL PROTECTED] > > What do others think about a switch? Mauro? > > That's the default on Red Hat Linux / Fedora Core for some > releases now. > Not even one objection from customers so far. > We had a whole TON of problems while switching some of our internal production servers to RH (with passive ftp as default) due to direct connections to customers with badly written ACLs on routers (permitting active ftp only). Never had any problem on internet ftp servers, though, so I'd say go with it, too. Heiko -- -- PREVINET S.p.A. www.previnet.it -- Heiko Herold [EMAIL PROTECTED] [EMAIL PROTECTED] -- +39-041-5907073 ph -- +39-041-5907472 fax
wget -D 12.ab.de -i $file
Hi all, my problem: I got an html file that includes both links to e.g. http://12.ab.de/xyz http://34.ab.de/ I actually want to perform a wget -D12.ab.de -Ixyz -p -F -i input.html However, this will trigger files from 34.ab.de as well. I tried --exclude-domains "34.ab.de" without success. I'm afraid that reading the URLs from an input file can't be passed through a -D filter? What's a reasonable behavior of combining -i and -D? Wget 1.8.2 Thanks, Martin
recursive download from pages with ?dir= references
Dear list members: I would like to know if it is possible to mirror or recursively download web sites that have links like ' .php?dir=./ ' within. If yes what are the options to apply? And please point me at a site, if you know any, that deals with this issue. Thank you for your help. Please send a copy to my email address ([EMAIL PROTECTED]) since I am not subscribe to the wget list. IG
