Re: Wget patches for .files

2005-08-21 Thread Hrvoje Niksic
Carl Ponder [EMAIL PROTECTED] writes:

 How about this, then document wget as follows:

   By default, for wildcard and recursive operations, wget
   *ignores* invisible files (like .profile, .rhosts, etc.) 
   that begin with '.'.

But that's the catch, it really doesn't ignore anything, it's just
that the server isn't listing them.  If I knew of a portable way to
change that, I would change it.  Ignoring dot files has never
intentional.

 Then add a flag

   --invisibleok  Causes wildcard and recursive operations to
  process (otherwise invisible) files that
  begin with .. This flag may not work with
  all FTP servers.

 When the flag is set, use -a in the FTP operations.

It would be more correct to say that this flag may not work with
non-Unix FTP servers, because that's where the real problem lies.

 Then the burden is on the user to figure out whether it works or
 not, which is okay for my purposes.

If nothing else works out, we can add something like that.  I for one
would prefer Wget to be smarter and try to download dot files by
default, without the user's intervention.


Re: Wget patches for .files

2005-08-21 Thread Hrvoje Niksic
[EMAIL PROTECTED] (Steven M. Schweda) writes:

 [...] I for one would prefer Wget to be smarter and try to download
 dot files by default, without the user's intervention.

Given the variability in FTP servers (even among UNIX FTP servers) I
 don't see how this could be done reliably.

I hoped that EPLF (http://cr.yp.to/ftp/list/eplf.html) was
better-supported among today's FTP servers or that an equivalent
proposal exists and is widely implemented.  (Being smarter referred
to trying EPLF first and falling back to LIST if that failed.)
Unfortunately I cannot find any confirmation for this.

It is hard to believe that the best today's FTP servers have to offer
to the client is the necessity of sending -l and the necessity of
parsing the Unix directory listing.

 I think that an option like --ftp-list-opts=xxx (where LIST xxx
 is used in ftp_list() instead of plain LIST) would be less likely
 to cause trouble for the casual user.

So do I, which is why I provided (a variant of) it for those who need
it right now.