Re: too many users

2005-04-20 Thread Hrvoje Niksic 
Leonid [EMAIL PROTECTED] writes:

 Yes, wget 1.9.1 consideres failure to connect as a fatal error and
 abandoned to re-try attempts. I have submitted several times a patch
 for fixing this and similar problems. Presumably, it will be
 inlcuded in the future wget 1.11 . If yoy need the fix now, you can
 find it the patch against wget-1.10-alpha1 in
 http://software.lpetrov.net/wget-1.10-persistent.patch or
 alternatively an entire tarball in
 http://software.lpetrov.net/wget-pet/

I reviewed the persistent patch and I think it's a very good idea --
Wget has needed something like that for a long time.

The patch as it stands IMHO does require one change: I don't think
things like opt.ntry and printwhat should be checked in as
low-level a function as connect_to_host.  connect_to_host was meant as
a fairly straightforward wrapper around functions like
gethostbyname/socket/connect that correctly multiple A/ records,
IPv6, etc.  It probably shouldn't contain UI code such as retries.

The code in http.c and ftp.c has all the loops that retry connecting.
The patch should trivially modify them to check for persistence before
giving up.

too many users

2005-04-13 Thread Leonid 
Andrei,
Yes, wget 1.9.1 consideres failure to connect as a fatal error and 
abandoned to re-try attempts. I have submitted several times a patch for
fixing this and similar problems. Presumably, it will be inlcuded in
the future wget 1.11 . If yoy need the fix now, you can find it
the patch against wget-1.10-alpha1 in 
http://software.lpetrov.net/wget-1.10-persistent.patch
or alternatively an entire tarball in http://software.lpetrov.net/wget-pet/

Good luck

too many users

2005-04-11 Thread Florin Andrei 
(not subscribed to the list, please Cc me)

wget-1.9.1

I am trying to do this:

$ wget -v -t 0 -nd -c --passive-ftp
ftp://ftp.smoovenet.com/pub/lardlad/sounds/season11/grift16.mp3
--12:34:45--
ftp://ftp.smoovenet.com/pub/lardlad/sounds/season11/grift16.mp3
   = `grift16.mp3'
Resolving ftp.smoovenet.com... 66.90.80.51
Connecting to ftp.smoovenet.com[66.90.80.51]:21... connected.
Logging in as anonymous ...
Login incorrect.

But, as you can see in frame #10 in the attached file, the reply is not
login incorrect but too many users.

For some reason, wget thinks there's a hard error and gives up.
I'd like wget to just keep trying to download, according to the -t 0
option, instead of giving up. If the retries are separated by 30 seconds
or so, it won't overload the server.

-- 
Florin Andrei

http://florin.myip.org/
No. TimeSourceDestination   Protocol Info
  1 0.00XXX.YYY.ZZZ.KKK 66.90.80.51   TCP  
33340  ftp [SYN] Seq=0 Ack=0 Win=5840 Len=0 MSS=1460 TSV=242708530 TSER=0 WS=2

Frame 1 (74 bytes on wire, 74 bytes captured)
Arrival Time: Apr 11, 2005 12:34:45.852994000
Time delta from previous packet: 0.0 seconds
Time since reference or first frame: 0.0 seconds
Frame Number: 1
Packet Length: 74 bytes
Capture Length: 74 bytes
Protocols in frame: eth:ip:tcp
Ethernet II, Src: 00:00:e2:2b:b1:2d, Dst: 00:00:0c:07:ac:01
Destination: 00:00:0c:07:ac:01 (All-HSRP-routers_01)
Source: 00:00:e2:2b:b1:2d (AcerTech_2b:b1:2d)
Type: IP (0x0800)
Internet Protocol, Src Addr: XXX.YYY.ZZZ.KKK (XXX.YYY.ZZZ.KKK), Dst Addr: 
66.90.80.51 (66.90.80.51)
Version: 4
Header length: 20 bytes
Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00)
 00.. = Differentiated Services Codepoint: Default (0x00)
 ..0. = ECN-Capable Transport (ECT): 0
 ...0 = ECN-CE: 0
Total Length: 60
Identification: 0xd3b6 (54198)
Flags: 0x04 (Don't Fragment)
0... = Reserved bit: Not set
.1.. = Don't fragment: Set
..0. = More fragments: Not set
Fragment offset: 0
Time to live: 64
Protocol: TCP (0x06)
Header checksum: 0x0cb8 (correct)
Source: XXX.YYY.ZZZ.KKK (XXX.YYY.ZZZ.KKK)
Destination: 66.90.80.51 (66.90.80.51)
Transmission Control Protocol, Src Port: 33340 (33340), Dst Port: ftp (21), 
Seq: 0, Ack: 0, Len: 0
Source port: 33340 (33340)
Destination port: ftp (21)
Sequence number: 0(relative sequence number)
Header length: 40 bytes
Flags: 0x0002 (SYN)
0...  = Congestion Window Reduced (CWR): Not set
.0..  = ECN-Echo: Not set
..0.  = Urgent: Not set
...0  = Acknowledgment: Not set
 0... = Push: Not set
 .0.. = Reset: Not set
 ..1. = Syn: Set
 ...0 = Fin: Not set
Window size: 5840
Checksum: 0xc48e (correct)
Options: (20 bytes)
Maximum segment size: 1460 bytes
SACK permitted
Time stamp: tsval 242708530, tsecr 0
NOP
Window scale: 2 (multiply by 4)

No. TimeSourceDestination   Protocol Info
  2 0.10887366.90.80.51   XXX.YYY.ZZZ.KKK TCP  ftp 
 33340 [SYN, ACK] Seq=0 Ack=1 Win=5792 Len=0 MSS=1380 TSV=41982635 
TSER=242708530 WS=0

Frame 2 (74 bytes on wire, 74 bytes captured)
Arrival Time: Apr 11, 2005 12:34:45.961867000
Time delta from previous packet: 0.108873000 seconds
Time since reference or first frame: 0.108873000 seconds
Frame Number: 2
Packet Length: 74 bytes
Capture Length: 74 bytes
Protocols in frame: eth:ip:tcp
Ethernet II, Src: 00:d0:bc:f6:8c:1c, Dst: 00:00:e2:2b:b1:2d
Destination: 00:00:e2:2b:b1:2d (AcerTech_2b:b1:2d)
Source: 00:d0:bc:f6:8c:1c (Cisco_f6:8c:1c)
Type: IP (0x0800)
Internet Protocol, Src Addr: 66.90.80.51 (66.90.80.51), Dst Addr: 
XXX.YYY.ZZZ.KKK (XXX.YYY.ZZZ.KKK)
Version: 4
Header length: 20 bytes
Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00)
 00.. = Differentiated Services Codepoint: Default (0x00)
 ..0. = ECN-Capable Transport (ECT): 0
 ...0 = ECN-CE: 0
Total Length: 60
Identification: 0x (0)
Flags: 0x04 (Don't Fragment)
0... = Reserved bit: Not set
.1.. = Don't fragment: Set
..0. = More fragments: Not set
Fragment offset: 0
Time to live: 44
Protocol: TCP (0x06)
Header checksum: 0xf46e (correct)
Source: 66.90.80.51 (66.90.80.51)
Destination: XXX.YYY.ZZZ.KKK (XXX.YYY.ZZZ.KKK)
Transmission Control Protocol, Src Port: ftp (21), Dst Port: 33340 (33340), 
Seq: 0, Ack: 1, Len: 0
Source port: ftp (21)
Destination port: 33340 (33340)
Sequence number: 0(relative sequence number)
Acknowledgement number: 1(relative ack number)
Header length: 40 bytes
Flags: 0x0012 (SYN