Josip Rodin wrote:
Is anyone else noticing a surprisingly large number of clients that tend to
repeat connections, as if they are doing some very aggressive prefetching
and breaking down connections into pieces?
You have the same problem with some FTP clients (I presume it is mostly
with some download accelerators). As the server is trying to maximize
disk request size (to lower IO load on disk system), I preferred to
disable REST command (needed to resume a download and thus needed by
download accelerators) as some client are using 16 to 32 KB blocks while
downloading ISOs.
Even without REST command, some clients keep on trying to do segmented
download (the following logs are not related to OpenOffice, I just pick
out worst examples) :
Mon Apr 2 12:10:14 2007 1 IPx.xx.xxx.xxx 17376
AA28FullInstaller_Generic.exe b _ o a Squid@ ftp 0 * i
Mon Apr 2 12:10:22 2007 1 IPx.xx.xxx.xxx 17376
AA28FullInstaller_Generic.exe b _ o a Squid@ ftp 0 * i
Mon Apr 2 12:10:29 2007 1 IPx.xx.xxx.xxx 17376
AA28FullInstaller_Generic.exe b _ o a Squid@ ftp 0 * i
[...one retry every 8s or so...]
# grep -c " IPx.xx.xxx.xxx " /var/log/xferlog
334
Another one :
Sun Apr 1 00:00:59 2007 1 IPy.yy.yyy.yyy 20160
AA28FullInstaller_Generic.exe b _ o a IEUser@ ftp 0 * i
Sun Apr 1 00:01:05 2007 1 IPy.yy.yyy.yyy 20160
AA28FullInstaller_Generic.exe b _ o a IEUser@ ftp 0 * i
Sun Apr 1 00:01:11 2007 1 IPy.yy.yyy.yyy 20160
AA28FullInstaller_Generic.exe b _ o a IEUser@ ftp 0 * i
# zgrep " IPy.yy.yyy.yyy " /var/log/xferlog.1.gz | wc -l
1606
# zgrep " IPy.yy.yyy.yyy " /var/log/xferlog.2.gz | wc -l
6276
I am wondering who designed a FTP client that is retrying thousands time
to (resume a) download.
I've had to lower the mod_cband limits to 5 rps and 5 conns on my Apache
to get them to be bearable, and banned some particularly annoying clients
completely, otherwise the server was hitting MaxClients limit way too often.
Just before I disabled the resume ability, a third of connected IP were
openning at least two connection to download a single file.
François
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
