Hi folks,
i'm running squid for about 30 users with a very close to standard setup.
The proxy is transparrent to the users. I increased the cache size to 14 G
and have allocated about 512 mb ram. Apart from that the conf is standard.
Below I enclose a "calamaris statistic report", which is where my trouble
begins. I often have a negative average speed increase, and my byte hit
ratio is bad - approxematly 3-5 % allthough I get a good request hit
ratio.
My hope is that anyone by looking at the report can help me improve the
overall proxy performance. If needed I'll enclose the squid.conf file.
# Summary
Calamaris statistics
--------------------------------------------------------- --------------
------
lines parsed: lines
126047
invalid lines: lines
0
parse time: sec
41
parse speed: lines/sec
3074
--------------------------------------------------------- --------------
------
Proxy statistics
--------------------------------------------------------- --------------
------
Total amount: requests
126047
unique hosts/users: hosts
34
Total Bandwidth: Byte
3360M
Proxy efficiency (HIT [kB/sec] / DIRECT [kB/sec]): factor
0.66
Average speed increase: %
-2.28
TCP response time of 100% requests: msec
755
--------------------------------------------------------- --------------
------
Cache statistics
--------------------------------------------------------- --------------
------
Total amount cached: requests
47735
Request hit rate: %
37.87
Bandwidth savings: Byte
150M
Bandwidth savings in Percent (Byte hit rate): %
4.47
Average cached object size: Byte
3299
Average direct object size: Byte
42980
Average object size: Byte
27952
--------------------------------------------------------- --------------
------
# Incoming requests by method
method request % sec/req Byte %
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
GET 123481 97.96 0.75 3433347K 99.79
36.99
POST 2294 1.82 0.99 7395777 0.21
3.19
HEAD 235 0.19 0.20 99037 0.00
2.05
NONE 20 0.02 0.00 29096 0.00
1092.85
PROPFIND 13 0.01 0.11 17371 0.00
12.06
OPTIONS 4 0.00 0.06 3280 0.00
14.43
------------------------------ --------- ------ ------- -------- ------
-------
Sum 126047 100.00 0.75 3440715K 100.00
36.17
# Incoming UDP-requests by status
no matching requests
# Incoming TCP-requests by status
status request % sec/req Byte %
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
HIT 47735 37.87 0.13 153786K 4.47
24.33
TCP_IMS_HIT 26661 21.15 0.02 9833998 0.28
18.76
TCP_REFRESH_HIT 9925 7.87 0.55 78555994 2.23
14.15
TCP_HIT 5286 4.19 0.06 58741309 1.67
188.53
TCP_NEGATIVE_HIT 2960 2.35 0.01 3513393 0.10
102.69
TCP_MEM_HIT 2903 2.30 0.02 6832080 0.19
134.31
MISS 78288 62.11 1.13 3286878K 95.53
37.01
TCP_MISS 74323 58.96 1.15 3254574K 94.59
38.24
TCP_REFRESH_MISS 3668 2.91 0.64 31017023 0.88
12.91
TCP_CLIENT_REFRESH_MISS 297 0.24 4.57 2063016 0.06
1.48
ERROR 24 0.02 0.00 51692 0.00
1147.28
TCP_DENIED 24 0.02 0.00 51692 0.00
1147.28
------------------------------ --------- ------ ------- -------- ------
-------
Sum 126047 100.00 0.75 3440715K 100.00
36.17
# Outgoing requests by status
status request % sec/req Byte %
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
DIRECT Fetch from Source 88219 100.00 1.07 3364765K 100.00
35.70
DIRECT 88219 100.00 1.07 3364765K 100.00
35.70
SIBLING 0 0.00 0.00 0 0.00
0.00
PARENT 0 0.00 0.00 0 0.00
0.00
------------------------------ --------- ------ ------- -------- ------
-------
Sum 88219 100.00 1.07 3364765K 100.00
35.70
# Outgoing requests by destination
neighbor type request % sec/req Byte %
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
DIRECT 88219 100.00 1.07 3364765K 100.00
35.70
------------------------------ --------- ------ ------- -------- ------
-------
Sum 88219 100.00 1.07 3364765K 100.00
35.70
# Request-destinations by 2nd-level-domain
destination request % hit-% Byte %
hit-%
-------------------------------- --------- ------ ------ -------- ------
------
*.cafeen.org 5937 4.71 93.72 6801134 0.19
54.69
<error> 5305 4.21 55.44 6872343 0.20
51.06
*.dr.dk 4842 3.84 73.38 730135K 21.22
1.07
*.travian.dk 3279 2.60 32.08 8640691 0.25
18.21
*.dba.dk 3228 2.56 66.51 14169266 0.40
10.43
*.msn.com 2851 2.26 18.10 11143648 0.32
5.57
statistik-gallup.net 2466 1.96 0.00 1414712 0.04
0.00
*.myspace.com 2180 1.73 17.29 28930777 0.82
4.89
*.google.com 2129 1.69 5.78 30745388 0.87
0.90
*.mymusic.dk 2110 1.67 35.21 228983K 6.66
0.12
*.berlingske-mail.dk 1897 1.50 96.26 1067141 0.03
80.67
ekstrabladet.dk 1785 1.42 12.89 4375244 0.12
14.28
*.myspacecdn.com 1730 1.37 21.56 454945K 13.22
0.48
dkbn.dk 1452 1.15 55.10 11947861 0.34
3.03
*.lego.com 1379 1.09 23.93 5892238 0.17
1.86
*.momondo.com 1365 1.08 32.01 4259281 0.12
5.62
*.adtech.de 1318 1.05 1.29 1424658 0.04
0.25
*.youtube.com 1223 0.97 22.16 122194K 3.55
0.30
*.klassik.dk 1198 0.95 32.05 3904904 0.11
3.43
*.flickr.com 1161 0.92 2.67 21110460 0.60
1.85
other: 2110 2nd-level-domains 77212 61.26 33.70 1745571K 50.73
7.34
-------------------------------- --------- ------ ------ -------- ------
------
Sum 126047 100.00 37.87 3440715K 100.00
4.47
# Request-destinations by toplevel-domain
destination request % hit-% Byte %
hit-%
-------------------------------- --------- ------ ------ -------- ------
------
*.dk 48026 38.10 48.94 1249551K 36.32
3.62
*.com 45732 36.28 25.12 1748592K 50.82
3.53
*.net 8299 6.58 20.29 245920K 7.15
3.75
*.org 7309 5.80 81.71 39343871 1.12
20.55
<error> 5305 4.21 55.44 6872343 0.20
51.06
<unresolved> 3638 2.89 12.20 70001247 1.99
6.84
*.de 1680 1.33 12.14 7873640 0.22
12.74
*.cn 960 0.76 54.27 2766639 0.08
6.28
*.info 836 0.66 23.56 13495337 0.38
9.91
*.pl 751 0.60 0.13 309584 0.01
1.81
*.se 539 0.43 3.71 1199302 0.03
2.50
*.fr 428 0.34 31.07 9620581 0.27
21.82
*.es 428 0.34 0.23 1564132 0.04
1.63
*.uk 360 0.29 30.83 2717396 0.08
9.77
*.biz 329 0.26 50.76 2293951 0.07
29.66
*.edu 325 0.26 1.85 7511238 0.21
54.58
*.us 202 0.16 69.80 13502787 0.38
71.94
*.eu 172 0.14 18.60 1147106 0.03
7.36
*.no 143 0.11 1.40 2345350 0.07
11.87
*.au 122 0.10 2.46 161752 0.00
4.51
other: 28 top-level-domains 463 0.37 35.21 18646026 0.53
13.01
-------------------------------- --------- ------ ------ -------- ------
------
Sum 126047 100.00 37.87 3440715K 100.00
4.47
# TCP-Request-protocol
protocol request % hit-% Byte %
hit-%
-------------------------------- --------- ------ ------ -------- ------
------
http: 120742 95.79 37.10 3434004K 99.80
4.38
<error> 5305 4.21 55.44 6872343 0.20
51.06
-------------------------------- --------- ------ ------ -------- ------
------
Sum 126047 100.00 37.87 3440715K 100.00
4.47
# Requested content-type
content-type request % hit-% Byte %
hit-%
-------------------------------- --------- ------ ------ -------- ------
------
image/gif 38897 30.86 61.94 102731K 2.99
44.54
image/jpeg 26678 21.17 30.94 321255K 9.34
19.50
text/html 23512 18.65 3.57 194778K 5.66
1.27
<unknown> 8032 6.37 36.77 2953716 0.08
30.40
application/x-javascript 7345 5.83 45.38 27856728 0.79
27.45
<error> 5305 4.21 55.44 6872343 0.20
51.06
text/css 3033 2.41 59.48 11928551 0.34
36.07
image/png 2769 2.20 67.39 15192812 0.43
40.76
text/xml 2282 1.81 4.95 5610341 0.16
1.64
text/plain 2018 1.60 4.56 488498K 14.20
1.55
application/x-shockwave-flash 1892 1.50 20.51 73785996 2.09
5.71
text/javascript 1319 1.05 46.55 3214408 0.09
15.34
application/octet-stream 1000 0.79 18.80 243926K 7.09
0.08
audio/mpeg 505 0.40 0.79 670022K 19.47
0.01
application/zip 238 0.19 1.26 3253937 0.09
18.50
image/x-icon 222 0.18 52.25 638332 0.02
56.70
application/xml 167 0.13 37.13 659342 0.02
12.07
image/pjpeg 127 0.10 0.00 553810 0.02
0.00
application/x-mms-framed 78 0.06 0.00 705775K 20.51
0.00
video/x-ms-asf 73 0.06 4.11 57413 0.00
3.39
other: 56 content-types 555 0.44 12.61 564728K 16.41
1.30
-------------------------------- --------- ------ ------ -------- ------
------
Sum 126047 100.00 37.87 3440715K 100.00
4.47
# Requested extensions
extensions request % hit-% Byte %
hit-%
-------------------------------- --------- ------ ------ -------- ------
------
<dynamic> 36478 28.94 0.38 1689769K 49.11
0.03
gif 35311 28.01 72.83 99698830 2.83
47.40
jpg 26492 21.02 34.29 277642K 8.07
22.21
js 5600 4.44 73.71 18959700 0.54
45.14
<error> 5305 4.21 55.44 6872343 0.20
51.06
<none> 4575 3.63 7.83 34990326 0.99
3.99
css 2856 2.27 66.98 9386898 0.27
45.70
png 2616 2.08 74.24 11648394 0.33
53.32
php 1163 0.92 5.85 7605359 0.22
0.33
xml 1015 0.81 17.93 2426912 0.07
6.19
html 816 0.65 14.83 8604816 0.24
5.51
swf 613 0.49 66.23 44421312 1.26
9.68
htm 512 0.41 27.73 6174349 0.18
3.68
asp 414 0.33 5.80 2856910 0.08
1.34
ico 365 0.29 36.99 955532 0.03
41.36
aspx 320 0.25 0.00 5041846 0.14
0.00
JPG 317 0.25 31.86 5909269 0.17
12.49
jpeg 228 0.18 57.46 1438056 0.04
28.08
flv 71 0.06 21.13 416471K 12.10
2.22
wmv 48 0.04 0.00 468082K 13.60
0.00
other: 107 extensions 932 0.74 20.49 328017K 9.53
1.89
-------------------------------- --------- ------ ------ -------- ------
------
Sum 126047 100.00 37.87 3440715K 100.00
4.47
# Incoming UDP-requests by host
no matching requests
# Incoming TCP-requests by host
host request hit-% sec/req Byte hit-%
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
192.168.0.251 23794 51.23 0.43 680523K 7.72
67.25
192.168.0.231 13864 31.61 0.36 121489K 16.62
24.60
192.168.0.241 11883 45.57 0.46 222074K 5.12
40.50
192.168.0.79 8474 26.54 0.18 42479278 9.27
27.33
192.168.0.244 8173 29.17 1.09 260161K 1.03
29.34
192.168.0.118 6506 30.03 0.33 167104K 1.76
76.75
192.168.0.242 5407 26.91 5.38 501600K 1.09
17.26
192.168.0.139 4371 64.42 0.16 8762011 34.39
12.08
192.168.0.126 4096 22.46 0.58 84831104 10.94
34.71
192.168.0.227 4079 42.73 1.05 290881K 2.63
67.79
192.168.0.58 4010 39.40 0.16 53297233 8.82
83.35
192.168.0.32 3821 23.45 0.14 24276371 2.93
44.05
192.168.0.221 3580 30.11 0.33 180426K 3.70
152.66
192.168.0.56 2977 29.73 0.24 22034040 4.47
30.70
192.168.0.170 2940 55.17 1.58 427911K 0.89
91.89
192.168.0.236 2323 36.20 0.88 54787387 8.07
26.30
192.168.0.235 1927 45.98 1.92 6839339 12.38
1.80
192.168.0.68 1697 52.33 1.22 182109K 0.68
87.75
192.168.0.81 1596 45.80 0.56 20251574 22.19
22.28
192.168.0.228 1528 24.67 0.62 30664557 4.75
31.62
other: 14 requesting hosts 9001 27.13 0.07 67969233 9.33
0.70
------------------------------ --------- ------ ------- -------- ------
-------
Sum 126047 37.87 0.75 3440715K 4.47
36.17
# Size Distribution Diagram
object-size (bytes) request hit-% sec/req Byte hit-%
kB/sec
------------------------------ --------- ------ ------- -------- ------
-------
0-0 785 6.24 1.08 0 0.00
0.00
100-999 67281 54.48 0.18 31354112 45.28
2.52
1000-9999 40912 21.05 0.61 143237K 19.71
5.78
10000-99999 15613 14.26 0.99 402277K 13.74
26.03
100000-999999 976 19.16 2.94 219705K 19.46
76.69
1000000-9999999 434 2.07 69.47 1181480K 1.16
39.19
10000000-99999999 45 0.00 194.29 1314789K 0.00
150.38
100000000-999999999 1 0.00 141.81 148608K 0.00
1047.96
------------------------------ --------- ------ ------- -------- ------
-------
Sum 126047 37.87 0.75 3440715K 4.47
36.17
# Performance in 1 hour steps
incomin hit miss direct sibling
fetch
date request Byte kB/sec kB/sec kB/sec kB/sec kB/sec
kB/sec
--------------- --------- ----- ------- ------- ------- ------- -------
-------
30.May 07 06:00 979 12M 64.36 20.33 73.51 66.92 - -
30.May 07 07:00 1832 21M 27.45 15.64 31.88 25.49 - -
30.May 07 08:00 1579 11M 39.75 105.22 32.54 33.66 - -
30.May 07 09:00 2094 12M 33.29 34.54 33.22 32.90 - -
30.May 07 10:00 2550 69M 59.44 8.62 66.21 60.04 - -
30.May 07 11:00 2564 10M 23.40 62.73 18.94 21.28 - -
30.May 07 12:00 7590 257M 57.14 105.53 56.04 55.86 - -
30.May 07 13:00 11080 346M 34.74 60.53 34.11 34.26 - -
30.May 07 14:00 3610 44M 9.01 11.58 8.93 8.90 - -
30.May 07 15:00 5150 162M 27.04 39.54 26.77 26.77 - -
30.May 07 16:00 10327 306M 38.23 28.93 38.55 37.81 - -
30.May 07 17:00 18339 290M 17.40 39.68 16.72 17.01 - -
30.May 07 18:00 13404 209M 28.56 46.13 27.62 27.60 - -
30.May 07 19:00 7679 92M 17.05 50.22 15.64 16.71 - -
30.May 07 20:00 8380 220M 28.76 38.72 28.55 28.47 - -
30.May 07 21:00 11279 343M 73.69 84.77 72.81 72.59 - -
30.May 07 22:00 7412 125M 27.25 23.98 27.37 27.15 - -
30.May 07 23:00 3694 58M 59.56 27.93 62.90 60.96 - -
31.May 07 00:00 3792 689M 91.52 1.94 148.86 91.45 - -
31.May 07 01:00 2583 81M 54.76 86.85 53.56 54.82 - -
31.May 07 02:00 40 218K 25.03 6.08 25.50 24.94 - -
31.May 07 03:00 43 229K 20.23 1.36 20.56 20.23 - -
31.May 07 04:00 19 129K 15.90 - 15.90 15.90 - -
31.May 07 05:00 14 127K 21.65 - 21.65 21.65 - -
31.May 07 06:00 14 43455 12.89 - 12.89 12.89 - -
--------------- --------- ----- ------- ------- ------- ------- -------
-------
overall 126047 3360M 36.17 24.33 37.01 35.70 - -
# UDP-Request duration distribution in msec
no matching requests
# TCP-Request duration distribution in msec
time request % hit-% sec/req Byte % hit-%
kB/sec
---------------- --------- ------ ------ ------- -------- ------ ------
-------
<= 0.1 6481 5.14 98.86 0.00 4554606 0.13 100.00
6862.92
<= 0.2 6481 5.14 98.86 0.00 4554606 0.13 100.00
6862.92
<= 0.5 6481 5.14 98.86 0.00 4554606 0.13 100.00
6862.92
<= 1 13822 10.97 99.00 0.00 9464128 0.27 99.56
1156.87
<= 2 17600 13.96 99.08 0.00 12514848 0.36 99.54
786.20
<= 5 22413 17.78 99.05 0.00 17677478 0.50 99.60
509.43
<= 10 26148 20.74 99.06 0.00 22395790 0.64 99.67
347.62
<= 20 30106 23.88 99.05 0.00 29293130 0.83 99.73
234.72
<= 50 42705 33.88 82.49 0.01 58353902 1.66 73.61
95.95
<= 100 68510 54.35 59.74 0.04 143179K 4.16 44.78
58.25
<= 200 89370 70.90 49.63 0.06 272172K 7.91 31.18
49.93
<= 500 112600 89.33 41.76 0.11 448183K 13.03 24.95
34.62
<= 1000 121005 96.00 39.30 0.16 590707K 17.17 21.39
31.46
<= 2000 123703 98.14 38.53 0.18 713232K 20.73 20.20
31.90
<= 5000 124946 99.13 38.19 0.21 857564K 24.92 17.74
32.80
<= 10000 125331 99.43 38.08 0.23 1118622K 32.51 13.74
38.75
<= 20000 125545 99.60 38.01 0.25 1394361K 40.53 11.02
43.74
<= 50000 125705 99.73 37.97 0.29 1861301K 54.10 8.26
50.69
<= 100000 125819 99.82 37.94 0.37 2206349K 64.12 6.97
47.28
<= 200000 126017 99.98 37.88 0.59 2804263K 81.50 5.48
37.84
<= 500000 126033 99.99 37.87 0.62 3185421K 92.58 4.83
40.55
<= 1000000 126040 99.99 37.87 0.67 3392516K 98.60 4.53
40.44
<= 1e10 126047 100.00 37.87 0.75 3440715K 100.00 4.47
36.17
---------------- --------- ------ ------ ------- -------- ------ ------
-------
Sum 126047 100.00 37.87 0.75 3440715K 100.00 4.47
36.17
# UDP Response code distribution
no matching requests
# TCP Response code distribution
status-code request % Byte
%
---------------------------------------------- --------- ------ --------
------
000 (Used mostly with UDP traffic) 733 0.58 0
0.00
200 (OK) 79473 63.05 3408848K
99.07
204 (No Content) 308 0.24 106962
0.00
206 (Partial Content) 76 0.06 9424810
0.27
207 (Multi Status) 6 0.00 7074
0.00
301 (Moved Permanently) 1025 0.81 695657
0.02
302 (Moved Temporarily) 5395 4.28 4111776
0.12
303 (See Other) 239 0.19 120335
0.00
304 (Not Modified) 33486 26.57 11277324
0.32
400 (Bad Request) 27 0.02 53199
0.00
403 (Forbidden) 132 0.10 246752
0.01
404 (Not Found) 4953 3.93 6333840
0.18
410 (Gone) 1 0.00 715
0.00
500 (Internal Server Error) 59 0.05 43854
0.00
502 (Bad Gateway) 10 0.01 14655
0.00
503 (Service Unavailable) 84 0.07 117156
0.00
504 (Gateway Timeout) 39 0.03 62172
0.00
600 (Squid header parsing error) 1 0.00 15021
0.00
---------------------------------------------- --------- ------ --------
------
Sum 126047 100.00 3440715K
100.00
Calamaris 2.99.4.0
Copyright (C) 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006
Cord Beermann. Authors: Cord Beermann and Michael Pophal.
Calamaris comes with ABSOLUTELY NO WARRANTY. It is free software, and you are
welcome to redistribute it under certain conditions. See source for details.
http://Calamaris.Cord.de/
