Good morning all,
Recently, we've migrated one of our production servers from a Linux
box to a FreeBSD box. We're running Apache 1.3.34, with a PHP/MySQL
web application. Listed below, you can find how apache has been
compiled.
Yesterday afternoon, we put this new server into production and it
seemed to be behaving relatively OK, with system-load of 4-5. We
thought everything was going well and that this issue was wrapped
up. Serves us right - today we got into the office and found that
loads on our server had spiked to 150.
Before we pulled the server from production, we grabbed a few
snapshots of what the system was doing. After taking a look at
these, I haven't been able to make much head-way. If someone with
more experience in this matter could take a look, I would greatly
appreciate it.
Ultimately, my goal here is to get Apache to behave. Any solution
that will allow Apache to run without killing the server is
acceptable -- including upgrading to Apache 2. (Does Apache2
outperform Apache 1.3?)
server# httpd -V
Server version: Apache/1.3.34 (Unix)
Server built: Nov 28 2005 12:49:01
Server's Module Magic Number: 19990320:18
Server compiled with....
-D EAPI
-D EAPI_MM
-D EAPI_MM_CORE_PATH="/var/run/httpd.mm"
-D HAVE_MMAP
-D USE_MMAP_SCOREBOARD
-D USE_MMAP_FILES
-D HAVE_FLOCK_SERIALIZED_ACCEPT
-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
-D DYNAMIC_MODULE_LIMIT=64
-D HARD_SERVER_LIMIT=512
-D SO_ACCEPTFILTER
-D ACCEPT_FILTER_NAME="httpready"
-D HTTPD_ROOT="/usr/local"
-D SUEXEC_BIN="/usr/local/sbin/suexec"
-D DEFAULT_PIDLOG="/var/run/httpd.pid"
-D DEFAULT_SCOREBOARD="/var/run/httpd.scoreboard"
-D DEFAULT_LOCKFILE="/var/run/httpd.lock"
-D DEFAULT_ERRORLOG="/var/log/httpd-error.log"
-D TYPES_CONFIG_FILE="etc/apache/mime.types"
-D SERVER_CONFIG_FILE="etc/apache/httpd.conf"
-D ACCESS_CONFIG_FILE="etc/apache/access.conf"
-D RESOURCE_CONFIG_FILE="etc/apache/srm.conf"
This is vmstat during the problem -- note that CPU is 0% idle.
server# vmstat 1
procs memory page disks faults cpu
r b w avm fre flt re pi po fr sr da0 md0 in sy cs
us sy id
56 115 0 4105968 293024 10839 6 0 0 10462 13 0 0 660 5051
423 9 9 82
43 120 0 2559320 288348 75582 14 0 0 70335 0 0 0 1874
23305 1700 74 25 0
39 126 0 3174044 281440 65374 66 0 0 60878 0 64 0 1712
23361 1646 69 31 0
24 127 0 3171440 280976 24325 229 0 0 19744 0 1 0 2202
47064 2373 74 26 0
25 128 0 3164152 288296 41649 74 0 0 39391 0 1 0 1573
34180 1600 64 36 0
21 132 0 2649152 294112 66247 272 0 0 63361 0 1 0 1595
22986 1938 64 36 0
21 129 0 1634504 282236 31834 668 0 0 28466 0 91 0 1588
58544 2087 70 30 0
23 131 0 2243500 281344 56292 21 0 0 53558 0 1 0 1356
34243 1669 58 42 0
19 133 0 2235948 285932 37381 12 0 0 36987 0 2 0 1547
30101 1784 72 28 0
32 134 0 798396 295432 34687 4 0 0 36695 0 0 0 1079 2982
246 6 94 0
31 135 0 1312772 294476 202898 0 0 0 196045 0 12 0 1357
16086 1242 21 79 0
16 138 0 1325712 285204 90288 16 0 0 85205 0 8 0 1257
19917 1297 50 50 0
16 138 0 3459864 290800 48865 10 0 0 48583 0 2 0 1365
26674 1655 62 38 0
22 135 0 1415696 282132 62415 5 0 0 57784 0 1 0 1123
36272 1230 57 43 0
22 137 0 1390288 295284 90665 8 0 0 88675 0 2 0 1800
32413 2110 50 50 0
23 135 0 3550672 289536 29287 11 0 0 21393 0 0 0 1694
21543 1810 76 24 0
Our first top output:
last pid: 62787; load averages: 56.24, 105.03,
121.49
up 0+21:28:37 08:42:36
388 processes: 58 running, 314 sleeping, 16 zombie
CPU states: 19.3% user, 0.0% nice, 80.4% system, 0.4% interrupt,
0.0% idle
Mem: 1803M Active, 1349M Inact, 343M Wired, 124M Cache, 199M Buf,
278M Free
Swap: 8000M Total, 8000M Free
PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU CPU
COMMAND
36765 httpd 63 0 507M 68K RUN 0 0:39 10.69% 10.69% httpd
43430 httpd 60 0 505M 56K RUN 0 0:40 3.27% 3.27% httpd
60922 httpd 51 0 506M 122M RUN 0 0:02 2.69% 2.69% httpd
38828 httpd 51 0 507M 7152K RUN 1 0:32 2.34% 2.34% httpd
51672 httpd 2 0 507M 56K sbwait 0 0:19 2.10% 2.10% httpd
51040 httpd 2 0 506M 88K sbwait 0 0:26 1.95% 1.95% httpd
43457 httpd 50 0 507M 15508K RUN 1 0:33 1.56% 1.56% httpd
39021 httpd 2 0 505M 118M sbwait 0 0:44 1.27% 1.27% httpd
39007 httpd 46 0 507M 123M RUN 0 0:49 0.93% 0.93% httpd
36636 httpd 2 0 516M 122M sbwait 0 0:42 0.93% 0.93% httpd
50650 httpd 2 0 504M 56K sbwait 1 0:28 0.93% 0.93% httpd
43472 httpd 2 0 506M 122M sbwait 0 0:39 0.88% 0.88% httpd
50870 httpd 2 0 505M 6364K sbwait 0 0:24 0.88% 0.88% httpd
60806 httpd 2 0 504M 120M sbwait 0 0:01 0.88% 0.88% httpd
18704 httpd 2 0 508M 56K sbwait 0 1:04 0.83% 0.83% httpd
46300 httpd 2 0 504M 117M sbwait 1 0:26 0.83% 0.83% httpd
49956 httpd 2 0 506M 117M sbwait 1 0:25 0.83% 0.83% httpd
50868 httpd 52 0 507M 121M RUN 1 0:19 0.83% 0.83% httpd
43442 httpd 54 0 507M 43436K RUN 0 0:44 0.78% 0.78% httpd
43445 httpd 2 0 507M 122M sbwait 0 0:42 0.78% 0.78% httpd
46328 httpd 2 0 505M 121M sbwait 0 0:26 0.78% 0.78% httpd
...
Thanks,
Michael Jeung
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: [EMAIL PROTECTED]
" from the digest: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]