From: Operating system: Debian Linux PHP version: 5.3.10 Package: FPM related Bug Type: Bug Bug description:Runaway spawning of children after pipe error
Description: ------------ Relevant software versions Linux 2.6.32-5-amd64 Server Version: Apache/2.2.16 (Debian) DAV/2 mod_fastcgi/2.4.6 PHP Version 5.3.10-1~dotdeb.1 APC Version 3.1.9 Background This is a lightly-loaded webserver running around 40 virtual hosts that experiences occasional traffic spikes. Around 20 virtual hosts use php and have one fpm pool each to run php under their own user, configured as ondemand so that they have no fpm processes running when they are not serving pages. Generally there are between 1 and 5 fpm processes running in total at any one time, rising to maybe 20 to 30 when a spike of traffic comes in. Error I became aware of the problem after a service monitor reported that websites were no longer being served. Checking, I found that that php-fpm had crashed. Time since the last restart of php-fpm when the error occured was about 2 days 4 hours, with around 2.5million php requests served. The APC cache of 128Mb was about three-quarters full. Looking back through the logs, this is what I found. The problem appears to start at 18:55:32 when php-fpm was unable to read a pipe. I have no idea what caused this initial error, looking back through other logs I could not see any abnormal web requests around this time. Mar 24 18:55:32 banana php-fpm[21906]: [ERROR] unable to read what child say: Bad file descriptor (9) Mar 24 18:55:32 banana php-fpm[21906]: [ERROR] unable to read what child say: Bad file descriptor (9) There were no further fpm messages in the log until those shown below. This is the most worrying aspect of this bug as basically fpm seems to have gone into meltdown, continually spawning a process (and using almost all available cpu). Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22229 exited with code 0 after 0.002001 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22230 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22230 exited with code 0 after 0.001790 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22231 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22231 exited with code 0 after 0.001694 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22232 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22232 exited with code 0 after 0.001692 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22233 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22233 exited with code 0 after 0.001685 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22234 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22234 exited with code 0 after 0.001683 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22235 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22235 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22236 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22236 exited with code 0 after 0.001677 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22237 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22237 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22238 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22238 exited with code 0 after 0.001661 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22239 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22239 exited with code 0 after 0.001653 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22240 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22240 exited with code 0 after 0.001667 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22241 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22241 exited with code 0 after 0.001638 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22242 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22242 exited with code 0 after 0.001669 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22243 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22243 exited with code 0 after 0.001660 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22244 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22244 exited with code 0 after 0.001664 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22245 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22245 exited with code 0 after 0.001644 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22246 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22246 exited with code 0 after 0.001671 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22247 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22247 exited with code 0 after 0.001639 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22248 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22248 exited with code 0 after 0.001669 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22249 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22249 exited with code 0 after 0.001651 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22250 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22250 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22251 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22251 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22252 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22252 exited with code 0 after 0.001654 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22253 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22253 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22254 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22254 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22255 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22255 exited with code 0 after 0.001633 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22256 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22256 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22257 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22257 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22258 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22258 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22259 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22259 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22260 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22260 exited with code 0 after 0.001660 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22261 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22261 exited with code 0 after 0.001643 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22262 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22262 exited with code 0 after 0.001660 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22263 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22263 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22264 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22264 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22265 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22265 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22266 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22266 exited with code 0 after 0.001684 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22267 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22267 exited with code 0 after 0.001653 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22268 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22268 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22269 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22269 exited with code 0 after 0.001641 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22270 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22270 exited with code 0 after 0.001665 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22271 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22271 exited with code 0 after 0.001631 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22272 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22272 exited with code 0 after 0.001655 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22273 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22273 exited with code 0 after 0.001643 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22274 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22274 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22275 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22275 exited with code 0 after 0.001653 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22276 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22276 exited with code 0 after 0.001658 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22277 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22277 exited with code 0 after 0.001640 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22278 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22278 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22279 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22279 exited with code 0 after 0.001653 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22280 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22280 exited with code 0 after 0.001701 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22281 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22281 exited with code 0 after 0.001660 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22282 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22282 exited with code 0 after 0.007454 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22283 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22283 exited with code 0 after 0.001857 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22284 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22284 exited with code 0 after 0.001721 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22285 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22285 exited with code 0 after 0.001697 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22286 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22286 exited with code 0 after 0.001675 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22287 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22287 exited with code 0 after 0.001684 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22288 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22288 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22289 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22289 exited with code 0 after 0.001651 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22290 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22290 exited with code 0 after 0.001653 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22291 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22291 exited with code 0 after 0.001650 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22292 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22292 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22293 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22293 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22294 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22294 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22295 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22295 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22296 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22296 exited with code 0 after 0.001665 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22297 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22297 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22298 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22298 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22299 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22299 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22300 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22300 exited with code 0 after 0.001639 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22301 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22301 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22302 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22302 exited with code 0 after 0.001640 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22303 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22303 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22304 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22304 exited with code 0 after 0.001658 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22305 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22305 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22306 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22306 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22307 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22307 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22308 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22308 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22309 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22309 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22310 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22310 exited with code 0 after 0.001642 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22311 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22311 exited with code 0 after 0.001654 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22312 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22312 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22313 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22313 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22314 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22314 exited with code 0 after 0.001640 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22315 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22315 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22316 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22316 exited with code 0 after 0.001644 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22317 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22317 exited with code 0 after 0.001650 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22318 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22318 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22319 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22319 exited with code 0 after 0.001643 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22320 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22320 exited with code 0 after 0.001641 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22321 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22321 exited with code 0 after 0.001666 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22322 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22322 exited with code 0 after 0.001643 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22323 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22323 exited with code 0 after 0.001680 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22324 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22324 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22325 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22325 exited with code 0 after 0.001656 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22326 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22326 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22327 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22327 exited with code 0 after 0.001659 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22328 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22328 exited with code 0 after 0.001656 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22329 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22329 exited with code 0 after 0.001684 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22330 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22330 exited with code 0 after 0.001638 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22331 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22331 exited with code 0 after 0.001656 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22332 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22332 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22333 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22333 exited with code 0 after 0.001650 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22334 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22334 exited with code 0 after 0.001638 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22335 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22335 exited with code 0 after 0.001650 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22336 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22336 exited with code 0 after 0.001636 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22337 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22337 exited with code 0 after 0.001654 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22338 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22338 exited with code 0 after 0.001638 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22339 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22339 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22340 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22340 exited with code 0 after 0.001639 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22341 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22341 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22342 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22342 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22343 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22343 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22344 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22344 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22345 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22345 exited with code 0 after 0.001654 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22346 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22346 exited with code 0 after 0.001632 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22347 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22347 exited with code 0 after 0.001644 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22348 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22348 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22349 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22349 exited with code 0 after 0.001644 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22350 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22350 exited with code 0 after 0.001651 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22351 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22351 exited with code 0 after 0.001658 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22352 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22352 exited with code 0 after 0.001634 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22353 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22353 exited with code 0 after 0.001654 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22354 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22354 exited with code 0 after 0.001633 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22355 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22355 exited with code 0 after 0.001650 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22356 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22356 exited with code 0 after 0.001640 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22357 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22357 exited with code 0 after 0.001656 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22358 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22358 exited with code 0 after 0.001632 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22359 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22359 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22360 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22360 exited with code 0 after 0.001635 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22361 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22361 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22362 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22362 exited with code 0 after 0.001628 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22363 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22363 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22364 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22364 exited with code 0 after 0.001631 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22365 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22365 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22366 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22366 exited with code 0 after 0.001630 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22367 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22367 exited with code 0 after 0.001642 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22368 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22368 exited with code 0 after 0.001641 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22369 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22369 exited with code 0 after 0.001649 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22370 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22370 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22371 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22371 exited with code 0 after 0.001689 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22372 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22372 exited with code 0 after 0.001634 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22373 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22373 exited with code 0 after 0.001648 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22374 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22374 exited with code 0 after 0.001636 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22375 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22375 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22376 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22376 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22377 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22377 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22378 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22378 exited with code 0 after 0.001637 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22379 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22379 exited with code 0 after 0.001656 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22380 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22380 exited with code 0 after 0.001628 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22381 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22381 exited with code 0 after 0.001655 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22382 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22382 exited with code 0 after 0.001646 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22383 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22383 exited with code 0 after 0.001652 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22384 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22384 exited with code 0 after 0.001676 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22385 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22385 exited with code 0 after 0.001651 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22386 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22386 exited with code 0 after 0.001636 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22387 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22387 exited with code 0 after 0.001647 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22388 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22388 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22389 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22389 exited with code 0 after 0.001640 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22390 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22390 exited with code 0 after 0.001636 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22391 started Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22391 exited with code 0 after 0.001645 seconds from start Mar 24 18:56:48 banana php-fpm[21906]: [NOTICE] [pool ci] child 22392 started Mar 24 18:56:49 banana php-fpm[21906]: [NOTICE] [pool ci] child 22392 exited with code 0 after 0.001638 seconds from start Messages like his continued for nearly two minutes until php-fpm segfaulted (which is just as well, as I didn't get onto the server to clean up the mess for another 30 minutes). Mar 24 18:58:37 banana php-fpm[21906]: [NOTICE] [pool ci] child 947 exited with code 0 after 0.003013 seconds from start Mar 24 18:58:37 banana php-fpm[21906]: [NOTICE] [pool ci] child 950 started Mar 24 18:58:37 banana kernel: [4332778.033172] php5-fpm[21906]: segfault at 2 ip 0000000000000002 sp 00000000ffd50bec error 14 in php5-fpm[8048000+787000] I had a quick look at the fpm source code and it would seem that if a child cannot read the initial request that it was spawned to handle it will exit almost immediately with code 0. The master, still seeing there is a request to handle spawns a new process and so on... Whilst it does not address the cause that a pipe became unreadable, the child ought to exit with a code other than zero under these circumstances so that the master process does not continually retry (and maybe php-fpm could restart itself?). -- Edit bug report at https://bugs.php.net/bug.php?id=61558&edit=1 -- Try a snapshot (PHP 5.4): https://bugs.php.net/fix.php?id=61558&r=trysnapshot54 Try a snapshot (PHP 5.3): https://bugs.php.net/fix.php?id=61558&r=trysnapshot53 Try a snapshot (trunk): https://bugs.php.net/fix.php?id=61558&r=trysnapshottrunk Fixed in SVN: https://bugs.php.net/fix.php?id=61558&r=fixed Fixed in SVN and need be documented: https://bugs.php.net/fix.php?id=61558&r=needdocs Fixed in release: https://bugs.php.net/fix.php?id=61558&r=alreadyfixed Need backtrace: https://bugs.php.net/fix.php?id=61558&r=needtrace Need Reproduce Script: https://bugs.php.net/fix.php?id=61558&r=needscript Try newer version: https://bugs.php.net/fix.php?id=61558&r=oldversion Not developer issue: https://bugs.php.net/fix.php?id=61558&r=support Expected behavior: https://bugs.php.net/fix.php?id=61558&r=notwrong Not enough info: https://bugs.php.net/fix.php?id=61558&r=notenoughinfo Submitted twice: https://bugs.php.net/fix.php?id=61558&r=submittedtwice register_globals: https://bugs.php.net/fix.php?id=61558&r=globals PHP 4 support discontinued: https://bugs.php.net/fix.php?id=61558&r=php4 Daylight Savings: https://bugs.php.net/fix.php?id=61558&r=dst IIS Stability: https://bugs.php.net/fix.php?id=61558&r=isapi Install GNU Sed: https://bugs.php.net/fix.php?id=61558&r=gnused Floating point limitations: https://bugs.php.net/fix.php?id=61558&r=float No Zend Extensions: https://bugs.php.net/fix.php?id=61558&r=nozend MySQL Configuration Error: https://bugs.php.net/fix.php?id=61558&r=mysqlcfg
