We have an older server, running 5.4-RELEASE-p8 and used primarily
for email, which hangs every couple of weeks. The hang seems to
be in the disk I/O system. Based on the times of the hangs, the
triggering event seems to be running dump.
We have a serial console set up, I broke to the debugger and got the
following. Since the hang is in the disk I/O system, a dump is not
possible. The many versions of inetd are likely due to users attempting
to POP their email.
Any suggestions or tips on how to track this down and get it resolved
would be appreciated.
Relevant dmesg info:
ahc0: Adaptec aic7896/97 Ultra2 SCSI adapter port 0xe400-0xe4ff mem
0xffafe000-0xffafefff irq 16 at device 11.0 on pci0
aic7896/97: Ultra2 Wide Channel A, SCSI Id=7, 32/253 SCBs
ahc1: Adaptec aic7896/97 Ultra2 SCSI adapter port 0xe800-0xe8ff mem
0xffaff000-0xffaf irq 16 at device 11.1 on pci0
aic7896/97: Ultra2 Wide Channel B, SCSI Id=7, 32/253 SCBs
da0 at ahc0 bus 0 target 0 lun 0
da0: SEAGATE ST318436LW 0010 Fixed Direct Access SCSI-3 device
da0: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da0: 17522MB (35885168 512 byte sectors: 255H 63S/T 2233C)
da1 at ahc1 bus 0 target 0 lun 0
da1: SEAGATE ST336938LW 0003 Fixed Direct Access SCSI-3 device
da1: 80.000MB/s transfers (40.000MHz, offset 63, 16bit), Tagged Queueing
Enabled
da1: 35242MB (72176567 512 byte sectors: 255H 63S/T 4492C)
da2 at ahc1 bus 0 target 1 lun 0
da2: SEAGATE ST318436LW 0010 Fixed Direct Access SCSI-3 device
da2: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da2: 17522MB (35885168 512 byte sectors: 255H 63S/T 2233C)
GEOM_MIRROR: Device gm0s1 created (id=520792649).
GEOM_MIRROR: Device gm0s1: provider da0s1 detected.
GEOM_MIRROR: Device gm0s2 created (id=3744871543).
GEOM_MIRROR: Device gm0s2: provider da0s2 detected.
GEOM_MIRROR: Device gm0s1: provider da2s1 detected.
GEOM_MIRROR: Device gm0s1: provider da2s1 activated.
GEOM_MIRROR: Device gm0s1: provider da0s1 activated.
GEOM_MIRROR: Device gm0s1: provider mirror/gm0s1 launched.
GEOM_MIRROR: Device gm0s2: provider da2s2 detected.
GEOM_MIRROR: Device gm0s2: provider da2s2 activated.
GEOM_MIRROR: Device gm0s2: provider da0s2 activated.
GEOM_MIRROR: Device gm0s2: provider mirror/gm0s2 launched.
db ps
pid proc uid ppid pgrp flag stat wmesgwchan cmd
67487 c5ea98d40 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67486 c3b8a1c40 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67485 c634c7100 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67484 c62931c40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67483 c58a93880 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67482 c62937100 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67481 c58ab8d40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67480 c6292c5c0 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67479 c62938d40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67478 c634f0000 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67477 c62941c40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67476 c5e55c5c0 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67475 c5f1fe200 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67474 c5da854c0 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67473 c5f9ee200 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67472 c58a9e200 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67471 c602d8d40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67470 c61191c40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67469 c58ab1c40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67468 c5f19a980 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67467 c58c33880 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67466 c5f1f3880 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67465 c5f190000 442 67465 100 [SLPQ ufs 0xc3851c04][SLP] sshd
67464 c5fa68d40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67463 c5eab54c0 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67462 c62940000 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67461 c5fa67100 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67460 c61190000 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67459 c634c3880 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67458 c5da87100 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67457 c3b8e3880 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67456 c62948d40 551 551 100 [SLPQ ufs 0xc3851c04][SLP] sendmail
67455 c62921c40 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67454 c5f1954c0 574 574 000 [SLPQ ufs 0xc3851c04][SLP] inetd
67453 c5eab3880 574 574