8.1-STABLE: Weird behaviour with some network services
Hello, I'm running FreeBSD 8.1-STABLE amd64 r215423 on a Q9400 with 6GB RAM. Base system is on a geom_mirror, everything else is inside a few ZFS raidz1 pools. Everything except sshd runs inside jails. Three days ago I noticed that my audio/icecast2 (2.3.2, from ports) suddenly stopped processing connections. Couldn't stop it conventionally, either; only kill -9 worked. Then the same day Apache's httpd (2.2.18, prefork, built manually) stopped responding; child processes were stuck in state and never finished, and the dispatcher didn't spawn any new ones. However in this case 'apachectl restart' worked, and defunct processes were successfully killed. With gdb attached to icecast2, I can see 6 threads running, all of them except two being inside nanosleep(). The main process seems to be stuck at 453 ret = poll(ufds, global.server_sockets, timeout); Step by step execution in gdb inside poll() have somehow unfrozen the process at least once. Any advice on what might be the issue here? There are no issues with the HDDs (or so it seems; nothing in dmesg, and SMART health assessment is "All OK"). I haven't tried to restart the server as it's really unwelcome (and I doubt it's a proper solution). I've also did "make -j8 buildworld" to see if there might be RAM issues (as buildworld usually crashes on faulty RAM). No problems, either. Thanks in advance. P.S. Please CC, I am not subscribed to this list. -- Kamigishi Rei KREI-RIPE signature.asc Description: OpenPGP digital signature
Re: gmirror / crash dumps
Anton Shterenlikht wrote: 4) I have the following in my 7-stable kernel The long and the short of it is I don't get any dumps. I read somewhere that you can't dump onto a gmirror device. That is incorrect, but I don't know the cause of your problem. I run nothing but gmirror and dumps happen here. I was also told that "you won't get a valid dump if your dumpdev is on a GEOM_MIRROR device" On 7.x, you have a 'legal' way to run gmirror -v prefer before savecore is run. In -current, the corresponding rc file (alas, I forgot its name) is removed. I tried adding "gmirror -v prefer /dev/mirror0" to savecore rc.d file, but to no such luck. The problem here is the order of startup for the drives inside the mirror; the first drive in the array that started during the boot when the panic occurred has to be the preferred device during savecore - and when this condition is met, you will get a valid dump. i.e. let's assume that the system boots like GEOM_MIRROR: Device gm0: provider ada0 detected. GEOM_MIRROR: Device gm0: provider ada0 activated. GEOM_MIRROR: Device gm0: provider ada1 detected. GEOM_MIRROR: Device gm0: provider ada1 activated. GEOM_MIRROR: Device gm0: provider mirror/mirror0 launched. This makes us think that ada0 is the first drive to launch. Therefore, it's the drive where the dump will be saved during a panic. So we add gmirror configure -v prefer /dev/mirror/mirror0 /dev/ada0 (correct my syntax if I'm wrong here; tried it a month ago) to /etc/rc.d/savecore right before the savecore call. We do stuff, configure, build kernels, rebuild 'em, etc, reboot, and the system comes up GEOM_MIRROR: Device gm0: provider ada1 detected. GEOM_MIRROR: Device gm0: provider ada1 activated. GEOM_MIRROR: Device gm0: provider ada0 detected. GEOM_MIRROR: Device gm0: provider ada0 activated. GEOM_MIRROR: Device gm0: provider mirror/mirror0 launched. without us noticing. And that's it; if it panics now, savecore won't save the crash dump because ada0 doesn't have it. -- Kamigishi Rei KREI-RIPE ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
Re: is it safe to reboot while gmirror is rebuilding?
Anton Shterenlikht wrote: On FBSD 8.0-current ia64 I've gmirror on 63GB partition, which takes quite a long time to rebuild, perhaps 30 min. Is it safe to reboot, or write to this filesystem, while it is being rebuilt (gmirror status DEGRADED) ? Doesn't matter which version it is; gmirror checkpoints the rebuild process so you can safely reboot/write/etc. -- Kamigishi Rei KREI-RIPE ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
