On Wed, 13 Oct 2021 10:58:34 +0200 =?UTF-8?Q?Bernhard_=c3=9cbelacker?=
<bernha...@mailbox.org> wrote:
> On Tue, 28 Sep 2021 15:01:22 +0200 uninsubria.it
<netmon.notificat...@uninsubria.it> wrote:
>
> > example from 'dmesg' output:
> > [Tue Sep 28 11:05:22 2021] omshell[4604]: segfault at 0 ip
000055623cdd06dc sp 00007ffd5a2c7c78 error 4 in omshell[55623cd97000+45000]
> >
>
>
> Hello,
> maybe you can add a few pairs of the
> dmesg "segfault" and "code" lines.
> This would make it possible to locate the crashing instruction,
> and therefore maybe point to a source code line.
>
> Kind regards,
> Bernhard
>
>
Hi,
Fortunately our Rsyslog has some logs of the problem when it happened
2-3 weeks ago.
It happened after migrating from Debian10 to Debian11 on our DHCPD
production servers, so I had to rollback to the Deb10 snapshots to
restore functionality.
If it's needed, I can try to recreate a testing environment with the 2
servers having dhcpd failover partnership and see if the problem happens
without dhcpd clients (or very few of them).
Thanks for your attention.
*DHCPD-SERVER1*
daemon.err-20210924.log.gz:Sep 24 15:24:01 Sep 24 15:24:01 $hostname1
omshell[15957]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 15:24:01 Sep 24 15:24:01 $hostname1
omshell[15957]: Object 55b8caa695d0 io
daemon.err-20210924.log.gz:Sep 24 16:01:51 Sep 24 16:01:51 $hostname1
omshell[5643]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 16:01:51 Sep 24 16:01:51 $hostname1
omshell[5643]: Object 564b87a855d0 io
daemon.err-20210924.log.gz:Sep 24 18:42:36 Sep 24 18:42:36 $hostname1
omshell[24902]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 18:42:36 Sep 24 18:42:36 $hostname1
omshell[24902]: Object 55db2d44e5d0 io
daemon.err-20210924.log.gz:Sep 24 22:05:42 Sep 24 22:05:42 $hostname1
omshell[48864]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 22:05:43 Sep 24 22:05:42 $hostname1
omshell[48864]: Object 55df88ace5d0 io
daemon.err-20210925.log.gz:Sep 25 07:14:13 Sep 25 07:14:13 $hostname1
omshell[113565]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 07:14:13 Sep 25 07:14:13 $hostname1
omshell[113565]: Object 5610441a65d0 io
daemon.err-20210925.log.gz:Sep 25 07:24:19 Sep 25 07:24:18 $hostname1
omshell[114622]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 07:24:19 Sep 25 07:24:18 $hostname1
omshell[114622]: Object 55bd6a3b95d0 io
daemon.err-20210925.log.gz:Sep 25 10:36:24 Sep 25 10:36:24 $hostname1
omshell[137283]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 10:36:24 Sep 25 10:36:24 $hostname1
omshell[137283]: Object 55bcd68a55d0 io
daemon.err-20210925.log.gz:Sep 25 18:11:45 Sep 25 18:11:45 $hostname1
omshell[190235]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 18:11:45 Sep 25 18:11:45 $hostname1
omshell[190235]: Object 55cf7d0525d0 io
daemon.err-20210926.log.gz:Sep 26 04:22:52 Sep 26 04:22:52 $hostname1
omshell[262070]: Bad descriptor 8.
daemon.err-20210926.log.gz:Sep 26 06:44:17 Sep 26 06:44:17 $hostname1
omshell[279284]: Bad descriptor 8.
daemon.err-20210926.log.gz:Sep 26 06:44:17 Sep 26 06:44:17 $hostname1
omshell[279284]: Object 5611e3e6c5d0 io
daemon.err-20210926.log.gz:Sep 26 08:05:27 Sep 26 08:05:27 $hostname1
omshell[289631]: Bad descriptor 8.
daemon.err-20210926.log.gz:Sep 26 08:05:27 Sep 26 08:05:27 $hostname1
omshell[289631]: Object 557af2d875d0 io
daemon.err-20210926.log.gz:Sep 26 14:10:49 Sep 26 14:10:49 $hostname1
omshell[332719]: Bad descriptor 8.
daemon.err-20210926.log.gz:Sep 26 14:10:49 Sep 26 14:10:49 $hostname1
omshell[332719]: Object 55f9db1c05d0 io
daemon.err-20210927.log.gz:Sep 27 02:10:08 Sep 27 02:10:08 $hostname1
omshell[417339]: Bad descriptor 8.
daemon.err-20210927.log.gz:Sep 27 02:10:08 Sep 27 02:10:08 $hostname1
omshell[417339]: Object 55a1fa8085d0 io
daemon.err-20210928.log.gz:Sep 28 13:56:06 Sep 28 13:56:05 $hostname1
omshell[19675]: <STDIN> line 1: unknown token: obj
daemon.err-20210928.log.gz:Sep 28 13:56:06 Sep 28 13:56:05 $hostname1
omshell[19675]: obj:
daemon.err-20210928.log.gz:Sep 28 13:56:06 Sep 28 13:56:05 $hostname1
omshell[19675]: ^
daemon.err-20210928.log.gz:Sep 28 13:56:25 Sep 28 13:56:25 $hostname1
omshell[20427]: <STDIN> line 1: unknown token: obj
daemon.err-20210928.log.gz:Sep 28 13:56:25 Sep 28 13:56:25 $hostname1
omshell[20427]: obj:
daemon.err-20210928.log.gz:Sep 28 13:56:25 Sep 28 13:56:25 $hostname1
omshell[20427]: ^
kern.info-20210924.log.gz:Sep 24 15:24:01 Sep 24 15:24:01 $hostname1
kernel: [1726104.115073] omshell[15957]: segfault at 0 ip
000055b8c9f4b6dc sp 00007ffff4281c78 error 4 in omshell[55b8c9f12000+45000]
kern.info-20210924.log.gz:Sep 24 16:01:51 Sep 24 16:01:51 $hostname1
kernel: [ 2073.362145] omshell[5643]: segfault at 0 ip 0000564b861f26dc
sp 00007ffffb22d868 error 4 in omshell[564b861b9000+45000]
kern.info-20210924.log.gz:Sep 24 18:42:36 Sep 24 18:42:36 $hostname1
kernel: [11718.391350] omshell[24902]: segfault at 0 ip 000055db2c85d6dc
sp 00007ffcfd1c2ee8 error 4 in omshell[55db2c824000+45000]
kern.info-20210924.log.gz:Sep 24 22:05:43 Sep 24 22:05:42 $hostname1
kernel: [23904.569555] omshell[48864]: segfault at 0 ip 000055df87bd16dc
sp 00007ffcc8c9cf68 error 4 in omshell[55df87b98000+45000]
kern.info-20210925.log.gz:Sep 25 02:19:58 Sep 25 02:19:58 $hostname1
kernel: [39160.160592] isc-worker0000[78519]: segfault at f ip
000055d529cf055d sp 00007fc819a7ede0 error 4 in omshell[55d529cb9000+45000]
kern.info-20210925.log.gz:Sep 25 07:14:13 Sep 25 07:14:13 $hostname1
kernel: [56815.613296] omshell[113565]: segfault at 0 ip
000056104349b6dc sp 00007ffc8c53d518 error 4 in omshell[561043462000+45000]
kern.info-20210925.log.gz:Sep 25 07:24:19 Sep 25 07:24:18 $hostname1
kernel: [57420.722577] omshell[114622]: segfault at 0 ip
000055bd685bc6dc sp 00007ffc5e8c79a8 error 4 in omshell[55bd68583000+45000]
kern.info-20210925.log.gz:Sep 25 10:36:24 Sep 25 10:36:24 $hostname1
kernel: [68945.901017] omshell[137283]: segfault at 0 ip
000055bcd60c76dc sp 00007ffd97009998 error 4 in omshell[55bcd608e000+45000]
kern.info-20210925.log.gz:Sep 25 18:11:45 Sep 25 18:11:45 $hostname1
kernel: [96267.824241] omshell[190235]: segfault at 0 ip
000055cf7ca096dc sp 00007fff37ea42e8 error 4 in omshell[55cf7c9d0000+45000]
kern.info-20210925.log.gz:Sep 25 22:48:12 Sep 25 22:48:12 $hostname1
kernel: [112853.958355] isc-worker0000[222986]: segfault at 150000000f
ip 0000556f9b4a555d sp 00007fd6b5ba2de0 error 4 in
omshell[556f9b46e000+45000]
kern.info-20210926.log.gz:Sep 26 06:44:17 Sep 26 06:44:17 $hostname1
kernel: [141419.477209] omshell[279284]: segfault at 0 ip
00005611e33556dc sp 00007ffcdd1ac6e8 error 4 in omshell[5611e331c000+45000]
kern.info-20210926.log.gz:Sep 26 08:05:27 Sep 26 08:05:27 $hostname1
kernel: [146290.010224] omshell[289631]: segfault at 0 ip
0000557af0e726dc sp 00007ffc2ad29bb8 error 4 in omshell[557af0e39000+45000]
kern.info-20210926.log.gz:Sep 26 08:56:08 Sep 26 08:56:08 $hostname1
kernel: [149330.555500] isc-worker0000[295696]: segfault at f ip
0000556c1de7455d sp 00007fb11b895de0 error 4 in omshell[556c1de3d000+45000]
kern.info-20210926.log.gz:Sep 26 10:37:33 Sep 26 10:37:33 $hostname1
kernel: [155415.263114] isc-worker0000[307829]: segfault at 4 ip
0000564b0b614446 sp 00007fa959e6ac10 error 4 in omshell[564b0b5d5000+45000]
kern.info-20210926.log.gz:Sep 26 11:59:33 Sep 26 11:59:33 $hostname1
kernel: [160335.872389] isc-worker0000[317285]: segfault at f ip
000055fc36bec55d sp 00007f047a4c0de0 error 4 in omshell[55fc36bb5000+45000]
kern.info-20210926.log.gz:Sep 26 14:10:49 Sep 26 14:10:49 $hostname1
kernel: [168212.057212] omshell[332719]: segfault at 0 ip
000055f9d90876dc sp 00007fff40d1bad8 error 4 in omshell[55f9d904e000+45000]
kern.info-20210926.log.gz:Sep 26 17:44:31 Sep 26 17:44:31 $hostname1
kernel: [181033.431549] isc-worker0000[357808]: segfault at f ip
000055b17361855d sp 00007f8607a84de0 error 4 in omshell[55b1735e1000+45000]
kern.info-20210927.log.gz:Sep 27 02:10:08 Sep 27 02:10:08 $hostname1
kernel: [211370.968127] omshell[417339]: segfault at 0 ip
000055a1f8f3b6dc sp 00007fffeccbd5b8 error 4 in omshell[55a1f8f02000+45000]
kern.info-20210927.log.gz:Sep 27 08:14:44 Sep 27 08:14:44 $hostname1
kernel: [233247.283794] isc-worker0000[460384]: segfault at 4 ip
0000564d0205c446 sp 00007f3ef5386c10 error 4 in omshell[564d0201d000+45000]
*DHCPD-SERVER2*
daemon.err-20210924.log.gz:Sep 24 17:21:44 Sep 24 17:21:44 $hostname2
omshell[51200]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 17:21:44 Sep 24 17:21:44 $hostname2
omshell[51200]: Object 561e5f9da5d0 io
daemon.err-20210924.log.gz:Sep 24 19:43:49 Sep 24 19:43:49 $hostname2
omshell[68010]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 19:43:49 Sep 24 19:43:49 $hostname2
omshell[68010]: Object 55887953c5d0 io
daemon.err-20210924.log.gz:Sep 24 23:38:15 Sep 24 23:38:15 $hostname2
omshell[95434]: Bad descriptor 8.
daemon.err-20210924.log.gz:Sep 24 23:38:15 Sep 24 23:38:15 $hostname2
omshell[95434]: Object 55ba47b985d0 io
daemon.err-20210925.log.gz:Sep 25 02:41:15 Sep 25 02:41:15 $hostname2
omshell[116652]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 02:41:15 Sep 25 02:41:15 $hostname2
omshell[116652]: Object 5580d59395d0 io
daemon.err-20210925.log.gz:Sep 25 05:47:35 Sep 25 05:47:35 $hostname2
omshell[137990]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 05:47:35 Sep 25 05:47:35 $hostname2
omshell[137990]: Object 56472ce385d0 io
daemon.err-20210925.log.gz:Sep 25 09:04:25 Sep 25 09:04:25 $hostname2
omshell[161240]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 09:04:25 Sep 25 09:04:25 $hostname2
omshell[161240]: Object 558a7a3785d0 io
daemon.err-20210925.log.gz:Sep 25 16:09:21 Sep 25 16:09:21 $hostname2
omshell[211831]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 16:09:21 Sep 25 16:09:21 $hostname2
omshell[211831]: Object 560318c115d0 io
daemon.err-20210925.log.gz:Sep 25 18:06:07 Sep 25 18:06:07 $hostname2
omshell[225562]: Bad descriptor 8.
daemon.err-20210925.log.gz:Sep 25 18:06:07 Sep 25 18:06:07 $hostname2
omshell[225562]: Object 56064b9b45d0 io
daemon.err-20210926.log.gz:Sep 26 18:59:35 Sep 26 18:59:35 $hostname2
omshell[400494]: Bad descriptor 8.
daemon.err-20210926.log.gz:Sep 26 18:59:35 Sep 26 18:59:35 $hostname2
omshell[400494]: Object 55b11bf7b710 io
daemon.err-20210926.log.gz:Sep 26 18:59:35 Sep 26 18:59:35 $hostname2
omshell[400494]: Object 55b11bf7b520 connection
daemon.err-20210928.log.gz:Sep 28 10:57:32 Sep 28 10:57:53 $hostname2
omshell[3840]: <STDIN> line 1: unknown token: q
daemon.err-20210928.log.gz:Sep 28 10:57:32 Sep 28 10:57:53 $hostname2
omshell[3840]:
daemon.err-20210928.log.gz:Sep 28 10:57:32 Sep 28 10:57:53 $hostname2
omshell[3840]: ^
daemon.err-20210928.log.gz:Sep 28 11:05:01 Sep 28 11:05:22 $hostname2
omshell[4604]: Bad descriptor 8.
daemon.err-20210928.log.gz:Sep 28 11:05:01 Sep 28 11:05:22 $hostname2
omshell[4604]: Object 55623ee035d0 io
daemon.err-20210928.log.gz:Sep 28 11:16:13 Sep 28 11:16:13 $hostname2
omshell[6253]: <STDIN> line 1: unknown token: exit
daemon.err-20210928.log.gz:Sep 28 11:16:13 Sep 28 11:16:13 $hostname2
omshell[6253]:
daemon.err-20210928.log.gz:Sep 28 11:16:13 Sep 28 11:16:13 $hostname2
omshell[6253]: ^
daemon.err-20210928.log.gz:Sep 28 11:25:40 Sep 28 11:25:40 $hostname2
omshell[7232]: <STDIN> line 1: unknown token: exit
daemon.err-20210928.log.gz:Sep 28 11:25:40 Sep 28 11:25:40 $hostname2
omshell[7232]:
daemon.err-20210928.log.gz:Sep 28 11:25:40 Sep 28 11:25:40 $hostname2
omshell[7232]: ^
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: <STDIN> line 1: eof in string constant
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: key omapi_key "83c365804fb278350d915f90952fa3aa
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: ^
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: <STDIN> line 1: invalid base64 character 10.
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: key omapi_key "83c365804fb278350d915f90952fa3aa
daemon.err-20210928.log.gz:Sep 28 11:25:50 Sep 28 11:25:50 $hostname2
omshell[7457]: ^
daemon.err-20210928.log.gz:Sep 28 12:27:48 Sep 28 12:27:48 $hostname2
omshell[18645]: <STDIN> line 1: unknown token: exit
daemon.err-20210928.log.gz:Sep 28 12:27:48 Sep 28 12:27:48 $hostname2
omshell[18645]:
daemon.err-20210928.log.gz:Sep 28 12:27:48 Sep 28 12:27:48 $hostname2
omshell[18645]: ^
daemon.err-20210928.log.gz:Sep 28 12:27:50 Sep 28 12:27:50 $hostname2
omshell[18645]: <STDIN> line 1: unknown token: quit
daemon.err-20210928.log.gz:Sep 28 12:27:50 Sep 28 12:27:50 $hostname2
omshell[18645]:
daemon.err-20210928.log.gz:Sep 28 12:27:50 Sep 28 12:27:50 $hostname2
omshell[18645]: ^
daemon.err-20210928.log.gz:Sep 28 14:19:32 Sep 28 14:19:32 $hostname2
omshell[49786]: <STDIN> line 1: unknown token: exit
daemon.err-20210928.log.gz:Sep 28 14:19:32 Sep 28 14:19:32 $hostname2
omshell[49786]:
daemon.err-20210928.log.gz:Sep 28 14:19:32 Sep 28 14:19:32 $hostname2
omshell[49786]: ^
daemon.err-20210928.log.gz:Sep 28 14:19:33 Sep 28 14:19:33 $hostname2
omshell[49786]: <STDIN> line 1: unknown token: quit
daemon.err-20210928.log.gz:Sep 28 14:19:33 Sep 28 14:19:33 $hostname2
omshell[49786]:
daemon.err-20210928.log.gz:Sep 28 14:19:33 Sep 28 14:19:33 $hostname2
omshell[49786]: ^
daemon.err-20210928.log.gz:Sep 28 15:54:08 Sep 28 15:54:08 $hostname2
omshell[61610]: <STDIN> line 1: eof in string constant
daemon.err-20210928.log.gz:Sep 28 15:54:08 Sep 28 15:54:08 $hostname2
omshell[61610]: set name = "dhcp-failover
daemon.err-20210928.log.gz:Sep 28 15:54:08 Sep 28 15:54:08 $hostname2
omshell[61610]: ^
kern.info-20210924.log.gz:Sep 24 10:42:26 Sep 24 10:42:26 $hostname2
kernel: [ 95.049245] isc-worker0000[1753]: segfault at f ip
00005561e61a855d sp 00007f9e89a25de0 error 4 in omshell[5561e6171000+45000]
kern.info-20210924.log.gz:Sep 24 17:21:44 Sep 24 17:21:44 $hostname2
kernel: [24053.419054] omshell[51200]: segfault at 0 ip 0000561e5e58b6dc
sp 00007ffe4a2e7568 error 4 in omshell[561e5e552000+45000]
kern.info-20210924.log.gz:Sep 24 19:43:49 Sep 24 19:43:49 $hostname2
kernel: [32578.322732] omshell[68010]: segfault at 0 ip 0000558878a4b6dc
sp 00007ffc6b7c5de8 error 4 in omshell[558878a12000+45000]
kern.info-20210924.log.gz:Sep 24 23:38:15 Sep 24 23:38:15 $hostname2
kernel: [46644.578133] omshell[95434]: segfault at 0 ip 000055ba46d496dc
sp 00007ffe207322c8 error 4 in omshell[55ba46d10000+45000]
kern.info-20210925.log.gz:Sep 25 02:41:15 Sep 25 02:41:15 $hostname2
kernel: [57624.594222] omshell[116652]: segfault at 0 ip
00005580d388b6dc sp 00007ffccba36598 error 4 in omshell[5580d3852000+45000]
kern.info-20210925.log.gz:Sep 25 04:57:05 Sep 25 04:57:05 $hostname2
kernel: [65774.493169] isc-worker0000[132844]: segfault at f ip
0000563a606d255d sp 00007fefc14f1de0 error 4 in omshell[563a6069b000+45000]
kern.info-20210925.log.gz:Sep 25 05:47:35 Sep 25 05:47:35 $hostname2
kernel: [68804.784942] omshell[137990]: segfault at 0 ip
000056472bca06dc sp 00007ffe99eb8b98 error 4 in omshell[56472bc67000+45000]
kern.info-20210925.log.gz:Sep 25 06:18:10 Sep 25 06:18:10 $hostname2
kernel: [70639.905566] isc-worker0000[141620]: segfault at f ip
00005603f2b4055d sp 00007fa3159bade0 error 4 in omshell[5603f2b09000+45000]
kern.info-20210925.log.gz:Sep 25 09:04:25 Sep 25 09:04:25 $hostname2
kernel: [80614.985424] omshell[161240]: segfault at 0 ip
0000558a78a7a6dc sp 00007fff9df4ba38 error 4 in omshell[558a78a41000+45000]
kern.info-20210925.log.gz:Sep 25 09:34:25 Sep 25 09:34:25 $hostname2
kernel: [82415.276674] isc-worker0000[164586]: segfault at f ip
000055ef12b0155d sp 00007fb4b4cf1de0 error 4 in omshell[55ef12aca000+45000]
kern.info-20210925.log.gz:Sep 25 16:09:22 Sep 25 16:09:21 $hostname2
kernel: [106111.475212] omshell[211831]: segfault at 0 ip
0000560317b156dc sp 00007ffdfb021528 error 4 in omshell[560317adc000+45000]
kern.info-20210925.log.gz:Sep 25 17:20:22 Sep 25 17:20:22 $hostname2
kernel: [110371.859670] isc-worker0000[220054]: segfault at f ip
000055b63700255d sp 00007f4d70571de0 error 4 in omshell[55b636fcb000+45000]
kern.info-20210925.log.gz:Sep 25 18:06:07 Sep 25 18:06:07 $hostname2
kernel: [113117.309279] omshell[225562]: segfault at 0 ip
000056064acc46dc sp 00007fffa83d6298 error 4 in omshell[56064ac8b000+45000]
kern.info-20210928.log.gz:Sep 28 11:05:01 Sep 28 11:05:22 $hostname2
kernel: [ 1458.755006] omshell[4604]: segfault at 0 ip 000055623cdd06dc
sp 00007ffd5a2c7c78 error 4 in omshell[55623cd97000+45000]
kern.info-20210928.log.gz:Sep 28 14:38:17 Sep 28 14:38:17 $hostname2
kernel: [14233.628306] omshell[52163]: segfault at fcf56f25bf0 ip
00007fc656ded717 sp 00007ffe733c09b0 error 4 in
libc-2.31.so[7fc656d8c000+14b000]
--
__________________________
Andrea Turbiglio
Università degli Studi dell’Insubria
Centro Sistemi Informativi e Comunicazione
Servizio Telecomunicazioni - Gestione Rete Dati di Ateneo
Via Valleggio, 11
22100 - COMO
tel. +39 031 238 9784
fax +39 031 238 9709
web www.uninsubria.it
mail andrea.turbig...@uninsubria.it
mail netw...@uninsubria.it
