Hi Akemi, FYI, fix was to de-install kmod-drbd90-9.1.15 and reinstall kmod-drbd90-9.1.14-4 which got my primary and backup server up and running again.
$ lsmod | grep drbd drbd_transport_tcp 28672 1 drbd 667648 2 drbd_transport_tcp libcrc32c 16384 3 bnx2x,xfs,drbd Original issue might have been in the upgrade process to kmod-drbd90-9.1.15?? Best, Nigel Nigel Phillips | IT Consultant Tel: (+353) 86 6057580 Skype: live:nigel_2260 www.ntalk.ie | ni...@ntalk.ie ----- Original Message ----- From: "Akemi Yagi" <tora...@elrepo.org> To: "Nigel Phillips" <ni...@ntalk.ie> Cc: "drbd-user" <drbd-user@lists.linbit.com> Sent: Sunday, 18 June, 2023 21:25:02 Subject: Re: [DRBD-user] ELRepo's kmod-drbd packages version 9.1.15 for RHEL 7, 8, and 9 are available Hi Nigel, I don't seem to be able to reproduce the issue on my test system. $ uname -r 4.18.0-477.13.1.el8_8.x86_64 $ sudo modprobe drbd (no output) $ sudo modprobe drbd_transport_tcp (no output) $ lsmod | grep drbd drbd_transport_tcp 28672 0 drbd 671744 1 drbd_transport_tcp libcrc32c 16384 3 nf_conntrack,nf_tables,drbd $ modinfo drbd | grep filename filename: /lib/modules/4.18.0-477.13.1.el8_8.x86_64/weak-updates/drbd90/drbd.ko $ modinfo drbd_transport_tcp | grep filename filename: /lib/modules/4.18.0-477.13.1.el8_8.x86_64/weak-updates/drbd90/drbd_transport_tcp.ko And dmesg shows: [450216.783241] drbd: loading out-of-tree module taints kernel. [450216.783546] drbd: module verification failed: signature and/or required key missing - tainting kernel [450216.792776] drbd: initialized. Version: 9.1.15 (api:2/proto:86-121) [450216.792779] drbd: GIT-hash: b6d225583f833dc02d3e13cd92864b30f2fd442a build by mockbuild@, 2023-06-06 13:16:29 [450216.792780] drbd: registered as block device major 147 That looks normal to me. Is there anything else I should check? Akemi On Sun, Jun 18, 2023 at 12:34 PM Nigel Phillips <ni...@ntalk.ie> wrote: > > Akemi, > > Seeing an issue with 9.1.15-1.el8_8 on update and reboot, looks like its > failing to load the drbd_transport_tcp.ko module on Alma Linux 8.8 > > $ drbdadm up r0 > r0: Failure: (172) Failed to create transport (drbd_transport_xxx module > missing?) > > Command 'drbdsetup new-peer r0 1 --_name=vmstorage3-bt --max-epoch-size=8000 > --max-buffers=8000 --sndbuf-size=8M' terminated with exit code 10 > > > $ lsmod | grep drbd > drbd 667648 1 > libcrc32c 16384 3 bnx2x,xfs,drbd > > > $ modprobe drbd_transport_tcp > modprobe: ERROR: could not insert 'drbd_transport_tcp': Invalid argument > > > $ locate drbd | grep modules > /etc/modules-load.d/drbd.conf > /usr/lib/modules/4.18.0-477.10.1.el8_8.x86_64/extra/drbd90 > /usr/lib/modules/4.18.0-477.10.1.el8_8.x86_64/extra/drbd90/drbd.ko > /usr/lib/modules/4.18.0-477.10.1.el8_8.x86_64/extra/drbd90/drbd_transport_tcp.ko > /usr/lib/modules/4.18.0-477.13.1.el8_8.x86_64/weak-updates/drbd90 > /usr/lib/modules/4.18.0-477.13.1.el8_8.x86_64/weak-updates/drbd90/drbd.ko > /usr/lib/modules/4.18.0-477.13.1.el8_8.x86_64/weak-updates/drbd90/drbd_transport_tcp.ko > > > > $ uname -r > 4.18.0-477.13.1.el8_8.x86_64 > > > dmesg > > [Sun Jun 18 20:21:22 2023] drbd r0: Starting worker thread (from drbdsetup > [2291]) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_find_path_by_addr > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_find_path_by_addr (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_get_listener > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_get_listener (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_stream_send_timed_out > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_stream_send_timed_out (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_register_transport_class > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_register_transport_class (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_should_abort_listening > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_should_abort_listening (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_put_listener > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_put_listener (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_path_event > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol drbd_path_event > (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_free_pages > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol drbd_free_pages > (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_unregister_transport_class > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_unregister_transport_class (err -22) > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: disagrees about version of > symbol drbd_alloc_pages > [Sun Jun 18 20:21:22 2023] drbd_transport_tcp: Unknown symbol > drbd_alloc_pages (err -22) > > > > > dnf update log > dnf.rpm.log:2023-06-03T21:32:54+0100 SUBDEBUG Upgrade: > drbd90-utils-9.23.1-1.el8.elrepo.x86_64 > dnf.rpm.log:2023-06-03T21:33:17+0100 SUBDEBUG Upgraded: > drbd90-utils-9.22.0-1.el8.elrepo.x86_64 > dnf.rpm.log:2023-06-03T21:33:45+0100 SUBDEBUG Upgraded: > kmod-drbd90-9.1.13-1.el8_7.elrepo.x86_64 > dnf.rpm.log:2023-06-10T21:30:09+0100 SUBDEBUG Upgrade: > kmod-drbd90-9.1.15-1.el8_8.elrepo.x86_64 > dnf.rpm.log:2023-06-10T21:30:39+0100 SUBDEBUG Upgraded: > kmod-drbd90-9.1.14-4.el8_8.elrepo.x86_64 > dnf.rpm.log:2023-06-17T09:07:23+0100 SUBDEBUG Upgrade: > drbd90-utils-9.24.0-1.el8.elrepo.x86_64 > dnf.rpm.log:2023-06-17T09:07:24+0100 SUBDEBUG Upgraded: > drbd90-utils-9.23.1-1.el8.elrepo.x86_64 > > Regards, > Nigel > > Nigel Phillips | IT Consultant > > > ----- Original Message ----- > From: "Akemi Yagi" <tora...@elrepo.org> > To: "drbd-user" <drbd-user@lists.linbit.com> > Sent: Tuesday, 6 June, 2023 20:25:20 > Subject: [DRBD-user] ELRepo's kmod-drbd packages version 9.1.15 for RHEL 7, > 8, and 9 are available > > The following kmod-drbd packages are now available from ELRepo. > > Install by running: > yum kmod-drbd9x (el9) > yum kmod-drbd90 (el7 and el8) > > el9: > kmod-drbd9x-9.1.15-1.el9_2.elrepo.x86_64.rpm > > el8: > kmod-drbd90-9.1.15-1.el8_8.elrepo.x86_64.rpm > > el7: > kmod-drbd90-9.1.15-1.el7_9.elrepo.x86_64.rpm > > If you are new to ELRepo, please see https://www.elrepo.org/ for how > to set up the repo. > > Thank you, > Akemi > _______________________________________________ > Star us on GITHUB: https://github.com/LINBIT > drbd-user mailing list > drbd-user@lists.linbit.com > https://lists.linbit.com/mailman/listinfo/drbd-user _______________________________________________ Star us on GITHUB: https://github.com/LINBIT drbd-user mailing list drbd-user@lists.linbit.com https://lists.linbit.com/mailman/listinfo/drbd-user