Hi Jeff,
Yes zfs modules are there - at least, I can see the zpools okay.
But, dkms status reports:
lustre-zfs, 2.12.3, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed
(WARNING! Diff between built and installed module!) (WARNING! Diff between
built and installed module!) (WARNING! Diff between built and installed
module!) (WARNING! Diff between built and installed module!) (WARNING!
Diff between built and installed module!)
spl, 0.7.13, 3.10.0-1062.9.1.el7.x86_64, x86_64: installed
spl, 0.7.13, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed
zfs, 0.7.13, 3.10.0-1062.9.1.el7.x86_64, x86_64: installed
zfs, 0.7.13, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed
So it would seem there might be problems somehwere (though I've just
checked on an older 7.6 system which is working, and that also gives the
same warnings).
Seems to be a problem with the osd-zfs module not loading.
Cheers,
Alastair.
On Mon, 1 Jun 2020, Jeff Johnson wrote:
Alastair,
Are you sure you have functioning ZFS modules for that kernel, and that
they are loaded? Are you able to see your zpools? Did you use DKMS for
either ZFS, Lustre or both? If so, what does `dkms status` report?
--Jeff
On Mon, Jun 1, 2020 at 4:21 PM Alastair Basden <a.g.bas...@durham.ac.uk>
wrote:
Hi,
We have just upgraded Lustre servers from 2.12.2 on centos 7.6 to 2.12.3
on centos 7.7.
The OSSs are on top of zfs (0.7.13 as recommended), and we are using
3.10.0-1062.1.1.el7_lustre.x86_64
After the update, Lustre will no longer mount - and messages such as:
Jun 2 00:02:44 hostname kernel: LustreError: 158-c: Can't load module
'osd-zfs'
Jun 2 00:02:44 hostname kernel: LustreError: Skipped 875 previous similar
messages
Jun 2 00:02:44 hostname kernel: LustreError:
226253:0:(genops.c:397:class_newdev()) OBD: unknown type: osd-zfs
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_config.c:403:class_attach()) Cannot create device
lustfs-OST0006-osd of type osd-zfs : -19
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_config.c:403:class_attach()) Skipped 881 previous similar
messages
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:197:lustre_start_simple()) lustfs-OST0006-osd attach
error -19
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:197:lustre_start_simple()) Skipped 881 previous
similar messages
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount_server.c:1947:server_fill_super()) Unable to start osd
on lustfs-ost6/ost6: -19
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount_server.c:1947:server_fill_super()) Skipped 881 previous
similar messages
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount (-19)
Jun 2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:1608:lustre_fill_super()) Skipped 881 previous
similar messages
Jun 2 00:02:44 hostname kernel: LustreError:
226253:0:(genops.c:397:class_newdev()) Skipped 887 previous similar messages
Does anyone have any ideas?
Thanks,
Alastair.
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
--
------------------------------
Jeff Johnson
Co-Founder
Aeon Computing
jeff.john...@aeoncomputing.com
www.aeoncomputing.com
t: 858-412-3810 x1001 f: 858-412-3845
m: 619-204-9061
4170 Morena Boulevard, Suite C - San Diego, CA 92117
High-Performance Computing / Lustre Filesystems / Scale-out Storage
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org