I also can say this procedure works fine with a little tweak to the
.spec file
for building the server packages.
It works well also with kernel 3.18.33, the latest one I tested with
Lustre/ZFS
On 24/06/16 13:15, Christopher J. Morrone wrote:
Yes, it is all a lot harder than it should be at this point. We're
slowly getting in packaging changes that should make it a little easier
in future releases. But fear not, it is doable.
There are other ways, but here is how I would do it with 2.8:
Skip the installation of the lustre-patched kernel. It is only actually
only required for ldiskfs testing these days. (If all goes well, there
will be no lustre-patched included with the Lustre 2.9 release packages)
Remove that and just use the stock CentOS 7 kernel.
Next install zfs (and its associate spl packages). You can find
pre-build binary or DKMS packages here:
https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS
Or you can compile them yourself using the instructions here:
https://github.com/zfsonlinux/zfs/wiki/Custom-Packages
We are going to compile lustre next, so you will also need to install
the following zfs development packages:
libzfs2-devel kmod-zfs-devel kmod-spl-devel.
Next download the lustre source rpm from here:
https://downloads.hpdd.intel.com/public/lustre/lustre-2.8.0/el7/server/SRPMS/
The package name is
"lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm", which makes it
seem like you have to have that specific kernel. But don't worry, that
was just an artifact of the old, broken packaging system. We are hoping
to fix that before the Lustre 2.9 is released.
Next you should be able to generate binary lustre rpms with this command:
rpmbuild --rebuild --with zfs --without ldiskfs
lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm
I am just guessing that you don't need ldiskfs since you are talking
about zfs. You can decide if you want to compile it or not.
If you hit any problems let us know. Maybe we'll use this discussion to
work up a new page of documentation in the wiki.
Chris
On 06/24/2016 07:48 AM, Yu Chen wrote:
Hello,
I am new to lustre system. Was trying to setup a lustre on Centos 7 with
zfs.
When came to the step to start lustre.service from systemctl, got the
errors:
....
-------
osd_zfs: disagrees about version of symbol dmu_objset_space
osd_zfs: Unknown symbol dmu_objset_space (err -22)
------
LustreError: 158-c: Can't load module 'osd-zfs'
LustreError: 48041:0:(genops.c:318:class_newdev()) OBD: unknown type:
osd-zfs
.....
Here is what I have done:
* I installed kernel-3.10.0-327.3.1.el7_lustre.x86_64,
* Then configured and installed zfs from archive.zfsonlinux.org
<http://archive.zfsonlinux.org>(0.6.5.7-1)
* Then downloaded and installed lustre rpms from el7.2.1511 from:
https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/
* Then *zpool*create mdt01-pool /dev/sdb
* mkfs.lustre --reformat --fsname=lustre01 --mgs --mdt
--backfstype=zfs --index=0 --mgsnode=10.1.12.1@o2ib
--servicenode=10.1.12.1@o2ib mdt01-pool/mgsmdt01
* echo "mds1 - lustre01-MDT0000 zfs:mdt01-pool/mgsmdt01" > /etc/ldev.conf
* echo "options lnet networks=o2ib(ib0)" > /etc/modprobe.d/lustre.conf
* systemctl start lustre.service
This is where it failed.
Then I think it might be because of the zfs version. So downloaded
lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm, and tried to
rebuild from it. But after rebuilding, there were no lustre-osd-zfs and
lustre-osd-zfs-mount rpms?
Would greatly appreciate any suggestions!
Thanks in advance!
yc
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
