Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-15 Thread Anjana Kar
I'd like to report that we've had success in setting up an ldiskfs MDT and zfs OSTs on a single node with the version lustre 2.4 g1cff80a. Something must have been fixed/changed in this tree since the install steps didn't change as far as I can tell. Also, I was making rpms from spl and zfs sour

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-09 Thread Thomas Stibor
Hello Anjana, I can confirm that this setup works (ZFS-MGS/MDT or LDFISKFS-MGS/MDT and ZFS-OSS/OST) I used a Cent OS 6.4 build: 2.4.0-RC2-gd3f91c4-PRISTINE-2.6.32-358.6.2.el6_lustre.g230b174.x86_64 and the Lustre Packages from http://downloads.whamcloud.com/public/lustre/latest-feature-release/e

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-08 Thread Ned Bass
On Tue, Oct 08, 2013 at 11:40:30AM -0400, Anjana Kar wrote: > The git checkout was on Sep. 20. Was the patch before or after? The bug was introduced on Sep. 10 and reverted on Sep. 24, so you hit the lucky window. :) > The zpool create command successfully creates a raidz2 pool, and mkfs.lustre

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-08 Thread Scott Nolin
I would check to make sure your ldev.conf file is set up with the lustre-ost0 and host name properly. Scott On 10/8/2013 10:40 AM, Anjana Kar wrote: The git checkout was on Sep. 20. Was the patch before or after? The zpool create command successfully creates a raidz2 pool, and mkfs.lustre doe

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-08 Thread Anjana Kar
The git checkout was on Sep. 20. Was the patch before or after? The zpool create command successfully creates a raidz2 pool, and mkfs.lustre does not complain, but [root@cajal kar]# zpool list NAME SIZE ALLOC FREECAP DEDUP HEALTH ALTROOT lustre-ost0 36.2T 2.24M 36.2T 0%

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Ned Bass
I'm guessing your git checkout doesn't include this commit: * 010a78e Revert "LU-3682 tunefs: prevent tunefs running on a mounted device" It looks like the LU-3682 patch introduced a bug that could cause your issue, so its reverted in the latest master. Ned On Mon, Oct 07, 2013 at 04:54:13PM -0

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Anjana Kar
On 10/07/2013 04:27 PM, Ned Bass wrote: > On Mon, Oct 07, 2013 at 02:23:32PM -0400, Anjana Kar wrote: >> Here is the exact command used to create a raidz2 pool with 8+2 drives, >> followed by the error messages: >> >> mkfs.lustre --fsname=cajalfs --reformat --ost --backfstype=zfs >> --index=0 --mgs

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Ned Bass
On Mon, Oct 07, 2013 at 02:23:32PM -0400, Anjana Kar wrote: > Here is the exact command used to create a raidz2 pool with 8+2 drives, > followed by the error messages: > > mkfs.lustre --fsname=cajalfs --reformat --ost --backfstype=zfs > --index=0 --mgsnode=10.10.101.171@o2ib lustre-ost0/ost0 raidz

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Scott Nolin
Ned Here is the exact command used to create a raidz2 pool with 8+2 drives, followed by the error messages: mkfs.lustre --fsname=cajalfs --reformat --ost --backfstype=zfs --index=0 --mgsnode=10.10.101.171@o2ib lustre-ost0/ost0 raidz2 /dev/sda /dev/sdc /dev/sde /dev/sdg /dev/sdi /dev/sdk /dev/

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Jeff Johnson
On 10/7/13 11:23 AM, Anjana Kar wrote: > Here is the exact command used to create a raidz2 pool with 8+2 drives, > followed by the error messages: > > mkfs.lustre --fsname=cajalfs --reformat --ost --backfstype=zfs --index=0 > --mgsnode=10.10.101.171@o2ib lustre-ost0/ost0 raidz2 /dev/sda /dev/sdc >

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Anjana Kar
On 10/07/2013 01:48 PM, Ned Bass wrote: > On Mon, Oct 07, 2013 at 06:09:21AM -0400, Anjana Kar wrote: >> Is it possible to configure the MDT as ldiskfs and the OSTs with zfs >> in lustre 2.4? The server is running a lustre kernel on a Centos 6.4 >> system, has both lustre-osd-ldiskfs and lustre-osd

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Ned Bass
On Mon, Oct 07, 2013 at 06:09:21AM -0400, Anjana Kar wrote: > Is it possible to configure the MDT as ldiskfs and the OSTs with zfs > in lustre 2.4? The server is running a lustre kernel on a Centos 6.4 > system, has both lustre-osd-ldiskfs and lustre-osd-zfs rpms installed. > The MDT is up as ldisk

Re: [Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Dilger, Andreas
In theory this should be possible, but we have not tested this for a long time since it isn't a configuration that is common. Note that you need to configure the OST on a separate node from the MDT in this case. We have not implemented the ability to have multiple OSD types on the same node. I

[Lustre-discuss] ldiskfs for MDT and zfs for OSTs?

2013-10-07 Thread Anjana Kar
Is it possible to configure the MDT as ldiskfs and the OSTs with zfs in lustre 2.4? The server is running a lustre kernel on a Centos 6.4 system, has both lustre-osd-ldiskfs and lustre-osd-zfs rpms installed. The MDT is up as ldiskfs, but get an error trying to configure the ost: mkfs.lustre --fsn