[lustre-discuss] ZFS and multipathing for OSTs

[Kurt Strosahl]

Good Afternoon,


As part of a new lustre deployment I've now got two disk shelves connected 
redundantly to two servers.  Since each disk has two paths to the server I'd 
like to use multipathing for both redundancy and improved performance.  I 
haven't found examples or discussion about such a setup, and was wondering if 
there are any resources out there that I could consult.


Of particular interest would be examples of the /etc/zfs/vdev_id.conf and any 
tuning that was done.  I'm also wondering about extra steps that may have to be 
taken when doing a disk replacement to account for the multipathing.  I've got 
plenty of time to experiment with this process, but I'd rather not reinvent the 
wheel if I don't have to.


w/r,

Kurt J. Strosahl
System Administrator: Lustre, HPC
Scientific Computing Group, Thomas Jefferson National Accelerator Facility
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] State of arm client?

[Andreas Dilger]

The older Pi boards are also 64-bit CPUs, but the problem is that Raspbian is 
only compiled with 32-bit kernels.  I was recently testing this, and for 
Raspbian you will need at least the tip of b2_12, or 2.12.1 in order to compile.

I compiled 2.12.1-rc on my 32-bit Raspbian. This mostly works, but there is a 
bug in readdir() handling for large dirs, which means that it will return the 
same entries over and over again, but eventually completes (possibly minutes 
later).  This is caused by userspace calling readdir64() on a 32-bit kernel and 
Lustre is confused with its 32-bit compatibility.

I haven't had any chance to look into this in more detail, especially since I 
don't think anyone else is running 32-bit clients. So, in summary, Raspbian is 
_almost_ usable, but using a 64-bit kernel is just a lot easier.

Cheers, Andreas

On Apr 25, 2019, at 15:46, Patrick Farrell 
mailto:pfarr...@whamcloud.com>> wrote:

Also, you’ll need (I think?) fairly new Pis - Lustre only supports ARM64 and 
older ones were 32 bit.

- Patrick

From: lustre-discuss 
mailto:lustre-discuss-boun...@lists.lustre.org>>
 on behalf of Peter Jones mailto:pjo...@whamcloud.com>>
Sent: Wednesday, April 24, 2019 11:08:38 PM
To: Andrew Elwell; 
lustre-discuss@lists.lustre.org
Subject: Re: [lustre-discuss] State of arm client?


Andrew



You will need to use 2.12.x (and 2.12.1 is in final release testing so would be 
a good bet if you can wait a short while)



Peter



From: lustre-discuss 
mailto:lustre-discuss-boun...@lists.lustre.org>>
 on behalf of Andrew Elwell 
mailto:andrew.elw...@gmail.com>>
Date: Wednesday, April 24, 2019 at 7:31 PM
To: "lustre-discuss@lists.lustre.org" 
mailto:lustre-discuss@lists.lustre.org>>
Subject: [lustre-discuss] State of arm client?



Hi folks,



I remember seeing a press release by DDN/Whamcloud last November that they were 
going to support ARM, but can anyone point me to the current state of client?



I'd like to deploy it onto a raspberry pi cluster (only 4-5 nodes) ideally on 
raspbian for demo / training purposes. (Yes I know it won't *quite* be 
infiniband performance, but as it's hitting a VM based set of lustre servers, 
that's the least of my worries). Ideally 2.10.x, but I'd take a 2.12 client if 
it can talk to 2.10.x servers





Many thanks

Andrew

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] State of arm client?

[Patrick Farrell]

Also, you’ll need (I think?) fairly new Pis - Lustre only supports ARM64 and 
older ones were 32 bit.

- Patrick

From: lustre-discuss  on behalf of 
Peter Jones 
Sent: Wednesday, April 24, 2019 11:08:38 PM
To: Andrew Elwell; lustre-discuss@lists.lustre.org
Subject: Re: [lustre-discuss] State of arm client?


Andrew



You will need to use 2.12.x (and 2.12.1 is in final release testing so would be 
a good bet if you can wait a short while)



Peter



From: lustre-discuss  on behalf of 
Andrew Elwell 
Date: Wednesday, April 24, 2019 at 7:31 PM
To: "lustre-discuss@lists.lustre.org" 
Subject: [lustre-discuss] State of arm client?



Hi folks,



I remember seeing a press release by DDN/Whamcloud last November that they were 
going to support ARM, but can anyone point me to the current state of client?



I'd like to deploy it onto a raspberry pi cluster (only 4-5 nodes) ideally on 
raspbian for demo / training purposes. (Yes I know it won't *quite* be 
infiniband performance, but as it's hitting a VM based set of lustre servers, 
that's the least of my worries). Ideally 2.10.x, but I'd take a 2.12 client if 
it can talk to 2.10.x servers





Many thanks

Andrew
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org