Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Zeeshan Ali Shah
Thanks a lot Mark and Cory and Peter. we moved to single FS with nodemap... /Zee On Fri, Jun 29, 2018 at 2:17 AM, Cory Spitz wrote: > Oops, right! Mark, thanks for pointing that out. Peter, thanks for the > update on ZFS 0.8. > -Cory > > -- > > On 6/28/18, 5:20 PM, "Peter Jones" wrote: > >

Re: [lustre-discuss] lctl ping node28@o2ib report Input/output error

2018-06-28 Thread Andreas Dilger
On Jun 28, 2018, at 21:14, yu sun wrote: > > all server and client that fore-mentioned is using netmasks 255.255.255.224. > and they can ping with each other, for example: > > root@ml-gpu-ser200.nmg01:~$ ping node28 > PING node28 (10.82.143.202) 56(84) bytes of data. > 64 bytes from node28 (10

Re: [lustre-discuss] Not able to load lustre modules on Lustre client

2018-06-28 Thread Andreas Dilger
On Jun 28, 2018, at 22:44, vaibhav pol wrote: > > Hi, > > I am using the precompiled rpms from site > (https://downloads.whamcloud.com/public/lustre/lustre-2.11.0/el7.4.1708/). > Modprobe is not able to find the lnet module . Tried to insert using insmod. > Following is the error message. >

Re: [lustre-discuss] Not able to load lustre modules on Luster client

2018-06-28 Thread vaibhav pol
Hi, I am using the precompiled rpms from site (https://downloads.whamcloud.com/public/lustre/lustre-2.11.0/el7.4.1708/). Modprobe is not able to find the lnet module . Tried to insert using insmod. Following is the error message. cfs_array_alloc (err 0) cfs_get_random_bytes (err 0) cfs_expr_

Re: [lustre-discuss] Not able to load lustre modules on Luster client

2018-06-28 Thread Andreas Dilger
It would be useful to include the actual error messages, in particular which module symbols it is complaining about. Cheers, Andreas On Jun 28, 2018, at 22:01, vaibhav pol wrote: > > Hi, >I have installed the Lustre client RPMS (Version 2.11.0) on CentOS 7.4 > > Whenever I tried

[lustre-discuss] Not able to load lustre modules on Luster client

2018-06-28 Thread vaibhav pol
Hi, I have installed the Lustre client RPMS (Version 2.11.0) on CentOS 7.4 Whenever I tried to insert lnet module it give the unknown symbol message and not able to load modules. Tried to insert forcefully but that is also not working. Thanks and regards, Vaibhav

Re: [lustre-discuss] lctl ping node28@o2ib report Input/output error

2018-06-28 Thread yu sun
all server and client that fore-mentioned is using netmasks 255.255.255.224. and they can ping with each other, for example: root@ml-gpu-ser200.nmg01:~$ ping node28 PING node28 (10.82.143.202) 56(84) bytes of data. 64 bytes from node28 (10.82.143.202): icmp_seq=1 ttl=61 time=0.047 ms 64 bytes fro

Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Cory Spitz
Oops, right! Mark, thanks for pointing that out. Peter, thanks for the update on ZFS 0.8. -Cory -- On 6/28/18, 5:20 PM, "Peter Jones" wrote: Correct. ZFS 0.8 will provide the necessary changes in the underlying ZFS. On 2018-06-28, 3:10 PM, "lustre-discuss on behalf of Mark Hah

Re: [lustre-discuss] SSK configuration

2018-06-28 Thread Andreas Dilger
On Jun 27, 2018, at 06:05, Mark Roper wrote: > > Hi Jeremy & All, > I got a request to share the results of my SSK performance investigation with > this group from Mark Hahn, which I'm happy to do! If you're not interested > in the impact on throughput for encryption of client-to-mds and clien

Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Peter Jones
Correct. ZFS 0.8 will provide the necessary changes in the underlying ZFS. On 2018-06-28, 3:10 PM, "lustre-discuss on behalf of Mark Hahn" wrote: > FYI, Project Quotas exist beginning with Lustre 2.10.0. but not yet for ZFS configs, right? sorry, I don't remember whether the

Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Mark Hahn
FYI, Project Quotas exist beginning with Lustre 2.10.0. but not yet for ZFS configs, right? sorry, I don't remember whether the OP mentioned which underfilesystem they were using... ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org htt

Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Cory Spitz
> Lustre's current/traditional owner-based quota accounting > is a bit of a drag, but eventually there will be project quotas... FYI, Project Quotas exist beginning with Lustre 2.10.0. Info is in the Lustre Ops Manual at http://doc.lustre.org/lustre_manual.xhtml#idm140687075905776. -Cory --

Re: [lustre-discuss] lctl ping node28@o2ib report Input/output error

2018-06-28 Thread Mohr Jr, Richard Frank (Rick Mohr)
> On Jun 27, 2018, at 4:44 PM, Mohr Jr, Richard Frank (Rick Mohr) > wrote: > > >> On Jun 27, 2018, at 3:12 AM, yu sun wrote: >> >> client: >> root@ml-gpu-ser200.nmg01:~$ mount -t lustre >> node28@o2ib1:node29@o2ib1:/project /mnt/lustre_data >> mount.lustre: mount node28@o2ib1:node29@o2ib1:/

Re: [lustre-discuss] what is fsname used for ? and how to get role based security ?

2018-06-28 Thread Andreas Dilger
For #3 you should look at "nodemap" and "subdirectory mount" in the manual. I agree that simple user permissions should be the starting point, but if you need more complete isolation (eg. if users are in charge of VM images), then the following presentation will be useful: http://wiki.lustre.org/i

Re: [lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Mark Hahn
we have different research groups i am thinking to have one filesystem and beneath it using ACL have project folders . well, the first approach should be to use the normal Unix mechanism: owners and groups. ACLs are usually treated as a way to make exceptions, since owner/group will capture m

Re: [lustre-discuss] New accounts in Jira?

2018-06-28 Thread Cory Spitz
All, Be advised that you if you had a previous working account with Intel HPDD, there is no need to sign up for a new one. You can use the exact same credentials you used with http://jira.hpdd.intel.com. -Cory -- From: lustre-discuss on behalf of "Moreno Diego (ID SIS)" Date: Thursday,

Re: [lustre-discuss] lctl ping node28@o2ib report Input/output error

2018-06-28 Thread Patrick Farrell
It seems expensive (straight mirroring rather than parity’s) and it’s asynchronous from Lustre, so if you’re really just syncing the block devices, that can’t guarantee safety on failure. If I understand what you’re doing, when a failure occurs, drbd may be in the middle of syncing the block d

Re: [lustre-discuss] New accounts in Jira?

2018-06-28 Thread Peter Jones
Diego Free sign up got restricted some months ago after a series of spam attacks on the wiki (which shares login credentials with JIRA). I’ll see about getting the message updated – in the meantime I will reach out to you privately to get this sorted out. Peter From: lustre-discuss on behalf

[lustre-discuss] multiple filesystem in MGS vs folder based ACL ? prons /cons

2018-06-28 Thread Zeeshan Ali Shah
we have different research groups i am thinking to have one filesystem and beneath it using ACL have project folders . Just curious what re the pros/cons of having multiple filesystem vs single filesystem with folders ? any advice ? /Zeeshan ___ lustre

Re: [lustre-discuss] what is fsname used for ? and how to get role based security ?

2018-06-28 Thread Zeeshan Ali Shah
Found the answers: http://doc.lustre.org/lustre_manual.xhtml#dbdoclet.50438194_88063 http://doc.lustre.org/lustre_manual.xhtml#managingsecurity Thanks for manual :) /Zee On Thu, Jun 28, 2018 at 12:48 AM Zeeshan Ali Shah wrote: > Dear All, > During mdt it ask for --fsname flag , docs mentioned