[lustre-discuss] Anyone know why lustre-zfs-dkms-2.12.8_6_g5457c37-1.el7.noarch.rpm won't install?

Hello, I has been a while since I installed Lustre ZFS and I am working to get 2.12.8 Lustre ZFS going on a basic system. The lib* spl* and zfs* packages all install with DKMS with no issue. lustre-zfs-dkms-2.12.8_6_g5457c37-1.el7.noarch.rpm does not want to install: The root issues seems t

Re: [lustre-discuss] DNE2 settings are not propagated?

Thanks Andreas and Cory very helpful. -D will help for what I am using it for. Thanks! Keith From: Spitz, Cory James Sent: Friday, March 20, 2020 12:57 PM To: Andreas Dilger ; Mannthey, Keith Cc: lustre-discuss@lists.lustre.org; Koutoupis, Petros Subject: Re: [lustre-discuss] DNE2

[lustre-discuss] DNE2 settings are not propagated?

I am doing some work with Lustre 2.13 (Downloaded from Whamcloud) and DNE 2 there are 6 MDTs. " [root@colts52-clx01 for-test]# lfs getdirstripe TEST lmv_stripe_count: 6 lmv_stripe_offset: 1 lmv_hash_type: fnv_1a_64 mdtidx FID[seq:oid:ver] 1 [0x2c400:0x5:0x0] 5

Re: [lustre-discuss] How to guide

http://wiki.lustre.org/Main_Page has link for how 2 guides. If you are doing a bare metal Lustre OSS and VM MDS? Just for testing? If your VMs are hosting Linux you should be able to mount the Lustre namespace pretty easily. https://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix will sho

Re: [lustre-discuss] Lustre Multi-Rail on 2 Network Types

I don't MR is really the right tool for the JOB you are trying to accomplish. There are 2 was to add tcp client to an existing o2ib system. 1. Add Lnet Routers to meet the performance goals you have.I would start here it is the least invasive way and the much more documented. http://

Re: [lustre-discuss] Lustre Size Variation after formatiing

MDT with ldiskfs has a large amount of it total space pre-allocated for inodes. Standard tools don’t see this as “free space” and is very normal for free space to seem odd. I would suggest you track free inodes on an Ldiskfs MDT as it is more meaningful metric for most users. Thanks, Keith F

Re: [lustre-discuss] lnet fails to start on reboot

Are you sure the fabric is up when lnet starts at boot? Double check the order your services start and be sure Lnet waits for the fabric/network before starting. Thanks, Keith > -Original Message- > From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On > Behal

Re: [lustre-discuss] Do lustre modules detect/act on changes made to parameters

A little info on lnetctl: http://wiki.lustre.org/Dynamic_LNet_Configuration_and_lnetctl Thanks, Keith From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of E.S. Rosenberg Sent: Tuesday, February 6, 2018 11:18 AM To: Lustre discussion Subject: Re: [lustre-discuss]

Re: [lustre-discuss] error while configuring lnet

: Parag Khuraswar Cc: Mannthey, Keith ; lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] error while configuring lnet Hi Parag - I've been away from this field for awhile, but this message may be the most helpful at this point: modprobe: ERROR: could not insert 'ko2iblnd

Re: [lustre-discuss] error while configuring lnet

If you have ib0 device check dmesg for more hints on what is going wrong. Thanks, Keith From: Parag Khuraswar [mailto:para...@citilindia.com] Sent: Friday, November 10, 2017 10:59 AM To: Mannthey, Keith ; lustre-discuss@lists.lustre.org Subject: RE: [lustre-discuss] error while configuring lnet

Re: [lustre-discuss] error while configuring lnet

What are you trying to accomplish? >From below: 10.1.1.205@tcp is on 0@lo not eno1 and in general you should not need the "-if" option to delete a fabric. Try: # lnetctl net del --net tcp Can you do a normal ping over ib0? "dmesg" can sometime provide greater details ab

Re: [lustre-discuss] output of lctl list_nids

Lctl list_nids is working for me on master. I have not tried on 2.10.x. Static configuring with LNET has not been disable with Lustre as far as I know. Does dmesg show the o2ib nid being created? Does lctl ping work? Thanks, Keith From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustr

Re: [lustre-discuss] ZFS-OST layout, number of OSTs

I have seen both small and large OST work it just depends on what you want in the system (Size/Performance/Manageability). Do benchmark both as they will differ in overall performance some. L2arc read cache can help some workloads. It takes multi reads for data to be moved into the cache so s

Re: [lustre-discuss] MGS is not working in HA

Kavi, You may want to open a jira ticket with this error. It looks like the mount command is only trying only the first nid of the mount command. Jira is https://jira.hpdd.intel.com “LU” project. I have seen Lustre Servers first mount behave like this but not client mounts. It should try th

Re: [lustre-discuss] slow mounting

You might check that you have the MGS as the first nid listed on the mount ha command. Some slow mounts are due to the mount trying the MDT first and going through a timeout before mount. Thanks, Keith -Original Message- From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lus

Re: [lustre-discuss] Lustre poor performance

ter. I am running my ib0 interface in connected mode with 65520 MTU size. Any hint will be much appreciated thank you Rick On 8/18/17 9:05 AM, Mannthey, Keith wrote: I would suggest you a few other tests to help isolate where the issue might be. 1. What is the single thread &quo

Re: [lustre-discuss] Lustre poor performance

Is Selinux enabled on the client or server? Thanks, Keith -Original Message- From: Riccardo Veraldi [mailto:riccardo.vera...@cnaf.infn.it] Sent: Friday, August 18, 2017 11:31 AM To: Mannthey, Keith ; Dennis Nelson ; lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Lustre

Re: [lustre-discuss] Lustre poor performance

I would suggest you a few other tests to help isolate where the issue might be. 1. What is the single thread "DD" write speed? 2. Lnet_selfttest: Please see " Chapter 28. Testing Lustre Network Performance (LNet Self-Test)" in the Lustre manual if this is a new test for you. This will help

Re: [lustre-discuss] Install issues on 2.10.0

Host_id is for zpool double import protection. If a host id is set on a zpool (zfs does this automatically) then a HA server can't just import to pool (users have to use --force). This makes the system a lot safer from double zpool imports. Call 'genhostid' on your Lustre servers and the warni

Re: [lustre-discuss] Lustre-2.9 / ZFS-0.7.0 tuning recommendations

> 1 OSS (2x E5-2650 v4, 24 cores, 768GB RAM) with three ODTs. > Each ODT on its own 30-disk pool (3, 10-disk raidz2 vdevs) using 8TB > drives pool options: > ashift=12 > dataset options: > recordsize=16M > compression=lz4 > atime=off > xattr=sa > dnodesize=auto As Andreas said not a

Re: [lustre-discuss] Installation

, Keith -Original Message- From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of Alan Batie Sent: Thursday, March 16, 2017 3:05 PM To: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Installation On 3/16/17 2:12 PM, Mannthey, Keith wrote: > Th

Re: [lustre-discuss] Installation

There is a special version of e2fs packages for Lustre Ldiskfs The build server should have what you are looking for https://build.hpdd.intel.com/job/e2fsprogs-master/ Thanks, Keith -Original Message- From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of A

Re: [lustre-discuss] OpenZFS support in lustre community editions

ZFS is functional in all version of Lustre since Lustre 2.4.If you have a Lustre version from the last few years you can deploy ZFS OST. Thanks, Keith From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of Zeeshan Ali Shah Sent: Thursday, October 20, 2016 12

Re: [lustre-discuss] Lustre Client Package for Rocks 6.2

Yasir, Did you try rebuilding from the src.rpm against your current kernel? https://wiki.hpdd.intel.com/display/PUB/Rebuilding+the+Lustre-client+rpms+for+a+new+kernel Thanks, Keith From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of Yasir Israr Sent: Thursday

Re: [lustre-discuss] New Luster 2.8 Install Question

I think you are still short the below package. https://downloads.hpdd.intel.com/public/e2fsprogs/latest/el7/RPMS/x86_64/e2fsprogs-devel-1.42.13.wc5-7.el7.x86_64.rpm Thanks, Keith From: Michael Skiba [mailto:michael.sk...@oracle.com] Sent: Monday, May 23, 2016 4:04 PM To: Mannthey, Keith ; Cowe

Re: [lustre-discuss] New Luster 2.8 Install Question

ustre.org] On Behalf Of Michael Skiba Sent: Tuesday, May 24, 2016 7:04 AM To: Mannthey, Keith; lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org>; michael.sk...@oracle.com<mailto:michael.sk...@oracle.com> Subject: Re: [lustre-discuss] New Luster 2.8 Install Questio

Re: [lustre-discuss] New Luster 2.8 Install Question

Are you trying to deploy Lustre servers or clients or both? I would suspect with a little work OUL 7.2 should work just fine with Lustre 2.8 and the Linux 3.10 based builds. Thanks, Keith From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of Michael Skiba Sent: Mon

Re: [lustre-discuss] Formating mgt's in failover

Hello, The Lustre manual covers how to configure the targets for failover. Please review the below section in the Lustre Manual: https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#configuringfailover Thanks, Keith From: lustre-discuss [mailto:l

Re: [Lustre-discuss] options lnet routes section in lustre.conf

Module load time parameters are limited to 1 page of memory as I understand. I think that on most systems is 4k worth of txt with of lnet options. Dynamic Lnet Config in master and soon to be Lustre 2.7 should fix this limitation. Thanks, Keith -Original Message- From: lustre-di