[lustre-discuss] Hadoop over Lustre
Hi Can you share a document / reference to run Hadoop over Lustre? Thanks & Regards Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre with ZFS as backend FS
Hi I have configured Lustre MDT and OST with ZFS as a backend file system. I am taking fio performance on a client. But I am getting very low performance as compared to ldiksfs Is it that ZFS degrades lustre performance? Please let me know Thanks Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Data stored in OST
Hi Thank you for your reply Yes, the OSTs must provide internal redundancy - RAID-6 typically Can RAID_6 be replaced with mirror/RAID0? Which type of RAID is recommended for MDT and OST? Also can you brief on how data will be read/written in Lustre with ZFS is used as backend filesystem in Lustre FS? Thanks and regards Nick On Mon, 22 May 2023 at 13:36, Andreas Dilger wrote: > Yes, the OSTs must provide internal redundancy - RAID-6 typically. > > There is File Level Redundancy (FLR = mirroring) possible in Lustre file > layouts, but it is "unmanaged", so users or other system-level tools are > required to resync FLR files if they are written after mirroring. > > Cheers, Andreas > > > On May 22, 2023, at 09:39, Nick dan via lustre-discuss < > lustre-discuss@lists.lustre.org> wrote: > > > > > > Hi > > > > I had one doubt. > > In lustre, data is divided into stripes and stored in multiple OSTs. So > each OST will have some part of data. > > My question is if one OST fails, will there be data loss? > > > > Please advise for the same. > > > > Thanks and regards > > Nick > > ___ > > lustre-discuss mailing list > > lustre-discuss@lists.lustre.org > > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Data stored in OST
Hi I had one doubt. In lustre, data is divided into stripes and stored in multiple OSTs. So each OST will have some part of data. My question is if one OST fails, will there be data loss? Please advise for the same. Thanks and regards Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Build Lustre from source ldiskfs
Hi Can I get a document to build lustre ldiskfs from source ? Thanks and regards Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Hadoop with Lustre
Hi Can you provide configuration for Hadoop with Lustre? Also something which will give better explanation of Lustre with Hadoop. Thanks and Regards Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre kernel space or user space
Hi Can you explain in detail how Lustre can be used with NFS? Do you mean that the storage will be lustre and client will be mounted with NFS? Will this affect the performance? Thanks and regards Nick On Wed, 3 May 2023 at 14:30, Tancheff, Shaun wrote: > Lustre is an in-kernel file system. > > > > I am not aware of a FUSE mountable Lustre, it would be very likely to have > an unacceptable performance profile. > > > > There is also method to re-export as an NFS share to enable NFS clients > access to data stored on Lustre, an example use case is when client OS does > not support Lustre but does support NFS. > > > > *From: *lustre-discuss on > behalf of Nick dan via lustre-discuss > *Reply-To: *Nick dan > *Date: *Wednesday, May 3, 2023 at 2:04 PM > *To: *"lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org>, " > lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, "lustre-discuss@lists.lustre.org" > > *Subject: *[lustre-discuss] Lustre kernel space or user space > > > > Hi > > > > I had a few questions. > > 1. Is lustre storage and client mounted in kernel space or user space? > > 2. Can lustre be mounted with fuse? What is the use of mounting lustre > with fuse? > > > > Thanks and regards, > > Nick > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre kernel space or user space
Hi I had a few questions. 1. Is lustre storage and client mounted in kernel space or user space? 2. Can lustre be mounted with fuse? What is the use of mounting lustre with fuse? Thanks and regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Build Lustre Ubuntu client from source
Hi all, Thank you for your help! I am able to build a Lustre client from source after using Ubuntu 22.04.2 LTS Kernel: Linux 5.15.0-39-generic. On Tue, 2 May 2023 at 11:30, Nick dan wrote: > Hi > > What do you mean by using devel version for for 2.15.3? > > On Tue, 2 May 2023 at 11:25, Philippe Weill > wrote: > >> Hello >> >> Don't use kernel 5.19 , it's not supported by lustre 2.15.2 >> go back to 5.15LTS on ubuntu 22.04.2 or use devel version for 2.15.3 >> >> https://9to5linux.com/ubuntu-22-04-lts-is-now-powered-by-linux-kernel-5-19-from-ubuntu-22-10 >> >> >> >> Le 02/05/2023 à 07:40, Nick dan a écrit : >> > Hi >> > I tried to follow the steps you have mentioned. But I am facing the >> following error: >> > >> > After make debs >> > >> > make[5]: *** [Makefile:1850: /home/user/lustre-release] Error 2 >> > make[5]: Leaving directory '/usr/src/linux-headers-5.19.0-41-generic' >> > make[4]: *** [autoMakefile:1126: modules] Error 2 >> > make[4]: Leaving directory '/home/user/lustre-release' >> > make[3]: *** [autoMakefile:664: all-recursive] Error 1 >> > make[3]: Leaving directory '/home/user/lustre-release' >> > make[2]: *** [autoMakefile:538: all] Error 2 >> > make[2]: Leaving directory '/home/user/lustre-release' >> > make[1]: *** [debian/rules:228: build-stamp] Error 2 >> > make[1]: Leaving directory '/home/user/lustre-release' >> > dpkg-buildpackage: error: debian/rules build subprocess returned exit >> status 2 >> > cp: cannot stat '/control.bkp': No such file or directory >> > cp: cannot stat '/control.main.bkp': No such file or directory >> > cp: cannot stat '/control.modules.in.bkp': No such file or directory >> > make: *** [autoMakefile:1276: debs] Error 2 >> > >> > Can you help? >> > >> > Thanks & Regards >> > Nick >> > >> > On Fri, 28 Apr 2023 at 15:45, Tancheff, Shaun > <mailto:shaun.tanch...@hpe.com>> wrote: >> > >> > This is my usual method, however there may be some additional >> packages needed >> > >> > __ __ >> > >> > sudoapt-get install-y \ >> > >> > module-assistant libreadline-dev debhelper \ >> > >> > dpatch automake pkg-config libtool libyaml-dev libnl-genl-3-dev >> \ >> > >> > libselinux-dev libsnmp-dev mpi-default-dev bzip2quilt \ >> > >> > linux-headers-$(uname-r) rsynclibssl-dev libpython3-dev swig >> > >> > __ __ >> > >> > >> > sh ./autogen.sh >> > >> > __ __ >> > >> > ./configure --config-cache --disable-server --enable-client >> --with-linux=/usr/src/linux-headers-5.4.0-147 >> > --with-linux-obj=/usr/src/linux-headers-5.4.0-147-generic >> --without-zfs --disable-ldiskfs --disable-snmp --enable-modules >> > >> > __ __ >> > >> > make debs >> > >> > __ __ >> > >> > __ __ >> > >> > *From: *lustre-discuss > <mailto:lustre-discuss-boun...@lists.lustre.org>> on behalf of >> > Nick dan via lustre-discuss > <mailto:lustre-discuss@lists.lustre.org>> >> > *Reply-To: *Nick dan > nickdan2...@gmail.com>> >> > *Date: *Friday, April 28, 2023 at 1:53 PM >> > *To: *"lustre-discuss-requ...@lists.lustre.org > lustre-discuss-requ...@lists.lustre.org>" >> > > lustre-discuss-requ...@lists.lustre.org>>, >> > "lustre-discuss-ow...@lists.lustre.org > lustre-discuss-ow...@lists.lustre.org>" < >> lustre-discuss-ow...@lists.lustre.org >> > <mailto:lustre-discuss-ow...@lists.lustre.org>>, " >> lustre-discuss@lists.lustre.org <mailto:lustre-discuss@lists.lustre.org>" >> > > lustre-discuss@lists.lustre.org>> >> > *Subject: *[lustre-discuss] Build Lustre Ubuntu client from >> source >> > >> > __ __ >> > >> > Hi >> > >> > __ __ >> > >> > Can you send the steps / documentation to build Lustre Ubuntu >> Client from source (git)? >> > >> > __ __ >> > >> > Thanks and regards, >> > >> > Nick >> > >> >> -- >> Weill Philippe - Administrateur Systeme et Reseaux >> CNRS/UPMC/IPSL LATMOS (UMR 8190) >> Tour 45/46 3e Etage B302|4 Place Jussieu|75252 Paris Cedex 05 - FRANCE >> Email:philippe.we...@latmos.ipsl.fr | tel:+33 0144274759 >> > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Build Lustre Ubuntu client from source
Hi I tried to follow the steps you have mentioned. But I am facing the following error: After make debs make[5]: *** [Makefile:1850: /home/user/lustre-release] Error 2 make[5]: Leaving directory '/usr/src/linux-headers-5.19.0-41-generic' make[4]: *** [autoMakefile:1126: modules] Error 2 make[4]: Leaving directory '/home/user/lustre-release' make[3]: *** [autoMakefile:664: all-recursive] Error 1 make[3]: Leaving directory '/home/user/lustre-release' make[2]: *** [autoMakefile:538: all] Error 2 make[2]: Leaving directory '/home/user/lustre-release' make[1]: *** [debian/rules:228: build-stamp] Error 2 make[1]: Leaving directory '/home/user/lustre-release' dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2 cp: cannot stat '/control.bkp': No such file or directory cp: cannot stat '/control.main.bkp': No such file or directory cp: cannot stat '/control.modules.in.bkp': No such file or directory make: *** [autoMakefile:1276: debs] Error 2 Can you help? Thanks & Regards Nick On Fri, 28 Apr 2023 at 15:45, Tancheff, Shaun wrote: > This is my usual method, however there may be some additional packages > needed > > > > sudo apt-get install -y \ > > module-assistant libreadline-dev debhelper \ > > dpatch automake pkg-config libtool libyaml-dev libnl-genl-3-dev \ > > libselinux-dev libsnmp-dev mpi-default-dev bzip2 quilt \ > > linux-headers-$(uname -r) rsync libssl-dev libpython3-dev swig > > > > > sh ./autogen.sh > > > > ./configure --config-cache --disable-server --enable-client > --with-linux=/usr/src/linux-headers-5.4.0-147 > --with-linux-obj=/usr/src/linux-headers-5.4.0-147-generic --without-zfs > --disable-ldiskfs --disable-snmp --enable-modules > > > > make debs > > > > > > *From: *lustre-discuss on > behalf of Nick dan via lustre-discuss > *Reply-To: *Nick dan > *Date: *Friday, April 28, 2023 at 1:53 PM > *To: *"lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, " > lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org>, "lustre-discuss@lists.lustre.org" > > *Subject: *[lustre-discuss] Build Lustre Ubuntu client from source > > > > Hi > > > > Can you send the steps / documentation to build Lustre Ubuntu Client from > source (git)? > > > > Thanks and regards, > > Nick > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Build Lustre Ubuntu client from source
Hi Can you send the steps / documentation to build Lustre Ubuntu Client from source (git)? Thanks and regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Client in other network
Hi I had a question If my lustre storage is in the India network. can I connect the lustre client in the US network in a different IP range? Thanks and Regards Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Configure Lustre Filesystem on Ubuntu 22.04/20.04
Hi Okay, thank you for your help! I am trying to make Ubuntu 20.04 as a lustre client. However the packages are for specific kernel versions which cannot be downloaded. Can I get generic Ubuntu client packages? Thanks and regards, Nick On Thu, 20 Apr 2023 at 19:29, Aurelien Degremont wrote: > Ubuntu 22.04 is not an officially supported distro for Lustre servers. > That's why the Ubuntu pakages are not available. > However, it is possible that manually building them from the source code > works (Ubuntu 20.04 is known to work, even if not supported. I don't know > about 22.04 specifically). > > Aurélien > -- > *De :* lustre-discuss de la > part de Nick dan via lustre-discuss > *Envoyé :* mercredi 19 avril 2023 12:11 > *À :* lustre-discuss-requ...@lists.lustre.org < > lustre-discuss-requ...@lists.lustre.org>; > lustre-discuss-ow...@lists.lustre.org < > lustre-discuss-ow...@lists.lustre.org>; lustre-discuss@lists.lustre.org < > lustre-discuss@lists.lustre.org> > *Objet :* [lustre-discuss] Configure Lustre Filesystem on Ubuntu > 22.04/20.04 > > *External email: Use caution opening links or attachments* > Hi > > I want to configure Lustre FS on Ubuntu 22.04 OS, but I can not find > lustre server packages on the following link > https://downloads.whamcloud.com/public/lustre/latest-release/ubuntu2204/ > > Can you help where can I find server packages for Lustre? > > Thanks and regards, > Nick > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Configure Lustre Filesystem on Ubuntu 22.04/20.04
Hi I want to configure Lustre FS on Ubuntu 22.04 OS, but I can not find lustre server packages on the following link https://downloads.whamcloud.com/public/lustre/latest-release/ubuntu2204/ Can you help where can I find server packages for Lustre? Thanks and regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre HA
Hi We are using Lustre with ZFS as a backend file system. How to configure the setup for HA? What are the advantages? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Node Failure in Lustre
Hi Okay. Thank you for the information Can you tell if the MDS/MGS or the OSS server goes down, how will the failure be handled on Lustre level? On Wed, 15 Mar 2023 at 13:45, Andreas Dilger wrote: > No, because the remote-attached SSDs are part of the ZFS pool and any > drive failures a t that level are the responsibility of ZFS in that case to > manage the failed drives (eg. with RAID) and for you to have system > monitors in place to detect this case and alert you to the drive failures. > This is no different than if the drives inside a RAID enclosure fail. > > Lustre cannot magically know about drives below the filesystem layer have > problems. It only cares about being able to access the whole filesystem, > and that the filesystem is intact even in the case of drive failures. > > Cheers, Andreas > > > On Mar 15, 2023, at 01:26, Nick dan via lustre-discuss < > lustre-discuss@lists.lustre.org> wrote: > > > > > > Hi > > > > There is a situation where disks from multiple servers are sent to a > main server.(Lustre storage) Zpool is created from the SSDs and mkfs.lustre > is done using zfs as a backend file system. Lustre client is also > connected. If one of the nodes from where the SSDs are sent goes down, will > the node failure be handled? > > > > Thanks and regards, > > Nick Dan > > ___ > > lustre-discuss mailing list > > lustre-discuss@lists.lustre.org > > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Node Failure in Lustre
Hi There is a situation where disks from multiple servers are sent to a main server.(Lustre storage) Zpool is created from the SSDs and mkfs.lustre is done using zfs as a backend file system. Lustre client is also connected. If one of the nodes from where the SSDs are sent goes down, will the node failure be handled? Thanks and regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] dkms error in zfs
Hi Trying to build lustre with this [root@sv01 lustre-zfs-2.15.2]# dkms build lustre-zfs/2.15.2 checking for LIBNL3... no configure: error: Package requirements (libnl-genl-3.0 >= 3.1) were not met: Package 'libnl-genl-3.0', required by 'virtual:world', not found Consider adjusting the PKG_CONFIG_PATH environment variable if you installed software in a non-standard prefix. Alternatively, you may set the environment variables LIBNL3_CFLAGS and LIBNL3_LIBS to avoid the need to call pkg-config. See the pkg-config man page for more details. configure error, check /var/lib/dkms/lustre-zfs/2.15.2/build/config.log Building module: Cleaning build area...(bad exit status: 2) make -j40 KERNELRELEASE=4.18.0-425.13.1.el8_7.x86_64...(bad exit status: 2) Error! Bad return status for module build on kernel: 4.18.0-425.13.1.el8_7.x86_64 (x86_64) Consult /var/lib/dkms/lustre-zfs/2.15.2/build/make.log for more information. Regards Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] ZFS Support for Lustre
Hi I have installed following packages of Lustre and ZFS *LUSTRE* [root@1u fs]# rpm -qa | grep lustre kmod-lustre-tests-debuginfo-2.15.2-1.el8.x86_64 lustre-zfs-dkms-2.15.2-1.el8.noarch kernel-debuginfo-common-x86_64-4.18.0-425.3.1.el8_lustre.x86_64 kernel-selftests-internal-4.18.0-425.3.1.el8_lustre.x86_64 kernel-core-4.18.0-425.3.1.el8_lustre.x86_64 kernel-devel-4.18.0-425.3.1.el8_lustre.x86_64 lustre-osd-zfs-mount-2.15.2-1.el8.x86_64 lustre-debuginfo-2.15.2-1.el8.x86_64 lustre-tests-debuginfo-2.15.2-1.el8.x86_64 kernel-modules-internal-4.18.0-425.3.1.el8_lustre.x86_64 kernel-debuginfo-4.18.0-425.3.1.el8_lustre.x86_64 lustre-iokit-2.15.2-1.el8.x86_64 kernel-ipaclones-internal-4.18.0-425.3.1.el8_lustre.x86_64 python3-perf-4.18.0-425.3.1.el8_lustre.x86_64 perf-4.18.0-425.3.1.el8_lustre.x86_64 kmod-lustre-osd-zfs-2.15.2-1.el8.x86_64 kmod-lustre-osd-zfs-debuginfo-2.15.2-1.el8.x86_64 kernel-headers-4.18.0-425.3.1.el8_lustre.x86_64 kernel-4.18.0-425.3.1.el8_lustre.x86_64 kmod-lustre-2.15.2-1.el8.x86_64 kernel-modules-extra-4.18.0-425.3.1.el8_lustre.x86_64 kmod-lustre-tests-2.15.2-1.el8.x86_64 lustre-debugsource-2.15.2-1.el8.x86_64 kernel-modules-4.18.0-425.3.1.el8_lustre.x86_64 kmod-lustre-debuginfo-2.15.2-1.el8.x86_64 perf-debuginfo-4.18.0-425.3.1.el8_lustre.x86_64 lustre-osd-ldiskfs-mount-2.15.2-1.el8.x86_64 lustre-osd-zfs-mount-debuginfo-2.15.2-1.el8.x86_64 *ZFS* lustre-zfs-dkms-2.15.2-1.el8.noarch libzfs5-devel-2.1.5-1.el8.x86_64 zfs-debuginfo-2.1.5-1.el8.x86_64 lustre-osd-zfs-mount-2.15.2-1.el8.x86_64 zfs-2.1.5-1.el8.x86_64 python3-pyzfs-2.1.5-1.el8.noarch zfs-test-2.1.5-1.el8.x86_64 kmod-lustre-osd-zfs-2.15.2-1.el8.x86_64 kmod-lustre-osd-zfs-debuginfo-2.15.2-1.el8.x86_64 zfs-debugsource-2.1.5-1.el8.x86_64 libzfs5-debuginfo-2.1.5-1.el8.x86_64 libzfs5-2.1.5-1.el8.x86_64 zfs-dkms-2.1.5-1.el8.noarch zfs-test-debuginfo-2.1.5-1.el8.x86_64 lustre-osd-zfs-mount-debuginfo-2.15.2-1.el8.x86_64 When I am trying to modprobe zfs this is the error I am getting I have rebooted the server [root@1u user]# modprobe zfs modprobe: FATAL: Module zfs not found in directory /lib/modules/4.18.0-425.3.1.el8_lustre.x86_64 FYI [root@1u user]# cd /lib/modules/4.18.0-425.3.1.el8_lustre.x86_64/extra/lustre-osd-zfs/fs [root@1u fs]# ls osd_zfs.ko Can you help with the error? Regards Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Downloading Lustre packages from github
Hi I am trying to install Lustre from git clone git:// git.whamcloud.com/fs/lustre-release.git OS Version Redhat 8.7 But when I am trying to fo i am getting lot of errors Steps following git clone git://git.whamcloud.com/fs/lustre-release.git cd lustre-release sh ./autogen.sh ./configure But I am getting this error at the end checking for keyctl_search in -lkeyutils... no configure: WARNING: GSS keyring backend requires libkeyutils configure: error: Cannot enable gss_keyring. See above for details. Can you provide detailed steps and other packages which need to be installed before? Regards Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Installation on Ubuntu
Hi We are trying to make Ubuntu 22.04 as Lustre Client for x86_64 Lustre Version we are using is 2.15.1 But the packages available here are for amd64 https://downloads.whamcloud.com/public/lustre/lustre-2.15.1/ubuntu2204/client/ >From where can we get packages for Ubuntu? Thanks and Regards Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] ZFS Support For Lustre
Hi I am using Lustre Version 2.15.1 on RedHat 8.8 As mentioned in the link, https://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix , the ZFS Version required is 2.1.2. However, when I am trying to install ZFS from https://downloads.whamcloud.com/public/lustre/lustre-2.15.1/el8.6/server/RPMS/x86_64/ I am getting the following error [root@st01 user]# yum install https://downloads.whamcloud.com/public/lustre/lustre-2.15.1/el8.6/server/RPMS/x86_64/zfs-2.1.2-1.el8.x86_64.rpm Updating Subscription Management repositories. Last metadata expiration check: 2:01:30 ago on Tue 14 Feb 2023 03:38:48 PM IST. zfs-2.1.2-1.el8.x86_64.rpm 248 kB/s | 649 kB 00:02 Error: Problem: conflicting requests - nothing provides zfs-kmod = 2.1.2 needed by zfs-2.1.2-1.el8.x86_64 (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) I have installed the other required packages like libzfs, libzpool, libnvpair, libutil. I am not able to download kmod-zfs version 2.1.2, as the latest version getting downloaded is 2.1.9 Can you help with this or suggest another way to download all supported ZFS Packages? Thanks, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Mount Lustre Filesystem on Client with non root user
Hi How to mount a lustre filesystem on a client without root privileges to non-root user? Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Mounting Lustre Client through non root user
Hi Thank you for your reply. Can you help me with mounting of lustre filesystem through `x-systemd.automount`.? Regards, Nick On Fri, 3 Feb 2023 at 20:23, Laura Hild wrote: > Hi Nick- > > I can't say I know whether Lustre supports the `user` option, but an > alternative might be to use `x-systemd.automount`. > > -Laura > > > > Od: lustre-discuss v imenu Nick > dan via lustre-discuss > Poslano: petek, 03. februar 2023 01:56 > Za: lustre-discuss-requ...@lists.lustre.org; > lustre-discuss@lists.lustre.org; lustre-discuss-ow...@lists.lustre.org > Zadeva: [lustre-discuss] Mounting Lustre Client through non root user > > Hi > > I want to mount the lustre client on the non-root user > > I have added the following line in /etc/fstab file > 192.168.10.11:/lustre/home/user/aa lustrerw,noauto,user,sync 0 > 0 > > But when I am trying to mount through my non-root user, I am receiving > this error > [user@cl01 ~]$ mount /home/user/aa > mount.lustre: mount 192.168.10.11:/lustre at /home/user/aa failed: > Operation not permitted > > Can this be solved? > > Regards, > Nick > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Mounting Lustre Client through non root user
Hi I want to mount the lustre client on the non-root user I have added the following line in /etc/fstab file 192.168.10.11:/lustre/home/user/aa lustrerw,noauto,user,sync 0 0 But when I am trying to mount through my non-root user, I am receiving this error [user@cl01 ~]$ mount /home/user/aa mount.lustre: mount 192.168.10.11:/lustre at /home/user/aa failed: Operation not permitted Can this be solved? Regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Regarding Lustre with ZFS
Hi I am using Red Hat Enterprise Linux 8.6 (Ootpa), with Kernel Linux 4.18.0-372.9.1.el8_lustre.x86_64 and Lustre Version 2.15.1. I was previously using ldiskfs and now I want to use ZFS with Lustre. Can you let me know what packages need to be installed? I have the following packages installed on my storage [user@st01 ~]$ rpm -qa | grep lustre kernel-modules-4.18.0-372.9.1.el8_lustre.x86_64 kmod-lustre-osd-ldiskfs-2.15.1-1.el8.x86_64 pcp-pmda-lustrecomm-5.3.5-8.el8.x86_64 python3-perf-4.18.0-372.9.1.el8_lustre.x86_64 kernel-devel-4.18.0-372.9.1.el8_lustre.x86_64 lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64 lustre-iokit-2.15.1-1.el8.x86_64 kernel-core-4.18.0-372.9.1.el8_lustre.x86_64 kmod-lustre-osd-ldiskfs-debuginfo-2.15.1-1.el8.x86_64 lustre-debugsource-2.15.1-1.el8.x86_64 lustre-2.15.1-1.el8.x86_64 lustre-tests-2.15.1-1.el8.x86_64 kernel-debuginfo-common-x86_64-4.18.0-372.9.1.el8_lustre.x86_64 kmod-lustre-debuginfo-2.15.1-1.el8.x86_64 python3-perf-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64 lustre-devel-2.15.1-1.el8.x86_64 kmod-lustre-tests-debuginfo-2.15.1-1.el8.x86_64 kernel-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64 perf-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64 kmod-lustre-2.15.1-1.el8.x86_64 lustre-ldiskfs-dkms-2.15.1-1.el8.noarch kmod-lustre-tests-2.15.1-1.el8.x86_64 kernel-4.18.0-372.9.1.el8_lustre.x86_64 lustre-debuginfo-2.15.1-1.el8.x86_64 pcp-pmda-lustre-5.3.5-8.el8.x86_64 - [user@st01 ~]$ rpm -qa | grep e2fs e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64 e2fsprogs-debuginfo-1.46.2.wc5-0.el8.x86_64 e2fsprogs-debugsource-1.46.2.wc5-0.el8.x86_64 e2fsprogs-libs-debuginfo-1.46.2.wc5-0.el8.x86_64 e2fsprogs-devel-1.46.2.wc5-0.el8.x86_64 e2fsprogs-1.46.2.wc5-0.el8.x86_64 e2fsprogs-static-1.46.2.wc5-0.el8.x86_64 Do I need to remove some packages for using ZFS? https://downloads.whamcloud.com/public/lustre/lustre-2.15.1/el8.6/server/RPMS/x86_64/ What packages are important from the above list for using ZFS? Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre with ZFS Install
Hi I have tried to complete the same configuration on centos, but when I am using the make command, I am getting this error Making all in . make[4]: Entering directory `/home/user/lustre-release/lustre/utils' gcc -DHAVE_CONFIG_H -I. -I../.. -DHAVE_IOCTL_IN_UNISTD_H -I /home/user/zfs/lib/libspl/include -I /home/user/zfs/lib/libspl/include/os/linux -I /home/user/zfs/include -include /home/user/lustre-release/undef.h -include /home/user/lustre-release/config.h -I/home/user/lustre-release/lnet/include/uapi -I/home/user/lustre-release/lustre/include/uapi -I/home/user/lustre-release/libcfs/include -I/home/user/lustre-release/lnet/utils/ -I/home/user/lustre-release/lustre/include -fPIC -D_GNU_SOURCE -D_LARGEFILE64_SOURCE=1 -D_FILE_OFFSET_BITS=64 -DLUSTRE_UTILS=1 -g -O2 -Wall -Werror -MT libmount_utils_zfs_a-libmount_utils_zfs.o -MD -MP -MF .deps/libmount_utils_zfs_a-libmount_utils_zfs.Tpo -c -o libmount_utils_zfs_a-libmount_utils_zfs.o `test -f 'libmount_utils_zfs.c' || echo './'`libmount_utils_zfs.c In file included from /home/user/zfs/include/sys/spa.h:39:0, from libmount_utils_zfs.c:32: /home/user/zfs/include/sys/zfs_context.h:698:42: error: expected ‘;’, ‘,’ or ‘)’ before ‘str’ extern int kmem_scnprintf(char *restrict str, size_t size, ^ libmount_utils_zfs.c: In function ‘zfs_check_hostid’: libmount_utils_zfs.c:397:2: error: too few arguments to function ‘spa_get_hostid’ hostid = spa_get_hostid(); ^ In file included from libmount_utils_zfs.c:32:0: /home/user/zfs/include/sys/spa.h:1109:17: note: declared here extern uint32_t spa_get_hostid(spa_t *spa); ^ make[4]: *** [libmount_utils_zfs_a-libmount_utils_zfs.o] Error 1 make[4]: Leaving directory `/home/user/lustre-release/lustre/utils' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/home/user/lustre-release/lustre/utils' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/home/user/lustre-release/lustre' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/user/lustre-release' make: *** [all] Error 2 Can you help with this? Regards, Nick On Wed, 25 Jan 2023 at 10:12, Nick dan wrote: > Hi > > Thank you for your help. I have found out the keyutils package > While ./configure, the next error I am facing is > > checking libmount/libmount.h usability... no > checking libmount/libmount.h presence... no > checking for libmount/libmount.h... no > checking whether to build with libmount... no > configure: error: libmount development package is required > > I can not find the lib mount devel package in RedHat 8.6. Can you help > with this? > > Regards, > Nick > > On Tue, 24 Jan 2023 at 20:55, Laura Hild wrote: > >> Hi, Nick- >> >> keyutils-libs is not the devel package. I think it is likely if you run >> >> dnf search keyutils >> >> that you will find the package you need to install. >> >> -Laura >> >> >> >> Od: lustre-discuss v imenu >> Nick dan via lustre-discuss >> Poslano: torek, 24. januar 2023 05:38 >> Za: Degremont, Aurelien >> Kp: lustre-discuss@lists.lustre.org >> Zadeva: [EXTERNAL] Re: [lustre-discuss] Lustre with ZFS Install >> >> Hi >> >> I have already installed keyutils >> [root@sv01 lustre-release]# yum install keyutils-libs >> Updating Subscription Management repositories. >> Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 >> PM IST. >> Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed. >> Dependencies resolved. >> Nothing to do. >> Complete! >> >> Tried to install with the command suggested by you >> Error: Unable to find a match: libkeyutils-devel >> FYI >> OS: Red Hat Enterprise Linux 8.6 (Ootpa) >> >> Regards, >> Nick >> >> >> On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien >> wrote: >> > configure: WARNING: GSS keyring backend requires libkeyutils >> >> The configure command clearly says that libkeyutils should be installed. >> Did you try to install it? >> >> Under Rhel, this is probably: dnf install libkeyutils-devel >> >> >> Aurélien >> >> [...] > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre with ZFS Install
Hi Thank you for your help. I have found out the keyutils package While ./configure, the next error I am facing is checking libmount/libmount.h usability... no checking libmount/libmount.h presence... no checking for libmount/libmount.h... no checking whether to build with libmount... no configure: error: libmount development package is required I can not find the lib mount devel package in RedHat 8.6. Can you help with this? Regards, Nick On Tue, 24 Jan 2023 at 20:55, Laura Hild wrote: > Hi, Nick- > > keyutils-libs is not the devel package. I think it is likely if you run > > dnf search keyutils > > that you will find the package you need to install. > > -Laura > > > ____ > Od: lustre-discuss v imenu Nick > dan via lustre-discuss > Poslano: torek, 24. januar 2023 05:38 > Za: Degremont, Aurelien > Kp: lustre-discuss@lists.lustre.org > Zadeva: [EXTERNAL] Re: [lustre-discuss] Lustre with ZFS Install > > Hi > > I have already installed keyutils > [root@sv01 lustre-release]# yum install keyutils-libs > Updating Subscription Management repositories. > Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 PM > IST. > Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed. > Dependencies resolved. > Nothing to do. > Complete! > > Tried to install with the command suggested by you > Error: Unable to find a match: libkeyutils-devel > FYI > OS: Red Hat Enterprise Linux 8.6 (Ootpa) > > Regards, > Nick > > > On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien > wrote: > > configure: WARNING: GSS keyring backend requires libkeyutils > > The configure command clearly says that libkeyutils should be installed. > Did you try to install it? > > Under Rhel, this is probably: dnf install libkeyutils-devel > > > Aurélien > > [...] ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre with ZFS Install
Hi I have already installed keyutils [root@sv01 lustre-release]# yum install keyutils-libs Updating Subscription Management repositories. Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 PM IST. Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed. Dependencies resolved. Nothing to do. Complete! Tried to install with the command suggested by you Error: Unable to find a match: libkeyutils-devel FYI OS: Red Hat Enterprise Linux 8.6 (Ootpa) Regards, Nick On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien wrote: > > configure: WARNING: GSS keyring backend requires libkeyutils > > > > The configure command clearly says that libkeyutils should be installed. > > Did you try to install it? > > > > Under Rhel, this is probably: dnf install libkeyutils-devel > > > > > > Aurélien > > > > *De : *Nick dan > *Date : *mardi 24 janvier 2023 à 10:41 > *À : *"Degremont, Aurelien" , " > lustre-discuss@lists.lustre.org" , " > lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, " > lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org> > *Objet : *RE: [EXTERNAL][lustre-discuss] Lustre with ZFS Install > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > Hi > > > > I have attached the text file. I have got the following error on > ./configure. > > configure: error: Cannot enable gss_keyring. See above for details. > > > > Can you help with this? > > > > On Tue, 24 Jan 2023 at 14:47, Degremont, Aurelien > wrote: > > Hi > > > > It looks like the ‘./configure’ command was not successful. Did you check > it? > > Also, please copy/paste terminal output as text and not as a picture. > > > > Aurélien > > > > *De : *lustre-discuss au nom de > Nick dan via lustre-discuss > *Répondre à : *Nick dan > *Date : *mardi 24 janvier 2023 à 09:31 > *À : *"lustre-discuss@lists.lustre.org" , > "lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, " > lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org> > *Objet : *[EXTERNAL] [lustre-discuss] Lustre with ZFS Install > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > Hi, > > > > We are trying to use ZFS with Lustre referring to the link: > > https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS > > > > We are using the following steps to do so and getting error while making > rpms. > > > > git clone git://git.whamcloud.com/fs/lustre-release.git > > cd lustre-release/ > sh ./autogen.sh > ./configure --disable-ldiskfs > > > > make rpms (When we are doing make rpms, we are getting the following > error) (Error attached in ss below) > > [root@sv01 lustre-release]# make rpms > make: *** No rule to make target 'rpms'. Stop. > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre with ZFS Install
Hi I have attached the text file. I have got the following error on ./configure. configure: error: Cannot enable gss_keyring. See above for details. Can you help with this? On Tue, 24 Jan 2023 at 14:47, Degremont, Aurelien wrote: > Hi > > > > It looks like the ‘./configure’ command was not successful. Did you check > it? > > Also, please copy/paste terminal output as text and not as a picture. > > > > Aurélien > > > > *De : *lustre-discuss au nom de > Nick dan via lustre-discuss > *Répondre à : *Nick dan > *Date : *mardi 24 janvier 2023 à 09:31 > *À : *"lustre-discuss@lists.lustre.org" , > "lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, " > lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org> > *Objet : *[EXTERNAL] [lustre-discuss] Lustre with ZFS Install > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > Hi, > > > > We are trying to use ZFS with Lustre referring to the link: > > https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS > > > > We are using the following steps to do so and getting error while making > rpms. > > > > git clone git://git.whamcloud.com/fs/lustre-release.git > > cd lustre-release/ > sh ./autogen.sh > ./configure --disable-ldiskfs > > > > make rpms (When we are doing make rpms, we are getting the following > error) (Error attached in ss below) > > [root@sv01 lustre-release]# make rpms > make: *** No rule to make target 'rpms'. Stop. > [root@sv01 lustre-release]# ./configure --disable-ldiskfs configure: loading site script /usr/share/config.site checking build system type... x86_64-pc-linux-gnu checking host system type... x86_64-pc-linux-gnu checking target system type... x86_64-pc-linux-gnu checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking how to create a pax tar archive... gnutar checking whether to enable maintainer-specific portions of Makefiles... yes checking for gcc... gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking whether gcc understands -c and -o together... yes checking whether make supports the include directive... yes (GNU style) checking dependency style of gcc... gcc3 checking how to print strings... printf checking for a sed that does not truncate output... /usr/bin/sed checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for fgrep... /usr/bin/grep -F checking for ld used by gcc... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B checking the name lister (/usr/bin/nm -B) interface... BSD nm checking whether ln -s works... yes checking the maximum length of command line arguments... 1572864 checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop checking for /usr/bin/ld option to reload object files... -r checking for objdump... objdump checking how to recognize dependent libraries... pass_all checking for dlltool... no checking how to associate runtime and link libraries... printf %s\n checking for ar... ar checking for archiver @FILE support... @ checking for strip... strip checking for ranlib... ranlib checking command to parse /usr/bin/nm -B output from gcc object... ok checking for sysroot... no checking for a working dd... /usr/bin/dd checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 checking for mt... no checking if : is a manifest tool... no checking how to run the C preprocessor... gcc -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking for dlfcn.h... yes checking for objdir... .libs checking if gcc supports -fno-rtti -fno-exceptions... no che
[lustre-discuss] Lustre with ZFS Install
Hi, We are trying to use ZFS with Lustre referring to the link: https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS We are using the following steps to do so and getting error while making rpms. git clone git://git.whamcloud.com/fs/lustre-release.git cd lustre-release/ sh ./autogen.sh ./configure --disable-ldiskfs make rpms (When we are doing make rpms, we are getting the following error) (Error attached in ss below) [root@sv01 lustre-release]# make rpms make: *** No rule to make target 'rpms'. Stop. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre with ZFS Install
Hi, We are trying to use ZFS with Lustre referring to the link: https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS We are using the following steps to do so and getting error while making rpms. git clone git://git.whamcloud.com/fs/lustre-release.git cd lustre-release/ sh ./autogen.sh ./configure --disable-ldiskfs make rpms (When we are doing make rpms, we are getting the following error) [image: image.png] Can you help with error? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Support for Postgres
Hi We have mounted the same data directory on all the lustre clients and have started the postgres service on all clients. Our requirement is as follows: 1 client as read-write node Other clients as read only We want to know if Postgres is compatible with Lustre and this case is achievable. Can you please let us know if this is possible? Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Client with Postgres
Hi, We have mounted our clients with the Lustre filesystem. We want to configure our client setup as follows: 1 client as read-write 2 clients as read only Can you help in configuring this setup? Or send a relevant document for the same? Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Lustre Client
Hi Thank you for your help I am using postgres with lustre client, when I mount lustre client with -o ro the postgres service is not starting Can you help how to make the postgres client read only? On Fri, 13 Jan 2023 at 16:34, Degremont, Aurelien wrote: > Did you try? :) > > > > > > But the answer is yes, ‘-o ro’ is supported for client mounts > > > > Aurélien > > *De : *lustre-discuss au nom de > Nick dan via lustre-discuss > *Répondre à : *Nick dan > *Date : *vendredi 13 janvier 2023 à 10:48 > *À : *"lustre-discuss@lists.lustre.org" , > "lustre-discuss-requ...@lists.lustre.org" < > lustre-discuss-requ...@lists.lustre.org>, " > lustre-discuss-ow...@lists.lustre.org" < > lustre-discuss-ow...@lists.lustre.org> > *Objet : *[EXTERNAL] [lustre-discuss] Lustre Client > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > Hi > > > > I wanted to ask if Lustre client can be mounted as read-only client or not > > > > Regards, > > Nick Dan > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Client
Hi I wanted to ask if Lustre client can be mounted as read-only client or not Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Regarding client mount on Lustre
Hi ip for st02=192.168.10.12 I have configured mgs and mdt on one server (say st02) using *mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme0n1* *mount -t lustre /dev/nvme0n1 /mnt/mds* And I have configured the ost on other server (say sv01) *mkfs.lustre --ost --index=1 --reformat --fsname=lustre --mgsnode=192.168.10.12@tcp /dev/nvme0n1* *mount -t lustre /dev/nvme0n1 /mnt/ost* When I am mounting on client(cl01) using *mount -t lustre 192.168.10.12@tcp:/lustre /mnt/lustre * But after mounting, we are getting the connection timed out error, I have stopped the firewall from both the servers and also configured lnet on all three nodes (st02, sv01, cl01) Can you help with solving this error? Thank you! Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] NVMe-over-fabric with Lustre
Hi Can you give a detailed document/information about NVMe-oF using the Lustre File System. Regards, Nick Dan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] ZFS with Lustre
Hi What packages are needed to be installed on server and client for using Lustre with ZFS? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre with RDMA
I want to share my nvme disk through rdma and use lustre over it Will this be the flow for the same? 1. Share the nvme disk through NVMe/RDMA from storage to client 2. Configure the Lustre File system, mount on server 3. Mount it on the client 4. set lustre.conf on servers ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] RDMA with Lustre
Hi Can you tell how to configure RDMA with Lustre ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Regarding Client Configuration of Lustre
I am using RedHat 8.6 Kernel Version: Linux 4.18.0-372.9.1.el8_lustre.x86_64 I have configured MDS and OSS Server (using the same OS) Now I want to configure the Lustre Client. I have installed the following packages. [image: image.png] Erro: [image: image.png] Can you tell what else needs to be done? Also, what other packages need to be installed? How to move ahead with the client configuration? Regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Now MGS and MDT server is working fine now i'll move forward with OSS server Thanks. Regards, Nick On Tue, 20 Dec 2022 at 16:39, Blagodarenko Artem < artem.blagodare...@gmail.com> wrote: > Hi Nick > > > > > Is the ldiskfs module available? > > > > It looks like lustre modules (ldiskfs exactly for mkfs.lustre) are not > loaded. > > Please, try load them first: > > > > #modprobe lustre > > > > If all required packages are installed, this command loads the modules. > > > > Best regards, > > Artem Blagodarenko > > > > *From: *lustre-discuss on > behalf of Nick dan via lustre-discuss > *Date: *Tuesday, 20 December 2022 at 04:19 > *To: *lustre-discuss@lists.lustre.org > *Subject: *[lustre-discuss] Problem in confugration of MGS and MDT server > in lustre. > > Hi, > > Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. > > Referred from https://www.lustre.org/ > > Successfully downloaded and installed the following packages by using yum > install command: > > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm > > After this trying to do mkfs.lustre on my available > NVMe-disk(nvme1n1)Mentioned in the below Fig > > > > And did the mkfs.lusre on it and getting the error . > > > > mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 > >Permanent disk data: > Target: lustre:MDT > Index: 0 > Lustre FS: lustre > Mount type: ldiskfs > Flags: 0x65 > (MDT MGS first_time update ) > Persistent mount opts: user_xattr,errors=remount-ro > Parameters: > > checking for existing Lustre data: not found > device size = 953869MB > formatting backing filesystem ldiskfs on /dev/nvme1n1 > target name lustre:MDT > kilobytes 976762584 > options-J size=4096 -I 1024 -i 2560 -q -O > dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg > -E lazy_journal_init="0",lazy_itable_init="0" -F > mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 > -q -O > dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg > -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k > mkfs.lustre: Unable to mount /dev/nvme1n1: No such device > Is the ldiskfs module available? > mkfs.lustre FATAL: failed to write local files > mkfs.lustre: exiting with 19 (No such device) > > Can you help where am I going wrong? > > Regards, > > Nick > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Hi, Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. Referred from https://www.lustre.org/ Successfully downloaded and installed the following packages by using yum install command: yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm After this trying to do mkfs.lustre on my available NVMe-disk(nvme1n1)Mentioned in the below Fig [image: image.png] And did the mkfs.lusre on it and getting the error . mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 Permanent disk data: Target: lustre:MDT Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: checking for existing Lustre data: not found device size = 953869MB formatting backing filesystem ldiskfs on /dev/nvme1n1 target name lustre:MDT kilobytes 976762584 options-J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k mkfs.lustre: Unable to mount /dev/nvme1n1: No such device Is the ldiskfs module available? mkfs.lustre FATAL: failed to write local files mkfs.lustre: exiting with 19 (No such device) Can you help where am I going wrong? Regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
