Re: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Now MGS and MDT server is working fine now i'll move forward with OSS server Thanks. Regards, Nick On Tue, 20 Dec 2022 at 16:39, Blagodarenko Artem < artem.blagodare...@gmail.com> wrote: > Hi Nick > > > > > Is the ldiskfs module available? > > > > It looks like lustre modules (ldiskfs exactly for mkfs.lustre) are not > loaded. > > Please, try load them first: > > > > #modprobe lustre > > > > If all required packages are installed, this command loads the modules. > > > > Best regards, > > Artem Blagodarenko > > > > *From: *lustre-discuss on > behalf of Nick dan via lustre-discuss > *Date: *Tuesday, 20 December 2022 at 04:19 > *To: *lustre-discuss@lists.lustre.org > *Subject: *[lustre-discuss] Problem in confugration of MGS and MDT server > in lustre. > > Hi, > > Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. > > Referred from https://www.lustre.org/ > > Successfully downloaded and installed the following packages by using yum > install command: > > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm > yum install > https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm > yum install > https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm > > After this trying to do mkfs.lustre on my available > NVMe-disk(nvme1n1)Mentioned in the below Fig > > > > And did the mkfs.lusre on it and getting the error . > > > > mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 > >Permanent disk data: > Target: lustre:MDT > Index: 0 > Lustre FS: lustre > Mount type: ldiskfs > Flags: 0x65 > (MDT MGS first_time update ) > Persistent mount opts: user_xattr,errors=remount-ro > Parameters: > > checking for existing Lustre data: not found > device size = 953869MB > formatting backing filesystem ldiskfs on /dev/nvme1n1 > target name lustre:MDT > kilobytes 976762584 > options-J size=4096 -I 1024 -i 2560 -q -O > dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg > -E lazy_journal_init="0",lazy_itable_init="0" -F > mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 > -q -O > dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg > -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k > mkfs.lustre: Unable to mount /dev/nvme1n1: No such device > Is the ldiskfs module available? > mkfs.lustre FATAL: failed to write local files > mkfs.lustre: exiting with 19 (No such device) > > Can you help where am I going wrong? > > Regards, > > Nick > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Hi Nick > Is the ldiskfs module available? It looks like lustre modules (ldiskfs exactly for mkfs.lustre) are not loaded. Please, try load them first: #modprobe lustre If all required packages are installed, this command loads the modules. Best regards, Artem Blagodarenko From: lustre-discuss on behalf of Nick dan via lustre-discuss Date: Tuesday, 20 December 2022 at 04:19 To: lustre-discuss@lists.lustre.org Subject: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre. Hi, Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. Referred from https://www.lustre.org/ Successfully downloaded and installed the following packages by using yum install command: yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm After this trying to do mkfs.lustre on my available NVMe-disk(nvme1n1)Mentioned in the below Fig [cid:ii_lbq5tp7r0] And did the mkfs.lusre on it and getting the error . mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 Permanent disk data: Target: lustre:MDT Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: checking for existing Lustre data: not found device size = 953869MB formatting backing filesystem ldiskfs on /dev/nvme1n1 target name lustre:MDT kilobytes 976762584 options-J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k mkfs.lustre: Unable to mount /dev/nvme1n1: No such device Is the ldiskfs module available? mkfs.lustre FATAL: failed to write local files mkfs.lustre: exiting with 19 (No such device) Can you help where am I going wrong? Regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Hi Yes, both parameters at the same time are valid. Regarding the RPMS you installed. You picked a new kernel, did you reboot to use it? If not you should. You are missing those 2 packages, I’m even surprised Yum did not complain about missing deps. kmod-lustre-2.15.1-1.el8.x86_64.rpm<https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kmod-lustre-2.15.1-1.el8.x86_64.rpm> kmod-lustre-osd-ldiskfs-2.15.1-1.el8.x86_64.rpm<https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kmod-lustre-osd-ldiskfs-2.15.1-1.el8.x86_64.rpm> lustre-ldiskfs-dkms: you installed ldiskfs support as a DKMS package but not Lustre as a DKMS too. I recommend using the same for every package, so here, install the osd package above instead of your DKMS one. Probably the best for you is to setup https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/ as YUM additional repository. Aurélien De : lustre-discuss au nom de Taner KARAGÖL via lustre-discuss Répondre à : Taner KARAGÖL Date : mardi 20 décembre 2022 à 07:12 À : Nick dan Cc : "lustre-discuss@lists.lustre.org" Objet : RE: [EXTERNAL][lustre-discuss] Problem in confugration of MGS and MDT server in lustre. CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. UNCLASSIFIED Hi, Is it valid to use two parameters at the same time? “--mgs –mdt” I dont think so. Regards, From: lustre-discuss On Behalf Of Nick dan via lustre-discuss Sent: Tuesday, December 20, 2022 7:17 AM To: lustre-discuss@lists.lustre.org Subject: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre. Hi, Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. Referred from https://www.lustre.org/ Successfully downloaded and installed the following packages by using yum install command: yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm After this trying to do mkfs.lustre on my available NVMe-disk(nvme1n1)Mentioned in the below Fig [cid:image001.png@01D9145E.95FCE300] And did the mkfs.lusre on it and getting the error . mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 Permanent disk data: Target: lustre:MDT Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: checking for existing Lustre data: not found device size = 953869MB formatting backing filesystem ldiskfs on /dev/nvme1n1 target name lustre:MDT kilobytes 976762584 options-J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k mkfs.lustre: Unable to mount /dev/nvme1n1: No such device Is the ldiskfs module available? mkfs.lustre FATAL: failed to write local files mkfs.lustre: exiting with 19 (No such device) Can you help where am I going wrong? Regards, Nick Dikkat: Bu elektronik posta mesaji kisisel ve ozeldir. Eger size gonderilmediyse lutfen gondericiyi bilgilendirip mesaji siliniz. Firmamiza gelen ve giden mesajlar virus taramasindan gecirilmekte, guvenlik nedeni ile kontrol edilerek saklanmaktadir. Mesajdaki gorusler ve bakis acisi gondericiye ait olup Aselsan A.S. resmi gorusu olmak zorunda degildir. Attention: This e-mail message is privileged and confidential. If you are not the intended reci
Re: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
UNCLASSIFIED Hi, Is it valid to use two parameters at the same time? “--mgs –mdt” I dont think so. Regards, From: lustre-discuss On Behalf Of Nick dan via lustre-discuss Sent: Tuesday, December 20, 2022 7:17 AM To: lustre-discuss@lists.lustre.org Subject: [lustre-discuss] Problem in confugration of MGS and MDT server in lustre. Hi, Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. Referred from https://www.lustre.org/ Successfully downloaded and installed the following packages by using yum install command: yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm After this trying to do mkfs.lustre on my available NVMe-disk(nvme1n1)Mentioned in the below Fig [image.png] And did the mkfs.lusre on it and getting the error . mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 Permanent disk data: Target: lustre:MDT Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: checking for existing Lustre data: not found device size = 953869MB formatting backing filesystem ldiskfs on /dev/nvme1n1 target name lustre:MDT kilobytes 976762584 options-J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k mkfs.lustre: Unable to mount /dev/nvme1n1: No such device Is the ldiskfs module available? mkfs.lustre FATAL: failed to write local files mkfs.lustre: exiting with 19 (No such device) Can you help where am I going wrong? Regards, Nick ## Dikkat: Bu elektronik posta mesaji kisisel ve ozeldir. Eger size gonderilmediyse lutfen gondericiyi bilgilendirip mesaji siliniz. Firmamiza gelen ve giden mesajlar virus taramasindan gecirilmekte, guvenlik nedeni ile kontrol edilerek saklanmaktadir. Mesajdaki gorusler ve bakis acisi gondericiye ait olup Aselsan A.S. resmi gorusu olmak zorunda degildir. ## Attention: This e-mail message is privileged and confidential. If you are not the intended recipient please delete the message and notify the sender. E-mails to and from the company are monitored for operational reasons and in accordance with lawful business practices. Any views or opinions presented are solely those of the author and do not necessarily represent the views of the company. ## ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Problem in confugration of MGS and MDT server in lustre.
Hi, Nick here Trying to configure Lustre MGS and MDT on Redhat 8.6. Referred from https://www.lustre.org/ Successfully downloaded and installed the following packages by using yum install command: yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/kernel-4.18.0-372.9.1.el8_lustre.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-ldiskfs-dkms-2.15.1-1.el8.noarch.rpm yum install https://downloads.whamcloud.com/public/lustre/latest-release/el8.6/server/RPMS/x86_64/lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libcom_err-1.46.2.wc5-0.el8.x86_64.rpm yum install https://downloads.whamcloud.com/public/e2fsprogs/latest/el8/RPMS/x86_64/libss-1.46.2.wc5-0.el8.x86_64.rpm After this trying to do mkfs.lustre on my available NVMe-disk(nvme1n1)Mentioned in the below Fig [image: image.png] And did the mkfs.lusre on it and getting the error . mkfs.lustre --fsname=lustre --mgs --mdt --index=0 /dev/nvme1n1 Permanent disk data: Target: lustre:MDT Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x65 (MDT MGS first_time update ) Persistent mount opts: user_xattr,errors=remount-ro Parameters: checking for existing Lustre data: not found device size = 953869MB formatting backing filesystem ldiskfs on /dev/nvme1n1 target name lustre:MDT kilobytes 976762584 options-J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:MDT -J size=4096 -I 1024 -i 2560 -q -O dirdata,uninit_bg,^extents,dir_nlink,quota,project,huge_file,ea_inode,large_dir,^fast_commit,flex_bg -E lazy_journal_init="0",lazy_itable_init="0" -F /dev/nvme1n1 976762584k mkfs.lustre: Unable to mount /dev/nvme1n1: No such device Is the ldiskfs module available? mkfs.lustre FATAL: failed to write local files mkfs.lustre: exiting with 19 (No such device) Can you help where am I going wrong? Regards, Nick ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org