[lustre-discuss] LVM support

2021-03-08 Thread Sid Young via lustre-discuss
G'Day all, I put this question to another member of the list privately, but I thought it would be good to ask of the whole list, if ZFS is supported for managing a large pool of disks in a typical OSS node, could LVM be used with a stripped LV configuration? Since LVM is rock solid and most likel

Re: [lustre-discuss] Performance over 100G ethernet

2021-03-08 Thread Colin Faber via lustre-discuss
Hi Sid, Start here https://wiki.lustre.org/LNET_Selftest That should get you near wire speed numbers and you can use it to play around with your network tunables. After that, obdfilter-survey, mdtest, IOR and fio amongst others will help you determine hero and average numbers for your whole I/O

[lustre-discuss] Performance over 100G ethernet

2021-03-08 Thread Sid Young via lustre-discuss
G'Day all, What sort of transfer speeds should I expect to see from a client writing a 1G file into the Lustre storage via RoCE on a 100G ConnectX5 (write block size is 1M)? I have done virtually no tuning yet and the MTU is showing as "active 1024". If you have any links to share with some per

[lustre-discuss] Timeline for OFED 5 support?

2021-03-08 Thread Adesanya, Adeyemi via lustre-discuss
Hi everyone. Any idea when we’ll see support for OFED 5 in an upcoming Lustre release? The 2.14.0 wiki page states "OFED: inkernel” in the test matrix…… Our IB fabric is based on Mellanox HDR switches and host adapters. Thanks. ——— Yemi ___ lustre-di

Re: [lustre-discuss] How to remove an OST completely

2021-03-08 Thread Tung-Han Hsieh via lustre-discuss
Dear Zeehan, In our case, it looks like that the removed OST is disappeared. However, sometimes we feel that some "shodow" of the removed OST still exists in the Lustre file system. In our system, running "lctl get_param osc.*.conn_uuid" it shows: osc.chome-OST-osc-MDT.ost_conn_uuid=192.

Re: [lustre-discuss] How to remove an OST completely

2021-03-08 Thread Tung-Han Hsieh via lustre-discuss
Dear Etienne, Thank you very much for this information, which very interesting. Will it be available in Lustre version 2.14 ? Hope that the Lustre manual could also be updateded for the corresponding usage. Then we would be happy to test it. Best Regards, T.H.Hsieh On Fri, Mar 05, 2021 at 08:5

Re: [lustre-discuss] How to remove an OST completely

2021-03-08 Thread Zeeshan Ali Shah via lustre-discuss
Dear Tung-Han, even during all the above steps the OST still appears? we did the same for 3 OSTs in our centre and they disappeared correctly. Zeehan On Mon, Mar 8, 2021 at 11:15 AM Tung-Han Hsieh < thhs...@twcp1.phys.ntu.edu.tw> wrote: > Dear Zeeshan, > > Yes. We did lfs_migrate to move data o

Re: [lustre-discuss] How to remove an OST completely

2021-03-08 Thread Tung-Han Hsieh via lustre-discuss
Dear Zeeshan, Yes. We did lfs_migrate to move data out of the OST which we are going to remove, and then deactivate it, and then unmount it. We have verified that after the whole process, no data lost, but only the total space of the Lustre file system decreased due to the removed OST. Best Regar

Re: [lustre-discuss] How to remove an OST completely

2021-03-08 Thread Zeeshan Ali Shah via lustre-discuss
Did you unmount the OST ? remember to lfs_migrate the data otherwise old data would give errors On Fri, Mar 5, 2021 at 11:59 AM Etienne Aujames via lustre-discuss < lustre-discuss@lists.lustre.org> wrote: > Hello, > > There is some process/work in progress on the LU-7668 to remove the OST > direc