Re: [lustre-discuss] OST not being used
Hi Megan, all, Yes, sorry, I should have said. Its 2.12.6. A bit more detail. I can set the stripe index to 0-3 and 8-191, and it works fine. However, when I set the stripe index to 4-7, they all end up on OST 8. It is a system with 192 OSTs and 24 OSSs. These 4 OSTs are all served on the second NIC of the first OSS server, so suggests a NIC problem (HDR100). However, the NIC appears to be fine, I can ping it, ssh into it, etc. lctl dl returns the OSTs as expected. I suspect that it has at some point been deemed to have failed, and marked as such. However I can't find such a mark, and can't work how to return it to operation. Thanks, Alastair. On Mon, 21 Jun 2021, Ms. Megan Larko via lustre-discuss wrote: [EXTERNAL EMAIL] Greetings Alastair! You did not indicate which version of Lustre you are using. FYI it can be useful to aiding you in your Lustre queries. You show your command "lfs setstripe --stripe-index 7 myfile.dat". The Lustre Operations Manual ( https://doc.lustre.org/lustre_manual.xhtml ) Section 40.1.1 "Synopsis: indicates that stripe-index starts counting at zero. My reading of the Manual indicates that starting at zero and using a default stripe count of one might correctly put the file on to obd index 8. Depending upon whether or not obdidx starts at zero or one, eight might possibly be the correct result. Did you try using a stripe-index of 6 to see if the resulting stripe count of one file is then on obdidx 7? If the OST is not usable then the command "lctl dl" will indicate that (as does the command you used for active OST devices. Your info does seem to indicate that the OST 7 is okay. Cheers, megan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] OST not being used
Greetings Alastair! You did not indicate which version of Lustre you are using. FYI it can be useful to aiding you in your Lustre queries. You show your command "lfs setstripe --stripe-index 7 myfile.dat". The Lustre Operations Manual ( https://doc.lustre.org/lustre_manual.xhtml ) Section 40.1.1 "Synopsis: indicates that stripe-index starts counting at zero. My reading of the Manual indicates that starting at zero and using a default stripe count of one might correctly put the file on to obd index 8. Depending upon whether or not obdidx starts at zero or one, eight might possibly be the correct result. Did you try using a stripe-index of 6 to see if the resulting stripe count of one file is then on obdidx 7? If the OST is not usable then the command "lctl dl" will indicate that (as does the command you used for active OST devices. Your info does seem to indicate that the OST 7 is okay. Cheers, megan ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] OST not being used
Hi, I'm trying to specify a particular OST to be used with: lfs setstripe --stripe-index 7 myfile.dat However, a lfs getstripe reveals that it hasn't managed to use this OST: myfile.dat lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen:0 lmm_stripe_offset: 8 obdidx objid objid group 87503 0x1d4f0 So, I assume the OST has been marked as unusable for some reason - how do I find out why, and set it back to usable? A: lctl get_param osc.fsname-*.active gives 1 for all OSTs. Likewise: lctl get_param osp.fsname-OST*.max_create_count gives 2 for all OSTs. What else should I check? Thanks, Alastair. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] LAD'21: Save the date!
LAD'21 - Lustre Administrators and Developers Workshop September 28th-30th, 2021 Online webinar + chat platform We are glad to announce LAD’21! This event will be a great opportunity for worldwide Lustre administrators and developers to gather and exchange their experiences, developments, tools, good practices and more. This year again, it will take place online from September 28th to September 30th, 2021. Like last year, pre-recorded sessions will be broadcasted twice a day for the various time zones. Additionally, a chat platform will be setup to manage questions/answers and to allow discussions with the speakers and the Lustre community. Make sure to book this date in your agenda! The call for paper will be sent soon. Best regards, The LAD organization team. WEB PAGE https://www.eofs.eu/events/lad21 [cid:81497565-0c14-4306-bfae-4d5c0f724d30] ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
