Re: [lustre-discuss] LUG 2022 REGISTRATION IS NOW OPEN!

[Kirill Lozinskiy via lustre-discuss]

Kilian,

Thank you for bringing this up and expressing your concerns!

We typically provide an overview of the OpenSFS finances at the Annual
Members Meeting that takes place at LUG. We understand that there is
interest in going deeper into the annual budget, so the OpenSFS Board of
Directors would like to invite any interested OpenSFS Members and
Participants to attend a budget deepdive next week on Wednesday, April 27th
at 12:30 PM Pacific time. If you are interested in attending the Board Zoom
call, please let us know so we can send you the invite. You can email
ad...@opensfs.org if you are interested in attending.

Thank you for bringing this up, and we hope to see you next week!

Warm regards,

Kirill Lozinskiy
OpenSFS Treasurer


On Thu, Apr 21, 2022 at 3:17 PM Kilian Cavalotti via Execs <
ex...@lists.opensfs.org> wrote:

> Dear OpenSFS,
>
> On Thu, Apr 21, 2022 at 9:06 AM OpenSFS Administration via
> lustre-discuss  wrote:
>
> > We’re excited to announce that registration for the Lustre User Group
> (LUG) 2022 virtual conference is now open. REGISTER ONLINE.  General
> registration is $175.
>
> So, just to clarify: the event is entirely virtual and yet
> participants will be charged a $175 registration fee?
> That seems a bit steep... :(
>
> What's the rationale here? Especially considering that registration
> for both LUG 2021 and LUG Webinar Series in 2020 (both virtual events
> as well) was free.
>
> Cheers,
> --
> Kilian
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Essential tools for Lustre

[Andreas Dilger via lustre-discuss]

Quota accounting adds about 1% overhead, but has been enabled by default for 
several years already.

Quota *enforcement* can have a higher overhead when close to the quota limits, 
and of course will remove 100% of performance when the limit is exceeded.

Cheers, Andreas

On Apr 22, 2022, at 13:40, Raj  wrote:


Andreas, Is there any IO penalties in enabling project quota? Will I see the 
same throughput from the FS?
Thanks
-Raj

On Fri, Apr 15, 2022 at 1:32 PM Andreas Dilger via lustre-discuss 
mailto:lustre-discuss@lists.lustre.org>> wrote:
Note that in newer Lustre releases, if you have project IDs enabled (you don't 
need to *enforce* project quotas, just have quota accounting enabled), that 
"df" (statfs()) will return the quota for the project ID on that directory 
tree.  It isn't _quite_ "fast du" for arbitrary directory trees, but quite 
useful in any case.


On Apr 15, 2022, at 11:17, Steve L via lustre-discuss 
mailto:lustre-discuss@lists.lustre.org>> wrote:

Hi Thomas,

Thanks for the tips.

I have a client that they are looking into implementing their own "fast du". I 
will look into Robinhood to see if there are any duplicated functions.  Not 
sure if they are looking into advanced functionality like policy management, 
thou.

Does Robinhood offer APIs, or command-line tools to provide "du" like data? If 
not, how about direct database accesses?

/steve

From: thomas.leibov...@cea.fr 
mailto:thomas.leibov...@cea.fr>>
Sent: Friday, April 15, 2022 4:03 AM
To: 'Steve L' mailto:slc1...@outlook.com>>
Cc: lustre-discuss@lists.lustre.org 
mailto:lustre-discuss@lists.lustre.org>>
Subject: RE: Essential tools for Lustre

Dear Steve,



>What are the essential tools to make life easier in the Lustre ecosystem?



We use and maintain to those 2 open-source tools:
-  Shine, for Lustre administration: https://github.com/cea-hpc/shine
-  RobinHood policy engine for managing data in filesystems: 
https://github.com/cea-hpc/robinhood/wiki



Best regards,
Thomas



De : lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] De la part 
de Steve L via lustre-discuss
Envoyé : samedi 9 avril 2022 00:52
À : lustre-discuss@lists.lustre.org
Objet : [lustre-discuss] Essential tools for Lustre



Hi All,



I am new to Lustre. I like to know if anyone out there is actively using IML 
(Integrated Manager for Lustre) to administer and/or monitor Lustre?



If yes, I plan to run Lustre LTS (e.g., 2.12.8). Do you know if IML can run 
against 2.12.8? IML official website seems to be very quiet for the last year. 
Is the project still alive?



If no, do you run any other GUI or non-GUI tools to help administer/monitor? 
What are the essential tools to make life easier in the Lustre ecosystem?



Any pointers are deeply appreciated.



If this is not the right forum to ask such questions, please accept my apology. 
I searched the archive, but could not discover any items related to IML.



Thanks ahead for your assistance.



Steve



___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Whamcloud







___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Essential tools for Lustre

[Raj via lustre-discuss]

Andreas, Is there any IO penalties in enabling project quota? Will I see
the same throughput from the FS?
Thanks
-Raj

On Fri, Apr 15, 2022 at 1:32 PM Andreas Dilger via lustre-discuss <
lustre-discuss@lists.lustre.org> wrote:

> Note that in newer Lustre releases, if you have project IDs enabled (you
> don't need to *enforce* project quotas, just have quota accounting
> enabled), that "df" (statfs()) will return the quota for the project ID on
> that directory tree.  It isn't _quite_ "fast du" for arbitrary directory
> trees, but quite useful in any case.
>
>
> On Apr 15, 2022, at 11:17, Steve L via lustre-discuss <
> lustre-discuss@lists.lustre.org> wrote:
>
> Hi Thomas,
>
> Thanks for the tips.
>
> I have a client that they are looking into implementing their own "fast
> du". I will look into Robinhood to see if there are any duplicated
> functions.  Not sure if they are looking into advanced functionality like
> policy management, thou.
>
> Does Robinhood offer APIs, or command-line tools to provide "du" like
> data? If not, how about direct database accesses?
>
> /steve
> --
> *From:* thomas.leibov...@cea.fr 
> *Sent:* Friday, April 15, 2022 4:03 AM
> *To:* 'Steve L' 
> *Cc:* lustre-discuss@lists.lustre.org 
> *Subject:* RE: Essential tools for Lustre
>
> Dear Steve,
>
>
> >What are the essential tools to make life easier in the Lustre ecosystem?
>
>
> We use and maintain to those 2 open-source tools:
> -  Shine, for Lustre administration:
> https://github.com/cea-hpc/shine
> -  RobinHood policy engine for managing data in filesystems:
> https://github.com/cea-hpc/robinhood/wiki
>
>
> Best regards,
> Thomas
>
>
> *De :* lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org
> ] *De la part de* Steve L via
> lustre-discuss
> *Envoyé :* samedi 9 avril 2022 00:52
> *À :* lustre-discuss@lists.lustre.org
> *Objet :* [lustre-discuss] Essential tools for Lustre
>
>
> Hi All,
>
>
> I am new to Lustre. I like to know if anyone out there is actively using
> IML (Integrated Manager for Lustre) to administer and/or monitor Lustre?
>
>
> If yes, I plan to run Lustre LTS (e.g., 2.12.8). Do you know if IML can
> run against 2.12.8? IML official website seems to be very quiet for the
> last year. Is the project still alive?
>
>
> If no, do you run any other GUI or non-GUI tools to help
> administer/monitor? What are the essential tools to make life easier in the
> Lustre ecosystem?
>
>
> Any pointers are deeply appreciated.
>
>
> If this is not the right forum to ask such questions, please accept my
> apology. I searched the archive, but could not discover any items related
> to IML.
>
>
> Thanks ahead for your assistance.
>
>
> Steve
>
>
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
>
> Cheers, Andreas
> --
> Andreas Dilger
> Lustre Principal Architect
> Whamcloud
>
>
>
>
>
>
>
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org