Re: [Lustre-discuss] python lustre os.stat(path)
Mark Day a écrit : > robinhood supplies this list, if you are using lustre 2.0 it directly > queries the mdt. > > http://sourceforge.net/apps/trac/robinhood > > On this subject does anyone know of a tool/app that tracks folder sizes? Robinhood can also do this. Aurélien ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] python lustre os.stat(path)
robinhood supplies this list, if you are using lustre 2.0 it directly queries the mdt. http://sourceforge.net/apps/trac/robinhood On this subject does anyone know of a tool/app that tracks folder sizes? mark - Original Message - From: "Andreas Dilger" To: "Emyr James" Cc: lustre-discuss@lists.lustre.org Sent: Friday, 18 November, 2011 3:30:02 AM Subject: Re: [Lustre-discuss] python lustre os.stat(path) On 2011-11-17, at 4:39, Emyr James wrote: > I've written a python script to walk the lustre filesystem, get the > os.stat details for each file to get the file owner id and then > generates a report of the total file size used by each user. I'm doing > it this way as users own files sprinkled throughout the filesystem as > opposed to all being filed away in neat subdirectories for each user. Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all. > As this is just using the standard posix stuff it's slow as it goes to the > OSS's to get the file info from there. Presumably it should be possible > to get this info from the MDS ? If so, what lustre specific commands > would be useful ? Is there a python module out there that links into the > lustre client libraries to access info direct from the MDS ? > Regards, > Emyr > ___ > Lustre-discuss mailing list > Lustre-discuss@lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] python lustre os.stat(path)
On 2011-11-17, at 4:39, Emyr James wrote: > I've written a python script to walk the lustre filesystem, get the > os.stat details for each file to get the file owner id and then > generates a report of the total file size used by each user. I'm doing > it this way as users own files sprinkled throughout the filesystem as > opposed to all being filed away in neat subdirectories for each user. Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all. > As this is just using the standard posix stuff it's slow as it goes to the > OSS's to get the file info from there. Presumably it should be possible > to get this info from the MDS ? If so, what lustre specific commands > would be useful ? Is there a python module out there that links into the > lustre client libraries to access info direct from the MDS ? > Regards, > Emyr > ___ > Lustre-discuss mailing list > Lustre-discuss@lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
