Re: [Lustre-discuss] python lustre os.stat(path)
robinhood supplies this list, if you are using lustre 2.0 it directly queries the mdt. http://sourceforge.net/apps/trac/robinhood On this subject does anyone know of a tool/app that tracks folder sizes? mark - Original Message - From: Andreas Dilger adil...@whamcloud.com To: Emyr James emyrjam...@gmail.com Cc: lustre-discuss@lists.lustre.org Sent: Friday, 18 November, 2011 3:30:02 AM Subject: Re: [Lustre-discuss] python lustre os.stat(path) On 2011-11-17, at 4:39, Emyr James emyrjam...@gmail.com wrote: I've written a python script to walk the lustre filesystem, get the os.stat details for each file to get the file owner id and then generates a report of the total file size used by each user. I'm doing it this way as users own files sprinkled throughout the filesystem as opposed to all being filed away in neat subdirectories for each user. Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all. As this is just using the standard posix stuff it's slow as it goes to the OSS's to get the file info from there. Presumably it should be possible to get this info from the MDS ? If so, what lustre specific commands would be useful ? Is there a python module out there that links into the lustre client libraries to access info direct from the MDS ? Regards, Emyr ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] python lustre os.stat(path)
Mark Day a écrit : robinhood supplies this list, if you are using lustre 2.0 it directly queries the mdt. http://sourceforge.net/apps/trac/robinhood On this subject does anyone know of a tool/app that tracks folder sizes? Robinhood can also do this. Aurélien ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
[Lustre-discuss] python lustre os.stat(path)
Hi, I've written a python script to walk the lustre filesystem, get the os.stat details for each file to get the file owner id and then generates a report of the total file size used by each user. I'm doing it this way as users own files sprinkled throughout the filesystem as opposed to all being filed away in neat subdirectories for each user. As this is just using the standard posix stuff it's slow as it goes to the OSS's to get the file info from there. Presumably it should be possible to get this info from the MDS ? If so, what lustre specific commands would be useful ? Is there a python module out there that links into the lustre client libraries to access info direct from the MDS ? Regards, Emyr ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] python lustre os.stat(path)
On 2011-11-17, at 4:39, Emyr James emyrjam...@gmail.com wrote: I've written a python script to walk the lustre filesystem, get the os.stat details for each file to get the file owner id and then generates a report of the total file size used by each user. I'm doing it this way as users own files sprinkled throughout the filesystem as opposed to all being filed away in neat subdirectories for each user. Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all. As this is just using the standard posix stuff it's slow as it goes to the OSS's to get the file info from there. Presumably it should be possible to get this info from the MDS ? If so, what lustre specific commands would be useful ? Is there a python module out there that links into the lustre client libraries to access info direct from the MDS ? Regards, Emyr ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
