On Thu, Mar 9, 2017 at 1:28 PM, Matthew Vernon <m...@sanger.ac.uk> wrote:
> On 09/03/17 10:45, Abhishek Lekshmanan wrote: > > On 03/09/2017 11:26 AM, Matthew Vernon wrote: >> >>> >>> I'm using Jewel / 10.2.3-0ubuntu0.16.04.2 . We want to keep track of our >>> S3 users' quota and usage. Even with a relatively small number of users >>> (23) it's taking ~23 seconds. >>> >>> What we do is (in outline): >>> radosgw-admin metadata list user >>> for each user X: >>> radosgw-admin user info --uid=X #has quota details >>> radosgw-admin user stats --uid=X #has usage details >>> >>> None of these calls is particularly slow (~0.5s), but the net result is >>> not very satisfactory. >>> >>> What am I doing wrong? :) >>> >> >> Is this a single site or a multisite cluster? If you're only trying to >> read info you could try disabling the cache (it is not recommended to >> use this if you're trying to write/modify info) for eg: >> > > It's a single site. > > $ radosgw-admin user info --uid=x --rgw-cache-enabled=false >> > > That doesn't noticably change the execution time (perhaps it improves it a > little) > > also you could run the info command with higher debug (--debug-rgw=20 >> --debug-ms=1) and paste that somewhere (its very verbose) to help >> identify where we're slowing down >> > > https://drive.google.com/drive/folders/0B4TV1iNptBAdMEdUaGJI > a3U1QVE?usp=sharing > > A quick look at the logs seems to indicate that most of the time is spent on the bootstrap , I will investigate it further. Should let you see the output from running this with that cache-disabling > option (and without). > > Naiively, I find myself wondering if some sort of all-users flag to the > info and stats command or a "tell me usage and quota with one call" command > would be quicker. > That sounds a good idea :), can you open a tracker feature issue for this Regards, Orit > > Thanks, > > Matthew > > > -- > The Wellcome Trust Sanger Institute is operated by Genome Research > Limited, a charity registered in England with number 1021457 and a company > registered in England with number 2742969, whose registered office is 215 > Euston Road, London, NW1 2BE. ______________________________ > _________________ > > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
