Re: bucket index sharding - IO throttle

2014-08-12 Thread Guang Yang
Hi Yehuda, Can you help to review the latest patch with throttle mechanism you suggested. Thanks! Thanks, Guang On Aug 4, 2014, at 3:20 PM, Guang Yang yguan...@outlook.com wrote: Hi Yehuda, Here is the new pull request - https://github.com/ceph/ceph/pull/2187 Thanks, Guang On Jul 31,

Re: bucket index sharding - IO throttle

2014-08-06 Thread Guang Yang
Hi Osier, I doubt the issue is related (the error message is connection failure), the below patch is pretty simple (and incomplete), what it does is to add a configuration to bucket meta info so that we can configure the number of shards on bucket basis (again, this is not included in the

Re: bucket index sharding - IO throttle

2014-08-05 Thread Osier Yang
On 2014年08月04日 15:20, Guang Yang wrote: Hi Yehuda, Here is the new pull request - https://github.com/ceph/ceph/pull/2187 I simply applied the patch on git top, and the testing shows rest-bench is completely broken with the 2 patches: root@testing-s3gw0:~/s3-tests# /usr/bin/rest-bench

Re: bucket index sharding - IO throttle

2014-08-04 Thread Guang Yang
Hi Yehuda, Here is the new pull request - https://github.com/ceph/ceph/pull/2187 Thanks, Guang On Jul 31, 2014, at 10:40 PM, Guang Yang yguan...@outlook.com wrote: Thanks Yehuda. I will do that (sorry I was occupied by some other stuff recently but I will try my best to provide a patch as

Re: bucket index sharding - IO throttle

2014-07-31 Thread Guang Yang
Thanks Yehuda. I will do that (sorry I was occupied by some other stuff recently but I will try my best to provide a patch as soon as possible). Thanks, Guang 在 2014年7月31日,上午1:00,Yehuda Sadeh yeh...@inktank.com 写道: Can you send this code through a github pull request (or at least as a

Re: bucket index sharding - IO throttle

2014-07-30 Thread Guang Yang
+ceph-devel. Thanks, Guang On Jul 29, 2014, at 10:20 PM, Guang Yang yguan...@outlook.com wrote: Hi Yehuda, Per you review comment in terms of IO throttling for bucket index operation, I prototyped the below code (details still need to polish), can you take a look if that is right way to

Re: bucket index sharding - IO throttle

2014-07-30 Thread Yehuda Sadeh
Can you send this code through a github pull request (or at least as a patch)? It'lll be easier to review and comment. Thanks, Yehuda On Wed, Jul 30, 2014 at 7:58 AM, Guang Yang yguan...@outlook.com wrote: +ceph-devel. Thanks, Guang On Jul 29, 2014, at 10:20 PM, Guang Yang