Re: [ceph-users] RGW configuration parameters

[Casey Bodley]

On 7/30/19 3:03 PM, Thomas Bennett wrote:

Hi Casey,

Thanks for your reply.

Just to make sure I understand correctly-  would that only be if the 
S3 object size for the put/get is multiples of your rgw_max_chunk_size?


whenever the object size is larger than a single chunk




Kind regards,
Tom

On Tue, 30 Jul 2019 at 16:57, Casey Bodley > wrote:


Hi Thomas,

I see that you're familiar with rgw_max_chunk_size, which is the most
object data that radosgw will write in a single osd request. Each
PutObj
and GetObj request will issue multiple osd requests in parallel,
up to
these configured window sizes. Raising these values can potentially
improve throughput at the cost of increased memory usage.

On 7/30/19 10:36 AM, Thomas Bennett wrote:
> Does anyone know what these parameters are for. I'm not 100% sure I
> understand what a window is in context of rgw objects:
>
>   * rgw_get_obj_window_size
>   * rgw_put_obj_min_window_size
>
> The code points to throttling I/O. But some more info would be
useful.
>
> Kind regards,
> Tom
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com 
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

--
Thomas Bennett

Storage Engineer at SARAO

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] RGW configuration parameters

[Thomas Bennett]

Hi Casey,

Thanks for your reply.

Just to make sure I understand correctly-  would that only be if the S3
object size for the put/get is multiples of your rgw_max_chunk_size?

Kind regards,
Tom

On Tue, 30 Jul 2019 at 16:57, Casey Bodley  wrote:

> Hi Thomas,
>
> I see that you're familiar with rgw_max_chunk_size, which is the most
> object data that radosgw will write in a single osd request. Each PutObj
> and GetObj request will issue multiple osd requests in parallel, up to
> these configured window sizes. Raising these values can potentially
> improve throughput at the cost of increased memory usage.
>
> On 7/30/19 10:36 AM, Thomas Bennett wrote:
> > Does anyone know what these parameters are for. I'm not 100% sure I
> > understand what a window is in context of rgw objects:
> >
> >   * rgw_get_obj_window_size
> >   * rgw_put_obj_min_window_size
> >
> > The code points to throttling I/O. But some more info would be useful.
> >
> > Kind regards,
> > Tom
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
-- 
Thomas Bennett

Storage Engineer at SARAO
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] RGW configuration parameters

[Casey Bodley]

Hi Thomas,

I see that you're familiar with rgw_max_chunk_size, which is the most 
object data that radosgw will write in a single osd request. Each PutObj 
and GetObj request will issue multiple osd requests in parallel, up to 
these configured window sizes. Raising these values can potentially 
improve throughput at the cost of increased memory usage.


On 7/30/19 10:36 AM, Thomas Bennett wrote:
Does anyone know what these parameters are for. I'm not 100% sure I 
understand what a window is in context of rgw objects:


  * rgw_get_obj_window_size
  * rgw_put_obj_min_window_size

The code points to throttling I/O. But some more info would be useful.

Kind regards,
Tom

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com