Re: [ceph-users] Tens of millions of objects in a sharded bucket

2018-04-20 Thread Rafał Wądołowski
Hi, We have some buckets with ~25M files inside. We've also using bucket index sharding. The performance is good, we are focused on read. BR, Rafal Wadolowski On 20.04.2018 00:57, Robert Stanford wrote: > >  The rule of thumb is not to have tens of millions of objects in a > radosgw bucket,

[ceph-users] Tens of millions of objects in a sharded bucket

2018-04-19 Thread Robert Stanford
The rule of thumb is not to have tens of millions of objects in a radosgw bucket, because reads will be slow. If using bucket index sharding (with 128 or 256 shards), does this eliminate this concern? Has anyone tried tens of millions (20-40M) of objects with sharded indexes? Thank you