[ceph-users] Re: How to organize data in S3

2021-05-24 Thread Matt Benjamin
The one side effect you might see if you actually create a million or more bucklets for a single user, is a large OMAP warning, as the mapping of buckets to owners is not sharded. Matt On Mon, May 24, 2021 at 1:51 AM Michal Strnad wrote: > > Thank you. So we can create millions of buckets

[ceph-users] Re: How to organize data in S3

2021-05-24 Thread Janne Johansson
Den mån 24 maj 2021 kl 07:51 skrev Michal Strnad : > > Thank you. So we can create millions of buckets associated to only one > S3 account without any limitation or side effect? Does anyone use it > this way? I'm not sure listing buckets will be fun if you literally create "millions of buckets"

[ceph-users] Re: How to organize data in S3

2021-05-24 Thread Konstantin Shalygin
By default when account is creating max buckets for account is 1000. You can change this default and any time set max buckets setting for any already created account k Sent from my iPhone > On 24 May 2021, at 08:52, Michal Strnad wrote: > > Thank you. So we can create millions of buckets

[ceph-users] Re: How to organize data in S3

2021-05-23 Thread Michal Strnad
Thank you. So we can create millions of buckets associated to only one S3 account without any limitation or side effect? Does anyone use it this way? Many thanks in advance. Michal On 5/23/21 9:42 PM, Janne Johansson wrote: > Many buckets. > > Den sön 23 maj 2021 kl 20:53 skrev Michal Strnad :

[ceph-users] Re: How to organize data in S3

2021-05-23 Thread Janne Johansson
Many buckets. Den sön 23 maj 2021 kl 20:53 skrev Michal Strnad : > > Hi all, > > We need to store millions of files using S3 protocol in Ceph (version > Nautilus), but have projects where isn't appropriate or possible to > create a lot of S3 accounts. Is it better to have multiple S3 buckets or >