Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-05-01 Thread Gregory Farnum
On Mon, Apr 30, 2018 at 10:57 PM Wido den Hollander wrote: > > > On 04/30/2018 10:25 PM, Gregory Farnum wrote: > > > > > > On Thu, Apr 26, 2018 at 11:36 AM Wido den Hollander > > wrote: > > > > Hi, > > > > I've been investigating the

Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-05-01 Thread David Turner
Primary RGW usage. 270M objects, 857TB data/1195TB raw, EC 8+3 in the RGW data pool, less than 200K objects in all other pools. OSDs 366 and 367 are NVMe OSDs, the rest are 10TB disks for data/DB and 2GB WAL NVMe partition. The only things on the NVMe OSDs are the RGW metadata pools. I only

Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-04-30 Thread Wido den Hollander
On 04/30/2018 10:25 PM, Gregory Farnum wrote: > > > On Thu, Apr 26, 2018 at 11:36 AM Wido den Hollander > wrote: > > Hi, > > I've been investigating the per object overhead for BlueStore as I've > seen this has become a topic for a lot of

Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-04-30 Thread Gregory Farnum
On Thu, Apr 26, 2018 at 11:36 AM Wido den Hollander wrote: > Hi, > > I've been investigating the per object overhead for BlueStore as I've > seen this has become a topic for a lot of people who want to store a lot > of small objects in Ceph using BlueStore. > > I've writting a

Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-04-27 Thread Konstantin Shalygin
I've writting a piece of Python code which can be run on a server running OSDs and will print the overhead. https://gist.github.com/wido/b1328dd45aae07c45cb8075a24de9f1f Feedback on this script is welcome, but also the output of what people are observing. For mixed (filestore / bluestore)

Re: [ceph-users] Collecting BlueStore per Object DB overhead

2018-04-27 Thread Dietmar Rieder
Hi Wido, thanks for the tool. Here are some stats from our cluster: Ceph 12.2.4, 240 OSDs, CephFS only onodes db_used_bytes avg_obj_sizeoverhead_per_obj Mean214871 1574830080 2082298 7607 Max 309855 3018850304 3349799 17753

[ceph-users] Collecting BlueStore per Object DB overhead

2018-04-26 Thread Wido den Hollander
Hi, I've been investigating the per object overhead for BlueStore as I've seen this has become a topic for a lot of people who want to store a lot of small objects in Ceph using BlueStore. I've writting a piece of Python code which can be run on a server running OSDs and will print the overhead.