Proxmox = 6.4-8
CEPH = 15.2.15
Nodes = 3
Network = 2x100G / node
Disk = nvme Samsung PM-1733 MZWLJ3T8HBLS 4TB
nvme Samsung PM-1733 MZWLJ1T9HBJR 2TB
CPU = EPYC 7252
CEPH pools = 2 separate pools for each disk type and each disk spliced in 2
OSD's
Replica = 3
VM don't do many
> Where is the rados bench before and after your problem?
Rados bench before deleting OSD's and recreating them + syncing with
fragmentation 0.89
T1 - wr,4M T2 = ro,seq,4M T3 = ro,rand,4M
> Total time run 60.0405 Total time run 250.486 Total time run
> 600.463
> Total writes made
> Where is the rados bench before and after your problem?
Rados bench before deleting OSD's and recreating them + syncing with
fragmentation 0.89
T1 - wr,4M T2 = ro,seq,4M T3 = ro,rand,4M
> Total time run 60.0405 Total time run 250.486 Total time run
> 600.463
> Total writes made
> Where is the rados bench before and after your problem?
Rados bench before deleting OSD's and recreating them + syncing with
fragmentation 0.89
T1 - wr,4M T2 = ro,seq,4M T3 = ro,rand,4M
> Total time run 60.0405 Total time run 250.486 Total time run
> 600.463
> Total writes made
Rados bench before deleting OSD's and recreating them + syncing with
fragmentation 0.89
> T1 - wr,4M
> Total time run 60.0405
> Total writes made 9997
> Write size 4194304
> Object size4194304
> Bandwidth (MB/sec) 666,017
> Stddev Bandwidth 24.1108
> Max
> First of all I'd like to clarify what exact command are you using to
> assess the fragmentation. There are two options: "bluestore allocator
> score" and "bluestore allocator fragmentation"
I am using this one : "ceph daemon osd.$i bluestore allocator score block"
> Both are not very accurate th
