[ceph-users] Re: How to get rbd block device IOPS and BW performance showing?

2021-04-24 Thread ceph
With at least nautlius enable ceph mgr module enable rbd_support then these are available rbd perf image iotop Or rbd perf image iostat Hf Mehmet Am 23. April 2021 14:08:17 MESZ schrieb "huxia...@horebdata.cn" : >Dear Ceph folks, > >I have a Luminous ceph cluster serving rbd block devices f

[ceph-users] Re: Different ceph versions on nodes in cluster

2021-04-24 Thread Eugen Block
You mention here the "recommended (and most tested) order" which order is that? Using cephadm with containers wouldn't the orchestrator command below take care of everything without having me to worry about any upgraded order/path? Yes, the orchestrator does that for you, but it can't hur

[ceph-users] Pacific, one of monitor service doesnt response.

2021-04-24 Thread Cem Zafer
Hi, I have no problem with my cluster before but when upgraded from 15.2.11 to 16.2.0 one of my ceph monitor service does not work. I have looked at the service log but cant figure it out. Can someone have any idea what could be wrong with that monitor service? Here is the service attached log. Reg

[ceph-users] Re: Unable to delete versioned bucket

2021-04-24 Thread Mark Schouten
Hi, Thanks! On Fri, Apr 23, 2021 at 10:04:52PM +0530, Soumya Koduri wrote: > This command is working for DeleteMarker at least on the latest master. I am > not sure if there is any bug in the version you are using. One other way to > delete them is to set lifecycle policy on the bucket with below

[ceph-users] Re: Pacific, one of monitor service doesnt response.

2021-04-24 Thread Eugen Block
Hi, without looking into the details, if other MONs are in quorum and the cluster is otherwise healthy you could try to remove the MON store and restart the container. Zitat von Cem Zafer : Hi, I have no problem with my cluster before but when upgraded from 15.2.11 to 16.2.0 one of my ce

[ceph-users] libceph: get_reply osd2 tid 1459933 data 3248128 > preallocated 131072, skipping

2021-04-24 Thread Markus Kienast
I am seeing these messages when booting from RBD and booting hangs there. libceph: get_reply osd2 tid 1459933 data 3248128 > preallocated 131072, skipping However, Ceph Health is OK, so I have no idea what is going on. I reboot my 3 node cluster and it works again for about two weeks. How can I

[ceph-users] RBD tuning for virtualization (all flash)

2021-04-24 Thread by morphin
Hello. We're running 1000vm on 28 node with 6 ssd (no seperate db device) and these vms are Mostly win10. 2 lvm osd Per 4tb device total 288osd and one RBD pool with 8192 PG. Replication 3. Ceph version : nautilus 14.2.16 I'm looking for all flash RBD tuning. This is good test env and tomorrow