[ceph-users] Re: Cannot mount RBD on client

Hi, By netcat I can see that OSD and MON ports are open. You check from your client? You can use rados cli to ensure your client can actually use your ceph cluster. Étienne From: service.pl...@ya.ru Sent: Friday, 21 June 2024 11:39 To: ceph-users@ceph.io

[ceph-users] Re: Performance of volume size, not a block size

Hi, Volume size doesn't affect performance, cloud providers apply a limit to ensure they can deliver expected performances to all their customers. Étienne From: Mitsumasa KONDO Sent: Monday, 15 April 2024 06:06 To: ceph-users@ceph.io Subject: [ceph-users]

[ceph-users] Re: CephFS space usage

Hi, Check your replication/EC configuration. How do you get your different sizes/usages? Étienne From: Thorne Lawler Sent: Wednesday, 13 March 2024 03:58 To: ceph-users@ceph.io Subject: [ceph-users] CephFS space usage [Some people who received this message

[ceph-users] Re: [CEPH] Ceph multi nodes failed

Hello, How many nodes do you have? > -Original Message- > From: Nguyễn Hữu Khôi > Sent: vendredi 24 novembre 2023 07:42 > To: ceph-users@ceph.io > Subject: [ceph-users] [CEPH] Ceph multi nodes failed > > Hello guys. > > I see many docs and threads talking about osd failed. I have a

[ceph-users] Re: OSDs down after reweight

Hi, You probably caused a large rebalance and overload your slow HDD. But all OSD are up in what you are sharing. Also, I see you changed weight and reweight values, that's what you wanted? Étienne > -Original Message- > From: Frank Schilder > Sent: mardi 15 novembre 2022 10:38 > To:

[ceph-users] Re: SMB and ceph question

Hey, There is a ceph VFS module you may want to look at, it will rely on cephfs data. https://github.com/samba-team/samba/blob/master/source3/modules/vfs_ceph.c Check for samba configuration `vfs objects = ceph` Étienne > -Original Message- > From: Christophe BAILLON > Sent: jeudi

[ceph-users] Re: Reducing ceph cluster size in half

just a safety check. - Then decrease PG if needed. - Etienne Menguy etienne.men...@croit.io > On 21 Feb 2022, at 22:58, Jason Borden wrote: > > Hi all, > > I'm looking for some advice on reducing my ceph cluster in half. I currently > have 40 hosts and 160 osds on

[ceph-users] Re: ceph osd purge => 4 PGs stale+undersized+degraded+peered

You removed OSD from 3 different hosts? I’m surprised it was healthy as purging stopped OSD is only going to ‘clean' crushmap. Is there any recover in progress? - Etienne Menguy etienne.men...@croit.io > On 17 Jan 2022, at 15:41, Rafael Diaz Maurin > wrote: > > Hello, >

[ceph-users] Re: ceph osd purge => 4 PGs stale+undersized+degraded+peered

Hi, Your cluster was healthy before purging osd? How much time did you wait between stoping osd and purging them? Étienne > On 17 Jan 2022, at 15:24, Rafael Diaz Maurin > wrote: > > Hello, > > All my pools on the cluster are replicated (x3). > > I purged some OSD (after I stopped them) and

[ceph-users] Re: Best way to add multiple nodes to a cluster?

o move PG only once. It's a bit more complex than just changing OSD weight. You can also change some settings to modify rebalance speed. - Etienne Menguy etienne.men...@croit.io > On 2 Nov 2021, at 07:20, Zakhar Kirpichenko wrote: > > Hi! > > I have a 3-node 16.2.6 cluster w

[ceph-users] Re: Free space in ec-pool should I worry?

Hi, Why do you think it’s used at 91%? Ceph reports 47.51% usage for this pool. - Etienne Menguy etienne.men...@croit.io > On 1 Nov 2021, at 18:03, Szabo, Istvan (Agoda) wrote: > > Hi, > > Theoretically my data pool is on 91% used but the fullest osd is on 60%, >

[ceph-users] Re: Replication question

er to put back PG to their original OSD. - Etienne Menguy etienne.men...@croit.io > On 30 Oct 2021, at 11:05, Yury Kirsanov wrote: > > Hi everyone, > I have a CEPH cluster with 3 MON/MGR/MDS nodes, 3 OSD nodes each hosting > two OSDs (2 HDDs, 1 OSD per HDD). My pools are confi

[ceph-users] Re: Cluster Health error's status

Could your hardware be faulty? You are trying to deploy the faulty monitor? Or a whole new cluster? If you are trying to fix your cluster, you should focus on OSD. A cluster can run without big troubles with 2 monitors for few days (if not years…). - Etienne Menguy etienne.men...@croit.io

[ceph-users] Re: Cluster Health error's status

Have you tried to restart one of the OSD that seems to block PG recover? I don’t think increasing PG can help. - Etienne Menguy etienne.men...@croit.io > On 29 Oct 2021, at 11:53, Michel Niyoyita wrote: > > Hello Eugen > > The failure_domain is host level and crush rule is

[ceph-users] Re: Cluster Health error's status

I guess it is the cause If I am not mistaken I don’t think monitor issue is the root cause of the unfound objects. You could easily delete monitor and deploy it again to “fix” your monitor quorum. - Etienne Menguy etienne.men...@croit.io > On 29 Oct 2021, at 11:30, Michel Niyoyita wrot

[ceph-users] Re: Cluster Health error's status

With “ceph pg x.y query” you can check why it’s complaining. x.y for pg id, like 5.77 It would also be interesting to check why mon fails to rejoin quorum, it may give you hints at your OSD issues. - Etienne Menguy etienne.men...@croit.io > On 29 Oct 2021, at 10:34, Michel Niyoyita wr

[ceph-users] Re: Cluster Health error's status

Hi, Please share “ceph -s” output. - Etienne Menguy etienne.men...@croit.io > On 29 Oct 2021, at 10:03, Michel Niyoyita wrote: > > Hello team > > I am running a ceph cluster with 3 monitors and 4 OSDs nodes running 3osd > each , I deployed my ceph cluster using ansibl

[ceph-users] Re: Can CEPH RBD devices be assigned to virtual machines in pre-allocation mode?

Hi, You mean pre allocating space of an rbd image? As far as I know it’s not possible on ceph side. Maybe your hypervisor allows it. - Etienne Menguy etienne.men...@croit.io > On 22 Oct 2021, at 03:58, tommy sway wrote: > > anyone can help me？ > > > On 10/21/2021 16:39

[ceph-users] Re: inconsistent pg after upgrade nautilus to octopus

Hi, You should check for inconsistency root cause. https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-pg/#pgs-inconsistent <https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-pg/#pgs-inconsistent> - Etienne Menguy etienne.men...@croit.io >

[ceph-users] Re: Ceph Community Ambassador Sync

Hi, Is tomorrow meeting still planned? I joined last month but there was nobody (could it be a timezone failure on my side?) - Etienne Menguy etienne.men...@croit.io > On 17 Sep 2021, at 20:46, Michel Niyoyita wrote: > > Hello Mike > > Where can we find a list

[ceph-users] Re: Erasure coded pool chunk count k

Hi, It depends of hardware, failure domain, use case, overhead. I don’t see an easy way to chose k and m values. - Etienne Menguy etienne.men...@croit.io > On 4 Oct 2021, at 16:57, Golasowski Martin wrote: > > Hello guys, > how does one estimate number of chunks for erasure co

[ceph-users] Re: Change max backfills

Hi, In the past you had this output if value was not changing, try with another value. I don’t know if things changed with latest Ceph version. - Etienne Menguy etienne.men...@croit.io > On 22 Sep 2021, at 15:34, Pascal Weißhaupt > wrote: > > Hi, > > > > I rec

[ceph-users] Re: Why set osd flag to noout during upgrade ?

meanwhile. - During an upgrade you have an ‘unusual’ cluster with different versions. It’s supposed to work, but you probably want to keep it ‘boring’. - Etienne Menguy etienne.men...@croit.io > On 22 Sep 2021, at 11:51, Francois Legrand wrote: > > Hello everybody, > > I

[ceph-users] Re: What's your biggest ceph cluster?

Hi, It’s not an easy question as bottleneck can be very different depending of use case/hardware. You may be interested by last ceph user survey results : https://ceph.io/en/news/blog/2021/2021-ceph-user-survey-results/

[ceph-users] Re: Replacing swift with RGW

Hi, There are some information on Ceph documentation https://docs.ceph.com/en/latest/radosgw/keystone/ . - Use keystone as auth for RGW - Create service and register your RGW as swift Étienne > On 27 Aug 2021, at 15:47, Michel Niyoyita

[ceph-users] Re: PGs stuck after replacing OSDs

Hi, It’s hard to explain as issue is no longer here, if it happens again “ceph pg x.y query” output could be useful. I don’t think you went too fast or removed too many disks in a single step. As you only have 3 nodes, Ceph should have directly noticed degraded PG and could not do much. You

[ceph-users] Re: SSD disk for OSD detected as type HDD

Hi, Changing device class works? https://docs.ceph.com/en/latest/rados/operations/crush-map/#device-classes ceph osd crush set-device-class [...] Étienne > On 16 Aug 2021, at 12:05, mabi wrote: > > Hello, > > I

[ceph-users] Re: Object Storage (RGW)

Hi, It’s only compatible with S3 and swift. You could also use object storage with rados, bypassing rgw. But it’s not user friendly and don’t provide the same features. Which kind of access/API were you expecting? Étienne > On 21 Jul 2021, at 09:43, Michel Niyoyita wrote: > > Dear Ceph

[ceph-users] Re: Ceph connect to openstack

And I forgot manila. Étienne > On 30 Jun 2021, at 21:44, Etienne Menguy wrote: > > Which openstack component do you want to use with ceph? > > I think you can use it with keystone/object storage, cinder and glance. > > Étienne > >> On 30 Jun 2021, at 18:50, Sz

[ceph-users] Re: Ceph connect to openstack

Which openstack component do you want to use with ceph? I think you can use it with keystone/object storage, cinder and glance. Étienne > On 30 Jun 2021, at 18:50, Szabo, Istvan (Agoda) > wrote: > > Hi, > > Is there any proper documentation how to connect ceph with openstack? > > > >