[ceph-users] Re: Ceph osd will not start.

2021-05-29 Thread Peter Childs
As far as I can see, cephadm on debian buster works, until it attempts to start to many osd daemons at once. I've a feeling it's running out of resources, but I'm not sure which ones it does not look like memory. I need to get back on site to play with the hardware, there is only so much one can

[ceph-users] Re: Ceph osd will not start.

2021-05-27 Thread Peter Childs
In the end it looks like I might be able to get the node up to about 30 odds before it stops creating any more. Or more it formats the disks but freezes up starting the daemons. I suspect I'm missing somthing I can tune to get it working better. If I could see any error messages that might

[ceph-users] Re: Ceph osd will not start.

2021-05-26 Thread Eugen Block
If I add the osd daemons one at a time with ceph orch daemon add osd drywood12:/dev/sda It does actually work, Great! I suspect what's happening is when my rule for creating osds run and creates them all-at-once it ties the orch it overloads cephadm and it can't cope. It's possible, I

[ceph-users] Re: Ceph osd will not start.

2021-05-26 Thread Peter Childs
After a bit of messing around. I managed to get it somewhat working. If I add the osd daemons one at a time with ceph orch daemon add osd drywood12:/dev/sda It does actually work, I suspect what's happening is when my rule for creating osds run and creates them all-at-once it ties the orch it

[ceph-users] Re: Ceph osd will not start.

2021-05-26 Thread Eugen Block
Hi, I believe your current issue is due to a missing keyring for client.bootstrap-osd on the OSD node. But even after fixing that you'll probably still won't be able to deploy an OSD manually with ceph-volume because 'ceph-volume activate' is not supported with cephadm [1]. I just tried

[ceph-users] Re: Ceph osd will not start.

2021-05-25 Thread Peter Childs
Not sure what I'm doing wrong, I suspect its the way I'm running ceph-volume. root@drywood12:~# cephadm ceph-volume lvm create --data /dev/sda --dmcrypt Inferring fsid 1518c8e0-bbe4-11eb-9772-001e67dc85ea Using recent ceph image ceph/ceph@sha256

[ceph-users] Re: Ceph osd will not start.

2021-05-24 Thread Peter Childs
On Mon, 24 May 2021, 21:08 Marc, wrote: > > > > I'm attempting to use cephadm and Pacific, currently on debian buster, > > mostly because centos7 ain't supported any more and cenotos8 ain't > > support > > by some of my hardware. > > Who says centos7 is not supported any more? Afaik centos7/el7

[ceph-users] Re: Ceph osd will not start.

2021-05-24 Thread 胡 玮文
> 在 2021年5月25日,03:52,Peter Childs 写道: > > I'm attempting to get get ceph up and running, and currently feel like I'm > going around in circles. > > I'm attempting to use cephadm and Pacific, currently on debian buster, > mostly because centos7 ain't supported any more and cenotos8 ain't

[ceph-users] Re: Ceph osd will not start.

2021-05-24 Thread Marc
> > I'm attempting to use cephadm and Pacific, currently on debian buster, > mostly because centos7 ain't supported any more and cenotos8 ain't > support > by some of my hardware. Who says centos7 is not supported any more? Afaik centos7/el7 is being supported till its EOL 2024. By then maybe a