Hi,
first, I'd recommend to use drivegroups [1] to apply OSD
specifications to entire hosts instead of manually adding an OSD
daemon. If you run 'ceph orch daemon add osd hostname:/dev/nvme0n1'
then the OSD is already fully deployed, meaning wal, db and data
device are all on the same disk (which is totally fine for NVMEs or
SSDs, depending on the use-case). In that case you would need to move
it to your target device by using the ceph-bluestore-tool:
$ ceph-bluestore-tool bluefs-bdev-new-wal --path osd path --dev-target
new-device
The question is, if you already use NVMEs as OSD devices, where's the
point in separating wal to different NVMEs? That doesn't make much
sense to me, but if I misunderstand your setup, please clarify.
[1]
https://docs.ceph.com/en/quincy/cephadm/services/osd/#advanced-osd-service-specifications
Zitat von "Adiga, Anantha" <anantha.ad...@intel.com>:
Hi,
After adding a node to the cluster (3 nodes) with cephadm, how do I
add OSDs with the same configuration on the other nodes ?
The other nodes have
12 drives for data osd-block AND 2 drives for wal osd-wal. There are
6 LVs in each wal disk for the 12 data drives.
I have added the ODS with
ceph orch daemon add osd hostname:/dev/nvme0n1
How do I attach the wal devices to the OSDs?
I have the WAL volumes created
nvme3n1
259:5 0 349.3G 0 disk
|-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--dad0df4e--149a--4e80--b451--79f9b81838b8 253:12 0 58.2G 0
lvm
|-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--a5f2e93a--7bf0--4904--a233--3946b855c764 253:13 0 58.2G 0
lvm
|-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--cc949e1b--2560--4d38--bc27--558550881726 253:14 0 58.2G 0
lvm
|-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--8846f50e--7e92--4f66--a738--ce3a89650019 253:15 0 58.2G 0
lvm
|-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--6d646762--483a--40ca--8c51--ea54e0684a94 253:16 0 58.2G 0
lvm
`-ceph--75d65cd1--91e4--4a8f--869b--e2a550f83104-osd--wal--74e58163--de1d--4062--a658--5b0356d43a87 253:17 0 58.2G 0
lvm
How do I attach the wal volumes to the OSDs
osd.36 nvme0n1 259:1 0 5.8T 0 disk
`-ceph--3df7c5c3--c2c0--4498--9e17--2af79e448abc-osd--block--804b50ea--d44c--4cad--9177--8d722f737df9 253:0 0 5.8T 0
lvm
Osd.37 nvme1n1 259:3 0 5.8T 0 disk
`-ceph--30858acc--c48b--4a08--bb98--4c9b59112c59-osd--block--0a3a198b--66ec--4ed9--94da--fb171e190e38 253:1 0 5.8T 0
lvm
nvme3n1
Thank you,
Anantha
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io
