Re: [ceph-users] ceph-volume does not support upstart
On Wed, Jan 10, 2018 at 8:38 PM, 赵赵贺东wrote: > Hello, > I am sorry for the delay. > Thank you for your suggestion. > > It is better to update system or keep using ceph-disk in fact. > Thank you Alfredo Deza & Cary. Both are really OK options for you for now. Unless ceph-disk is causing you issues, in which case, the recommended thing to do is to upgrade to a systemd system that ceph-volume supports > > >> 在 2018年1月8日,下午11:41,Alfredo Deza 写道: >> >> ceph-volume relies on systemd, it will not work with upstart. Going >> the fstab way might work, but most of the lvm implementation will want >> to do systemd-related calls like enabling units and placing files. >> >> For upstart you might want to keep using ceph-disk, unless upgrading >> to a newer OS is an option in which case ceph-volume would work (as >> long as systemd is available) >> >> On Sat, Dec 30, 2017 at 9:11 PM, 赵赵贺东 wrote: >>> Hello Cary, >>> >>> Thank you for your detailed description, it’s really helpful for me! >>> I will have a try when I get back to my office! >>> >>> Thank you for your attention to this matter. >>> >>> >>> 在 2017年12月30日,上午3:51,Cary 写道: >>> >>> Hello, >>> >>> I mount my Bluestore OSDs in /etc/fstab: >>> >>> vi /etc/fstab >>> >>> tmpfs /var/lib/ceph/osd/ceph-12 tmpfs rw,relatime 0 0 >>> = >>> Then mount everyting in fstab with: >>> mount -a >>> == >>> I activate my OSDs this way on startup: You can find the fsid with >>> >>> cat /var/lib/ceph/osd/ceph-12/fsid >>> >>> Then add file named ceph.start so ceph-volume will be run at startup. >>> >>> vi /etc/local.d/ceph.start >>> ceph-volume lvm activate 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac >>> == >>> Make it excitable: >>> chmod 700 /etc/local.d/ceph.start >>> == >>> cd /etc/local.d/ >>> ./ceph.start >>> == >>> I am a Gentoo user and use OpenRC, so this may not apply to you. >>> == >>> cd /etc/init.d/ >>> ln -s ceph ceph-osd.12 >>> /etc/init.d/ceph-osd.12 start >>> rc-update add ceph-osd.12 default >>> >>> Cary >>> >>> On Fri, Dec 29, 2017 at 8:47 AM, 赵赵贺东 wrote: >>> >>> Hello Cary! >>> It’s really big surprise for me to receive your reply! >>> Sincere thanks to you! >>> I know it’s a fake execute file, but it works! >>> >>> > >>> $ cat /usr/sbin/systemctl >>> #!/bin/bash >>> exit 0 >>> < >>> >>> I can start my osd by following command >>> /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph >>> >>> But, threre are still problems. >>> 1.Though ceph-osd can start successfully, prepare log and activate log looks >>> like errors occurred. >>> >>> Prepare log: >>> ===> >>> # ceph-volume lvm prepare --bluestore --data vggroup/lv >>> Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 >>> Running command: chown -R ceph:ceph /dev/dm-0 >>> Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block >>> Running command: sudo ceph --cluster ceph --name client.bootstrap-osd >>> --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o >>> /var/lib/ceph/osd/ceph-12/activate.monmap >>> stderr: got monmap epoch 1 >>> Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring >>> --create-keyring --name osd.12 --add-key >>> AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== >>> stdout: creating /var/lib/ceph/osd/ceph-12/keyring >>> stdout: added entity osd.12 auth auth(auid = 18446744073709551615 >>> key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) >>> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring >>> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ >>> Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore >>> --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key >>> --osd-data >>> /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac >>> --setuser ceph --setgroup ceph >>> stderr: warning: unable to create /var/run/ceph: (13) Permission denied >>> stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) >>> AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to >>> bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such >>> file or directory >>> stderr: >>> stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 >>> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >>> decode label at offset 66: buffer::malformed_input: void >>> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >>> end of struct encoding >>> stderr:
Re: [ceph-users] ceph-volume does not support upstart
Hello, I am sorry for the delay. Thank you for your suggestion. It is better to update system or keep using ceph-disk in fact. Thank you Alfredo Deza & Cary. > 在 2018年1月8日,下午11:41,Alfredo Deza写道: > > ceph-volume relies on systemd, it will not work with upstart. Going > the fstab way might work, but most of the lvm implementation will want > to do systemd-related calls like enabling units and placing files. > > For upstart you might want to keep using ceph-disk, unless upgrading > to a newer OS is an option in which case ceph-volume would work (as > long as systemd is available) > > On Sat, Dec 30, 2017 at 9:11 PM, 赵赵贺东 wrote: >> Hello Cary, >> >> Thank you for your detailed description, it’s really helpful for me! >> I will have a try when I get back to my office! >> >> Thank you for your attention to this matter. >> >> >> 在 2017年12月30日,上午3:51,Cary 写道: >> >> Hello, >> >> I mount my Bluestore OSDs in /etc/fstab: >> >> vi /etc/fstab >> >> tmpfs /var/lib/ceph/osd/ceph-12 tmpfs rw,relatime 0 0 >> = >> Then mount everyting in fstab with: >> mount -a >> == >> I activate my OSDs this way on startup: You can find the fsid with >> >> cat /var/lib/ceph/osd/ceph-12/fsid >> >> Then add file named ceph.start so ceph-volume will be run at startup. >> >> vi /etc/local.d/ceph.start >> ceph-volume lvm activate 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac >> == >> Make it excitable: >> chmod 700 /etc/local.d/ceph.start >> == >> cd /etc/local.d/ >> ./ceph.start >> == >> I am a Gentoo user and use OpenRC, so this may not apply to you. >> == >> cd /etc/init.d/ >> ln -s ceph ceph-osd.12 >> /etc/init.d/ceph-osd.12 start >> rc-update add ceph-osd.12 default >> >> Cary >> >> On Fri, Dec 29, 2017 at 8:47 AM, 赵赵贺东 wrote: >> >> Hello Cary! >> It’s really big surprise for me to receive your reply! >> Sincere thanks to you! >> I know it’s a fake execute file, but it works! >> >> > >> $ cat /usr/sbin/systemctl >> #!/bin/bash >> exit 0 >> < >> >> I can start my osd by following command >> /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph >> >> But, threre are still problems. >> 1.Though ceph-osd can start successfully, prepare log and activate log looks >> like errors occurred. >> >> Prepare log: >> ===> >> # ceph-volume lvm prepare --bluestore --data vggroup/lv >> Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 >> Running command: chown -R ceph:ceph /dev/dm-0 >> Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block >> Running command: sudo ceph --cluster ceph --name client.bootstrap-osd >> --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o >> /var/lib/ceph/osd/ceph-12/activate.monmap >> stderr: got monmap epoch 1 >> Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring >> --create-keyring --name osd.12 --add-key >> AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== >> stdout: creating /var/lib/ceph/osd/ceph-12/keyring >> stdout: added entity osd.12 auth auth(auid = 18446744073709551615 >> key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) >> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring >> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ >> Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore >> --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key >> --osd-data >> /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac >> --setuser ceph --setgroup ceph >> stderr: warning: unable to create /var/run/ceph: (13) Permission denied >> stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) >> AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to >> bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such >> file or directory >> stderr: >> stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >> decode label at offset 66: buffer::malformed_input: void >> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >> end of struct encoding >> stderr: 2017-12-29 08:13:08.644055 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >> decode label at offset 66: buffer::malformed_input: void >> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >> end of struct encoding >> stderr: 2017-12-29 08:13:08.644722 b66f3000 -1 >>
Re: [ceph-users] ceph-volume does not support upstart
ceph-volume relies on systemd, it will not work with upstart. Going the fstab way might work, but most of the lvm implementation will want to do systemd-related calls like enabling units and placing files. For upstart you might want to keep using ceph-disk, unless upgrading to a newer OS is an option in which case ceph-volume would work (as long as systemd is available) On Sat, Dec 30, 2017 at 9:11 PM, 赵赵贺东wrote: > Hello Cary, > > Thank you for your detailed description, it’s really helpful for me! > I will have a try when I get back to my office! > > Thank you for your attention to this matter. > > > 在 2017年12月30日,上午3:51,Cary 写道: > > Hello, > > I mount my Bluestore OSDs in /etc/fstab: > > vi /etc/fstab > > tmpfs /var/lib/ceph/osd/ceph-12 tmpfs rw,relatime 0 0 > = > Then mount everyting in fstab with: > mount -a > == > I activate my OSDs this way on startup: You can find the fsid with > > cat /var/lib/ceph/osd/ceph-12/fsid > > Then add file named ceph.start so ceph-volume will be run at startup. > > vi /etc/local.d/ceph.start > ceph-volume lvm activate 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac > == > Make it excitable: > chmod 700 /etc/local.d/ceph.start > == > cd /etc/local.d/ > ./ceph.start > == > I am a Gentoo user and use OpenRC, so this may not apply to you. > == > cd /etc/init.d/ > ln -s ceph ceph-osd.12 > /etc/init.d/ceph-osd.12 start > rc-update add ceph-osd.12 default > > Cary > > On Fri, Dec 29, 2017 at 8:47 AM, 赵赵贺东 wrote: > > Hello Cary! > It’s really big surprise for me to receive your reply! > Sincere thanks to you! > I know it’s a fake execute file, but it works! > > > > $ cat /usr/sbin/systemctl > #!/bin/bash > exit 0 > < > > I can start my osd by following command > /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph > > But, threre are still problems. > 1.Though ceph-osd can start successfully, prepare log and activate log looks > like errors occurred. > > Prepare log: > ===> > # ceph-volume lvm prepare --bluestore --data vggroup/lv > Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block > Running command: sudo ceph --cluster ceph --name client.bootstrap-osd > --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o > /var/lib/ceph/osd/ceph-12/activate.monmap > stderr: got monmap epoch 1 > Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring > --create-keyring --name osd.12 --add-key > AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== > stdout: creating /var/lib/ceph/osd/ceph-12/keyring > stdout: added entity osd.12 auth auth(auid = 18446744073709551615 > key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ > Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore > --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key > --osd-data > /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac > --setuser ceph --setgroup ceph > stderr: warning: unable to create /var/run/ceph: (13) Permission denied > stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) > AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to > bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such > file or directory > stderr: > stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.644055 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.644722 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.646722 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12/) _read_fsid unparsable uuid > stderr: 2017-12-29 08:14:00.697028 b66f3000
Re: [ceph-users] ceph-volume does not support upstart
Hello Cary, Thank you for your detailed description, it’s really helpful for me! I will have a try when I get back to my office! Thank you for your attention to this matter. > 在 2017年12月30日,上午3:51,Cary写道: > > Hello, > > I mount my Bluestore OSDs in /etc/fstab: > > vi /etc/fstab > > tmpfs /var/lib/ceph/osd/ceph-12 tmpfs rw,relatime 0 0 > = > Then mount everyting in fstab with: > mount -a > == > I activate my OSDs this way on startup: You can find the fsid with > > cat /var/lib/ceph/osd/ceph-12/fsid > > Then add file named ceph.start so ceph-volume will be run at startup. > > vi /etc/local.d/ceph.start > ceph-volume lvm activate 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac > == > Make it excitable: > chmod 700 /etc/local.d/ceph.start > == > cd /etc/local.d/ > ./ceph.start > == > I am a Gentoo user and use OpenRC, so this may not apply to you. > == > cd /etc/init.d/ > ln -s ceph ceph-osd.12 > /etc/init.d/ceph-osd.12 start > rc-update add ceph-osd.12 default > > Cary > > On Fri, Dec 29, 2017 at 8:47 AM, 赵赵贺东 wrote: >> Hello Cary! >> It’s really big surprise for me to receive your reply! >> Sincere thanks to you! >> I know it’s a fake execute file, but it works! >> >> > >> $ cat /usr/sbin/systemctl >> #!/bin/bash >> exit 0 >> < >> >> I can start my osd by following command >> /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph >> >> But, threre are still problems. >> 1.Though ceph-osd can start successfully, prepare log and activate log looks >> like errors occurred. >> >> Prepare log: >> ===> >> # ceph-volume lvm prepare --bluestore --data vggroup/lv >> Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 >> Running command: chown -R ceph:ceph /dev/dm-0 >> Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block >> Running command: sudo ceph --cluster ceph --name client.bootstrap-osd >> --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o >> /var/lib/ceph/osd/ceph-12/activate.monmap >> stderr: got monmap epoch 1 >> Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring >> --create-keyring --name osd.12 --add-key >> AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== >> stdout: creating /var/lib/ceph/osd/ceph-12/keyring >> stdout: added entity osd.12 auth auth(auid = 18446744073709551615 >> key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) >> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring >> Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ >> Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore >> --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key >> --osd-data >> /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac >> --setuser ceph --setgroup ceph >> stderr: warning: unable to create /var/run/ceph: (13) Permission denied >> stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) >> AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to >> bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such >> file or directory >> stderr: >> stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >> decode label at offset 66: buffer::malformed_input: void >> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >> end of struct encoding >> stderr: 2017-12-29 08:13:08.644055 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >> decode label at offset 66: buffer::malformed_input: void >> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >> end of struct encoding >> stderr: 2017-12-29 08:13:08.644722 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to >> decode label at offset 66: buffer::malformed_input: void >> bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past >> end of struct encoding >> stderr: 2017-12-29 08:13:08.646722 b66f3000 -1 >> bluestore(/var/lib/ceph/osd/ceph-12/) _read_fsid unparsable uuid >> stderr: 2017-12-29 08:14:00.697028 b66f3000 -1 key >> AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== >> stderr: 2017-12-29 08:14:01.261659 b66f3000 -1 created object store >> /var/lib/ceph/osd/ceph-12/ for osd.12 fsid >> 4e5adad0-784c-41b4-ab72-5f4fae499b3a >> <=== >> >> Activate log: >> ===> >> # ceph-volume lvm activate --bluestore 12 >>
Re: [ceph-users] ceph-volume does not support upstart
Hello, I mount my Bluestore OSDs in /etc/fstab: vi /etc/fstab tmpfs /var/lib/ceph/osd/ceph-12 tmpfs rw,relatime 0 0 = Then mount everyting in fstab with: mount -a == I activate my OSDs this way on startup: You can find the fsid with cat /var/lib/ceph/osd/ceph-12/fsid Then add file named ceph.start so ceph-volume will be run at startup. vi /etc/local.d/ceph.start ceph-volume lvm activate 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac == Make it excitable: chmod 700 /etc/local.d/ceph.start == cd /etc/local.d/ ./ceph.start == I am a Gentoo user and use OpenRC, so this may not apply to you. == cd /etc/init.d/ ln -s ceph ceph-osd.12 /etc/init.d/ceph-osd.12 start rc-update add ceph-osd.12 default Cary On Fri, Dec 29, 2017 at 8:47 AM, 赵赵贺东wrote: > Hello Cary! > It’s really big surprise for me to receive your reply! > Sincere thanks to you! > I know it’s a fake execute file, but it works! > > > > $ cat /usr/sbin/systemctl > #!/bin/bash > exit 0 > < > > I can start my osd by following command > /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph > > But, threre are still problems. > 1.Though ceph-osd can start successfully, prepare log and activate log looks > like errors occurred. > > Prepare log: > ===> > # ceph-volume lvm prepare --bluestore --data vggroup/lv > Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block > Running command: sudo ceph --cluster ceph --name client.bootstrap-osd > --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o > /var/lib/ceph/osd/ceph-12/activate.monmap > stderr: got monmap epoch 1 > Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring > --create-keyring --name osd.12 --add-key > AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== > stdout: creating /var/lib/ceph/osd/ceph-12/keyring > stdout: added entity osd.12 auth auth(auid = 18446744073709551615 > key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ > Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore > --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key > --osd-data > /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac > --setuser ceph --setgroup ceph > stderr: warning: unable to create /var/run/ceph: (13) Permission denied > stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) > AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to > bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such > file or directory > stderr: > stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.644055 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.644722 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to > decode label at offset 66: buffer::malformed_input: void > bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past > end of struct encoding > stderr: 2017-12-29 08:13:08.646722 b66f3000 -1 > bluestore(/var/lib/ceph/osd/ceph-12/) _read_fsid unparsable uuid > stderr: 2017-12-29 08:14:00.697028 b66f3000 -1 key > AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== > stderr: 2017-12-29 08:14:01.261659 b66f3000 -1 created object store > /var/lib/ceph/osd/ceph-12/ for osd.12 fsid > 4e5adad0-784c-41b4-ab72-5f4fae499b3a > <=== > > Activate log: > ===> > # ceph-volume lvm activate --bluestore 12 > 827f4a2c-8c1b-427b-bd6c-66d31a0468ac > Running command: sudo ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev > /dev/vggroup/lv --path /var/lib/ceph/osd/ceph-12 > Running command: sudo ln -snf /dev/vggroup/lv > /var/lib/ceph/osd/ceph-12/block > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 > Running command: sudo
Re: [ceph-users] ceph-volume does not support upstart
Hello Cary! It’s really big surprise for me to receive your reply! Sincere thanks to you! I know it’s a fake execute file, but it works! > $ cat /usr/sbin/systemctl #!/bin/bash exit 0 < I can start my osd by following command /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph But, threre are still problems. 1.Though ceph-osd can start successfully, prepare log and activate log looks like errors occurred. Prepare log: ===> # ceph-volume lvm prepare --bluestore --data vggroup/lv Running command: sudo mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-12 Running command: chown -R ceph:ceph /dev/dm-0 Running command: sudo ln -s /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block Running command: sudo ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-12/activate.monmap stderr: got monmap epoch 1 Running command: ceph-authtool /var/lib/ceph/osd/ceph-12/keyring --create-keyring --name osd.12 --add-key AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== stdout: creating /var/lib/ceph/osd/ceph-12/keyring stdout: added entity osd.12 auth auth(auid = 18446744073709551615 key=AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== with 0 caps) Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/keyring Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12/ Running command: sudo ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 12 --monmap /var/lib/ceph/osd/ceph-12/activate.monmap --key --osd-data /var/lib/ceph/osd/ceph-12/ --osd-uuid 827f4a2c-8c1b-427b-bd6c-66d31a0468ac --setuser ceph --setgroup ceph stderr: warning: unable to create /var/run/ceph: (13) Permission denied stderr: 2017-12-29 08:13:08.609127 b66f3000 -1 asok(0x850c62a0) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-osd.12.asok': (2) No such file or directory stderr: stderr: 2017-12-29 08:13:08.643410 b66f3000 -1 bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding stderr: 2017-12-29 08:13:08.644055 b66f3000 -1 bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding stderr: 2017-12-29 08:13:08.644722 b66f3000 -1 bluestore(/var/lib/ceph/osd/ceph-12//block) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding stderr: 2017-12-29 08:13:08.646722 b66f3000 -1 bluestore(/var/lib/ceph/osd/ceph-12/) _read_fsid unparsable uuid stderr: 2017-12-29 08:14:00.697028 b66f3000 -1 key AQAQ+UVa4z2ANRAAmmuAExQauFinuJuL6A56ww== stderr: 2017-12-29 08:14:01.261659 b66f3000 -1 created object store /var/lib/ceph/osd/ceph-12/ for osd.12 fsid 4e5adad0-784c-41b4-ab72-5f4fae499b3a <=== Activate log: ===> # ceph-volume lvm activate --bluestore 12 827f4a2c-8c1b-427b-bd6c-66d31a0468ac Running command: sudo ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vggroup/lv --path /var/lib/ceph/osd/ceph-12 Running command: sudo ln -snf /dev/vggroup/lv /var/lib/ceph/osd/ceph-12/block Running command: chown -R ceph:ceph /dev/dm-0 Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 Running command: sudo systemctl enable ceph-volume@lvm-12-827f4a2c-8c1b-427b-bd6c-66d31a0468ac Running command: sudo systemctl start ceph-osd@12 <=== After activate operation , osd did not start , but I can start osd by the following command(before restart host) /usr/bin/ceph-osd --cluster=ceph -i 12 -f --setuser ceph --setgroup ceph 2. After host reboot, everything about ceph-osd has been lost. Because before I reboot, /var/lib/ceph/osd/ceph-12 was mounted on tmpfs, so after reboot I lost everything about ceph-osd. #df -h /dev/root15G 2.4G 12G 18% / devtmpfs 1009M 4.0K 1009M 1% /dev none4.0K 0 4.0K 0% /sys/fs/cgroup none202M 156K 202M 1% /run none5.0M 0 5.0M 0% /run/lock none 1009M 0 1009M 0% /run/shm none100M 0 100M 0% /run/user tmpfs 1009M 48K 1009M 1% /var/lib/ceph/osd/ceph-12 3. ceph-osd can not start automatically. I think there are something wrong in osd upstart, I should add some operation about osd upstart. It seems that this ceph-volume for ubuntu14.04 is not a easy problem for me , so any suggestions or hints about the problems
Re: [ceph-users] ceph-volume does not support upstart
You could add a file named /usr/sbin/systemctl and add: exit 0 to it. Cary On Dec 28, 2017, at 18:45, 赵赵贺东wrote: Hello ceph-users! I am a ceph user from china. Our company deploy ceph on arm ubuntu 14.04. Ceph Version is luminous 12.2.2. When I try to activate osd by ceph-volume, I got the following error.(osd prepare stage seems work normally) It seems that ceph-volume only work under systemd, but ubuntu 14.04 does not support systemd. How can I deploy osd in ubuntu 14.04 by ceph-volume? Will ceph-volume support upstart in the future? ===> # ceph-volume lvm activate --bluestore 12 03fa2757-412d-4892-af8a-f2260294a2dc Running command: sudo ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vggroup/lvdata --path /var/lib/ceph/osd/ceph-12 Running command: sudo ln -snf /dev/vggroup/lvdata /var/lib/ceph/osd/ceph-12/block Running command: chown -R ceph:ceph /dev/dm-2 Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 Running command: sudo systemctl enable ceph-volume@lvm-12-03fa2757-412d-4892-af8a-f2260294a2dc stderr: sudo: systemctl: command not found --> RuntimeError: command returned non-zero exit status: 1 < Your reply will be appreciated! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] ceph-volume does not support upstart
Hello ceph-users! I am a ceph user from china. Our company deploy ceph on arm ubuntu 14.04. Ceph Version is luminous 12.2.2. When I try to activate osd by ceph-volume, I got the following error.(osd prepare stage seems work normally) It seems that ceph-volume only work under systemd, but ubuntu 14.04 does not support systemd. How can I deploy osd in ubuntu 14.04 by ceph-volume? Will ceph-volume support upstart in the future? ===> # ceph-volume lvm activate --bluestore 12 03fa2757-412d-4892-af8a-f2260294a2dc Running command: sudo ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vggroup/lvdata --path /var/lib/ceph/osd/ceph-12 Running command: sudo ln -snf /dev/vggroup/lvdata /var/lib/ceph/osd/ceph-12/block Running command: chown -R ceph:ceph /dev/dm-2 Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 Running command: sudo systemctl enable ceph-volume@lvm-12-03fa2757-412d-4892-af8a-f2260294a2dc stderr: sudo: systemctl: command not found --> RuntimeError: command returned non-zero exit status: 1 < Your reply will be appreciated! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com