Re: [ceph-users] How to set mon-clock-drift-allowed tunable
Hello everyone, I fixed my NTP server as you said, not changed the default value of mon-clock-drift-allowed tunable. Thank you, Atatur [cid:image14d44d.PNG@a59c06b6.409b36ff]<http://www.havelsan.com.tr> [cid:image87ad04.JPG@9a3e4b1b.4faa780e] Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image6489f2.PNG@072302f4.4685372a] +90 312 292 74 00 [cid:image0a6a43.PNG@18f5aac4.4aa77409] +90 312 219 57 97 [cid:imageee7972.JPG@eb4115d0.4b8225a7] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] OSD doesn't start - fresh installation
Hello, Sorry for wasting your time; below mistakes originated from unproperly removing OSDs (specifically forgetting to run “ceph auth del osd.#” ) from the cluster. Thank you for attention though. Best regards, Atatür From: Brad Hubbard [mailto:bhubb...@redhat.com] Sent: Tuesday, January 23, 2018 2:43 AM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr> Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] OSD doesn't start - fresh installation On Mon, Jan 22, 2018 at 10:37 PM, Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> wrote: Hi again, In the “journalctl –xe” output: Jan 22 15:29:18 mon02 ceph-osd-prestart.sh[1526]: OSD data directory /var/lib/ceph/osd/ceph-1 does not exist; bailing out. Also in my previous post, I forgot to say that “ceph-deploy osd create” command doesn’t fail and appears to be successful, you can see from the logs. But dameons on nodes don’t start. Regards, Atatur [cid:image001.png@01D39429.0A875E50]<http://www.havelsan.com.tr> Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image003.png@01D39429.0A875E50] +90 312 292 74 00<tel:+90%20312%20292%2074%2000> [cid:image004.png@01D39429.0A875E50] +90 312 219 57 97<tel:+90%20312%20219%2057%2097> [cid:image005.jpg@01D39429.0A875E50] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email From: Hüseyin Atatür YILDIRIM Sent: Monday, January 22, 2018 3:19 PM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: OSD doesn't start - fresh installation Hi all, Fresh installation but already ısed disks. I zapped all the disks and ran “ceph-deploy ods create” again but got same results. Log is attached. Can you please help? Did you mean "sdb1" rather than "sdb" perhaps? Thank you, Atatur ___ ceph-users mailing list ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Cheers, Brad ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] OSD doesn't start - fresh installation
Hi again, In the “journalctl –xe” output: Jan 22 15:29:18 mon02 ceph-osd-prestart.sh[1526]: OSD data directory /var/lib/ceph/osd/ceph-1 does not exist; bailing out. Also in my previous post, I forgot to say that “ceph-deploy osd create” command doesn’t fail and appears to be successful, you can see from the logs. But dameons on nodes don’t start. Regards, Atatur [cid:imagebb4d32.PNG@d7ad441f.4c963bbc]<http://www.havelsan.com.tr> [cid:image50c417.JPG@606135d0.4f9a9358] Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image60c332.PNG@38d52cd1.40afcd61] +90 312 292 74 00 [cid:imagec41e42.PNG@a4560fba.4aaeabd0] +90 312 219 57 97 [cid:image6e5829.JPG@ef9b8277.45994307] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email From: Hüseyin Atatür YILDIRIM Sent: Monday, January 22, 2018 3:19 PM To: ceph-users@lists.ceph.com Subject: OSD doesn't start - fresh installation Hi all, Fresh installation but already ısed disks. I zapped all the disks and ran “ceph-deploy ods create” again but got same results. Log is attached. Can you please help? Thank you, Atatur ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] OSD doesn't start - fresh installation
Hi all, Fresh installation but already ısed disks. I zapped all the disks and ran “ceph-deploy ods create” again but got same results. Log is attached. Can you please help? Thank you, Atatur [cid:image028a8d.PNG@94a00751.438f095a]<http://www.havelsan.com.tr> [cid:imageb2b5d1.JPG@c9e5388f.42b3d277] Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:imagedeafde.PNG@be2f9503.4da6c9ef] +90 312 292 74 00 [cid:image3667b8.PNG@95f007c4.4f9a80e1] +90 312 219 57 97 [cid:imageaf771f.JPG@922ea955.42b08e59] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email Osd-create.log Description: Osd-create.log ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] How to set mon-clock-drift-allowed tunable
Hello, How can I set mon_clock_drift_allowed tunable; should I set it at monitor nodes /etc/ceph/ceph.conf or where ? In [global] section, or in a [mon] section ? All these are not clear in the documentation. After setting, should I restart the daemons, or what specific daemon ? Or should I reboot the node? Thank you, Atatur [cid:imaged51036.PNG@3427f5e9.4f8ee361]<http://www.havelsan.com.tr> [cid:image9e5230.JPG@7be42bc5.49865965] Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image4739b6.PNG@4833e2cb.4e884e1f] +90 312 292 74 00 [cid:image6a41d4.PNG@7a7e7b1a.4caaa25e] +90 312 219 57 97 [cid:image4291ae.JPG@37fdf40b.419fe600] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] "ceph -s" shows no osds
I've upgraded the ceph-deploy, and I used the command: ceph-deploy install --release luminous mon01 osd01 osd02 but this time it gives certificate errors. I'm behind the corporate Proxy: [mon01][DEBUG ] connection detected need for sudo [mon01][DEBUG ] connected to host: mon01 [mon01][DEBUG ] detect platform information from remote host [mon01][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: Ubuntu 16.04 xenial [mon01][INFO ] installing Ceph on mon01 [mon01][INFO ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install ca-certificates apt-transport-https [mon01][DEBUG ] Reading package lists... [mon01][DEBUG ] Building dependency tree... [mon01][DEBUG ] Reading state information... [mon01][DEBUG ] apt-transport-https is already the newest version (1.2.24). [mon01][DEBUG ] ca-certificates is already the newest version (20170717~16.04.1). [mon01][DEBUG ] 0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded. [mon01][INFO ] Running command: sudo wget -O release.asc https://download.ceph.com/keys/release.asc [mon01][WARNIN] --2018-01-05 12:00:33-- https://download.ceph.com/keys/release.asc [mon01][WARNIN] Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 [mon01][WARNIN] Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected. [mon01][WARNIN] ERROR: cannot verify download.ceph.com's certificate, issued by 'CN=swcgint1.hvlnet.net': [mon01][WARNIN] Self-signed certificate encountered. [mon01][WARNIN] To connect to download.ceph.com insecurely, use `--no-check-certificate'. [mon01][WARNIN] command returned non-zero exit status: 5 [mon01][INFO ] Running command: sudo apt-key add release.asc [mon01][WARNIN] gpg: no valid OpenPGP data found. [mon01][ERROR ] RuntimeError: command returned non-zero exit status: 2 [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: apt-key add release.asc Is it possible to overcome this or do I need to use the manual installation? I'm using Ubuntu 16.04. Thank you, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Friday, January 5, 2018 11:56 AM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] "ceph -s" shows no osds 1.5.39 can be installed from "luminous" repo:: http://docs.ceph.com/docs/master/install/get-packages/ ________ From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Friday, January 5, 2018 9:16:48 AM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found out "pip install" is the most reasonable one; normal software repo install (i.e. sudo apt install ceph-deploy) always installs version 1.32. Do you agree with this ? Regards, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Thursday, January 4, 2018 3:46 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>>; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] "ceph -s" shows no osds Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy. From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Thursday, January 4, 2018 2:01:57 PM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Hi, ceph-deploy --version 1.5.32 Thank you, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Thursday, January 4, 2018 12:51 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>>; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] "ceph -s" shows no osds What is you "ceph-deploy --version" ? From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Thursday, January 4, 2018 9:14:39 AM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Hello Sergey, I issued the mgr create command and it fails with ceph-deploy mgr create mon01 usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF] COMMAND ... ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin',
Re: [ceph-users] "ceph -s" shows no osds
Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found out "pip install" is the most reasonable one; normal software repo install (i.e. sudo apt install ceph-deploy) always installs version 1.32. Do you agree with this ? Regards, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Thursday, January 4, 2018 3:46 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] "ceph -s" shows no osds Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy. ________ From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Thursday, January 4, 2018 2:01:57 PM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Hi, ceph-deploy --version 1.5.32 Thank you, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Thursday, January 4, 2018 12:51 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>>; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] "ceph -s" shows no osds What is you "ceph-deploy --version" ? From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Thursday, January 4, 2018 9:14:39 AM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Hello Sergey, I issued the mgr create command and it fails with ceph-deploy mgr create mon01 usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF] COMMAND ... ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg') Any ideas? Thank you.. From: Sergey Malinin [mailto:h...@newmail.com] Sent: Wednesday, January 3, 2018 5:56 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>>; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] "ceph -s" shows no osds What version are you using? Luminous needs mgr daemons running. ________ From: ceph-users <ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>> on behalf of Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Wednesday, January 3, 2018 5:15:30 PM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: [ceph-users] "ceph -s" shows no osds Hello, I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued ceph-deploy osd create mon01:sdb1 osd01:sdb1 osd02:sdb1 and ran successfully. But when I issued below from the admin host: ssh mon01 sudo ceph -s cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411 health HEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds 64 pgs stuck inactive 64 pgs stuck unclean no osds monmap e1: 1 mons at {mon01=192.168.122.158:6789/0} election epoch 4, quorum 0 mon01 osdmap e1: 0 osds: 0 up, 0 in flags sortbitwise,require_jewel_osds pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects 0 kB used, 0 kB / 0 kB avail 64 creating There's no osds in the cluster. Can you please help? Regards, Atatur [cid:image001.png@01D38605.E7F2BDC0]<http://www.havelsan.com.tr> Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image003.png@01D38605.E7F2BDC0] +90 312 292 74 00 [cid:image004.png@01D38605.E7F2BDC0] +90 312 219 57 97 [cid:image005.jpg@01D38605.E7F2BDC0] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] "ceph -s" shows no osds
Hi, ceph-deploy --version 1.5.32 Thank you, Atatür From: Sergey Malinin [mailto:h...@newmail.com] Sent: Thursday, January 4, 2018 12:51 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] "ceph -s" shows no osds What is you "ceph-deploy --version" ? ________ From: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Thursday, January 4, 2018 9:14:39 AM To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] "ceph -s" shows no osds Hello Sergey, I issued the mgr create command and it fails with ceph-deploy mgr create mon01 usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF] COMMAND ... ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg') Any ideas? Thank you.. From: Sergey Malinin [mailto:h...@newmail.com] Sent: Wednesday, January 3, 2018 5:56 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>>; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: Re: [ceph-users] "ceph -s" shows no osds What version are you using? Luminous needs mgr daemons running. From: ceph-users <ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>> on behalf of Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Wednesday, January 3, 2018 5:15:30 PM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: [ceph-users] "ceph -s" shows no osds Hello, I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued ceph-deploy osd create mon01:sdb1 osd01:sdb1 osd02:sdb1 and ran successfully. But when I issued below from the admin host: ssh mon01 sudo ceph -s cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411 health HEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds 64 pgs stuck inactive 64 pgs stuck unclean no osds monmap e1: 1 mons at {mon01=192.168.122.158:6789/0} election epoch 4, quorum 0 mon01 osdmap e1: 0 osds: 0 up, 0 in flags sortbitwise,require_jewel_osds pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects 0 kB used, 0 kB / 0 kB avail 64 creating There's no osds in the cluster. Can you please help? Regards, Atatur [cid:image001.png@01D38564.91FFCA80]<http://www.havelsan.com.tr> Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image003.png@01D38564.91FFCA80] +90 312 292 74 00 [cid:image004.png@01D38564.91FFCA80] +90 312 219 57 97 [cid:image005.jpg@01D38564.91FFCA80] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] "ceph -s" shows no osds
Hello Sergey, I issued the mgr create command and it fails with ceph-deploy mgr create mon01 usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF] COMMAND ... ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg') Any ideas? Thank you.. From: Sergey Malinin [mailto:h...@newmail.com] Sent: Wednesday, January 3, 2018 5:56 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] "ceph -s" shows no osds What version are you using? Luminous needs mgr daemons running. From: ceph-users <ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>> on behalf of Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Wednesday, January 3, 2018 5:15:30 PM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: [ceph-users] "ceph -s" shows no osds Hello, I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued ceph-deploy osd create mon01:sdb1 osd01:sdb1 osd02:sdb1 and ran successfully. But when I issued below from the admin host: ssh mon01 sudo ceph -s cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411 health HEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds 64 pgs stuck inactive 64 pgs stuck unclean no osds monmap e1: 1 mons at {mon01=192.168.122.158:6789/0} election epoch 4, quorum 0 mon01 osdmap e1: 0 osds: 0 up, 0 in flags sortbitwise,require_jewel_osds pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects 0 kB used, 0 kB / 0 kB avail 64 creating There's no osds in the cluster. Can you please help? Regards, Atatur [cid:image001.png@01D3853C.6EC4A770]<http://www.havelsan.com.tr> Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image003.png@01D3853C.6EC4A770] +90 312 292 74 00 [cid:image004.png@01D3853C.6EC4A770] +90 312 219 57 97 [cid:image005.jpg@01D3853C.6EC4A770] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] "ceph -s" shows no osds
Latest version. Oh yes, I omitted the manager daemon setup. Let me check.. Thank you.. From: Sergey Malinin [mailto:h...@newmail.com] Sent: Wednesday, January 3, 2018 5:56 PM To: Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] "ceph -s" shows no osds What version are you using? Luminous needs mgr daemons running. From: ceph-users <ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>> on behalf of Hüseyin Atatür YILDIRIM <hyildi...@havelsan.com.tr<mailto:hyildi...@havelsan.com.tr>> Sent: Wednesday, January 3, 2018 5:15:30 PM To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: [ceph-users] "ceph -s" shows no osds Hello, I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued ceph-deploy osd create mon01:sdb1 osd01:sdb1 osd02:sdb1 and ran successfully. But when I issued below from the admin host: ssh mon01 sudo ceph -s cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411 health HEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds 64 pgs stuck inactive 64 pgs stuck unclean no osds monmap e1: 1 mons at {mon01=192.168.122.158:6789/0} election epoch 4, quorum 0 mon01 osdmap e1: 0 osds: 0 up, 0 in flags sortbitwise,require_jewel_osds pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects 0 kB used, 0 kB / 0 kB avail 64 creating There's no osds in the cluster. Can you please help? Regards, Atatur [cid:image001.png@01D384BC.F2024730]<http://www.havelsan.com.tr> Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image003.png@01D384BC.F2024730] +90 312 292 74 00 [cid:image004.png@01D384BC.F2024730] +90 312 219 57 97 [cid:image005.jpg@01D384BC.F2024730] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] "ceph -s" shows no osds
Hello, I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued ceph-deploy osd create mon01:sdb1 osd01:sdb1 osd02:sdb1 and ran successfully. But when I issued below from the admin host: ssh mon01 sudo ceph –s cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411 health HEALTH_ERR 64 pgs are stuck inactive for more than 300 seconds 64 pgs stuck inactive 64 pgs stuck unclean no osds monmap e1: 1 mons at {mon01=192.168.122.158:6789/0} election epoch 4, quorum 0 mon01 osdmap e1: 0 osds: 0 up, 0 in flags sortbitwise,require_jewel_osds pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects 0 kB used, 0 kB / 0 kB avail 64 creating There’s no osds in the cluster. Can you please help? Regards, Atatur [cid:imageaa3447.PNG@f0efafdb.489ec152]<http://www.havelsan.com.tr> [cid:image99c333.JPG@b63449d5.448e22a1] Hüseyin Atatür YILDIRIM SİSTEM MÜHENDİSİ Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B Çankaya Ankara TÜRKİYE [cid:image1bff86.PNG@64ce8842.46a02b82] +90 312 292 74 00 [cid:image448150.PNG@6bd70914.47a367ef] +90 312 219 57 97 [cid:image32c65d.JPG@4a85730c.4fb253b5] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari> [http://www.havelsan.com.tr/Library/images/mail/email.jpg] Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com