Re: [ceph-users] "ceph -s" shows no osds

2018-01-05 Thread Serkan Çoban
Answer is in the logs:
[mon01][WARNIN] To connect to download.ceph.com insecurely, use
`--no-check-certificate'.

It will be better to mirror the repos and use them offline...

On Fri, Jan 5, 2018 at 12:08 PM, Hüseyin Atatür YILDIRIM <
hyildi...@havelsan.com.tr> wrote:

> I’ve upgraded the ceph-deploy, and I used the command:
>
>
>
> ceph-deploy install --release luminous mon01 osd01 osd02
>
>
>
> but this time it gives certificate errors. I’m behind the corporate Proxy:
>
>
>
>
>
> [mon01][DEBUG ] connection detected need for sudo
>
> [mon01][DEBUG ] connected to host: mon01
>
> [mon01][DEBUG ] detect platform information from remote host
>
> [mon01][DEBUG ] detect machine type
>
> [ceph_deploy.install][INFO  ] Distro info: Ubuntu 16.04 xenial
>
> [mon01][INFO  ] installing Ceph on mon01
>
> [mon01][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive
> DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends
> install ca-certificates apt-transport-https
>
> [mon01][DEBUG ] Reading package lists...
>
> [mon01][DEBUG ] Building dependency tree...
>
> [mon01][DEBUG ] Reading state information...
>
> [mon01][DEBUG ] apt-transport-https is already the newest version (1.2.24).
>
> [mon01][DEBUG ] ca-certificates is already the newest version
> (20170717~16.04.1).
>
> [mon01][DEBUG ] 0 upgraded, 0 newly installed, 0 to remove and 4 not
> upgraded.
>
> [mon01][INFO  ] Running command: sudo wget -O release.asc
> https://download.ceph.com/keys/release.asc
>
> [mon01][WARNIN] --2018-01-05 12:00:33--  https://download.ceph.com/
> keys/release.asc
>
> [mon01][WARNIN] Resolving download.ceph.com (download.ceph.com)...
> 158.69.68.124, 2607:5300:201:2000::3:58a1
>
> [mon01][WARNIN] Connecting to download.ceph.com (download.ceph.com
> )|158.69.68.124|:443... connected.
>
> [mon01][WARNIN] ERROR: cannot verify download.ceph.com's certificate,
> issued by ‘CN=swcgint1.hvlnet.net’:
>
> [mon01][WARNIN]   Self-signed certificate encountered.
>
> [mon01][WARNIN] To connect to download.ceph.com insecurely, use
> `--no-check-certificate'.
>
> [mon01][WARNIN] command returned non-zero exit status: 5
>
> [mon01][INFO  ] Running command: sudo apt-key add release.asc
>
> [mon01][WARNIN] gpg: no valid OpenPGP data found.
>
> [mon01][ERROR ] RuntimeError: command returned non-zero exit status: 2
>
> [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: apt-key add
> release.asc
>
>
>
> Is it possible to overcome this or do I need to use the manual
> installation? I’m using Ubuntu 16.04.
>
>
>
> Thank you,
>
> Atatür
>
>
>
> *From:* Sergey Malinin [mailto:h...@newmail.com]
> *Sent:* Friday, January 5, 2018 11:56 AM
>
> *To:* Hüseyin Atatür YILDIRIM ;
> ceph-users@lists.ceph.com
> *Subject:* Re: [ceph-users] "ceph -s" shows no osds
>
>
>
> 1.5.39 can be installed from “luminous” repo::
>
>
>
> http://docs.ceph.com/docs/master/install/get-packages/
>
>
> --
>
> *From:* Hüseyin Atatür YILDIRIM 
> *Sent:* Friday, January 5, 2018 9:16:48 AM
> *To:* Sergey Malinin; ceph-users@lists.ceph.com
> *Subject:* RE: [ceph-users] "ceph -s" shows no osds
>
>
>
> Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found
> out  “pip install”  is the most reasonable one; normal software repo
> install (i.e.  sudo apt install ceph-deploy)  always installs version 1.32.
>
> Do you agree with this ?
>
>
>
> Regards,
>
> Atatür
>
> *From:* Sergey Malinin [mailto:h...@newmail.com ]
> *Sent:* Thursday, January 4, 2018 3:46 PM
> *To:* Hüseyin Atatür YILDIRIM ;
> ceph-users@lists.ceph.com
> *Subject:* Re: [ceph-users] "ceph -s" shows no osds
>
>
>
> Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy.
>
>
> ------
>
> *From:* Hüseyin Atatür YILDIRIM 
> *Sent:* Thursday, January 4, 2018 2:01:57 PM
> *To:* Sergey Malinin; ceph-users@lists.ceph.com
> *Subject:* RE: [ceph-users] "ceph -s" shows no osds
>
>
>
> Hi,
>
>
>
>
>
> ceph-deploy --version
>
> 1.5.32
>
>
>
> Thank you,
>
> Atatür
>
> *From:* Sergey Malinin [mailto:h...@newmail.com ]
> *Sent:* Thursday, January 4, 2018 12:51 PM
> *To:* Hüseyin Atatür YILDIRIM ;
> ceph-users@lists.ceph.com
> *Subject:* Re: [ceph-users] "ceph -s" shows no osds
>
>
>
> What is you “ceph-deploy --version” ?
>
>
> --
>
> *From:* Hüseyin Atatür YILDIRIM 
> *Sent:* Thursday, January 4, 2018

Re: [ceph-users] "ceph -s" shows no osds

2018-01-05 Thread Hüseyin Atatür YILDIRIM
I've upgraded the ceph-deploy, and I used the command:

ceph-deploy install --release luminous mon01 osd01 osd02

but this time it gives certificate errors. I'm behind the corporate Proxy:


[mon01][DEBUG ] connection detected need for sudo
[mon01][DEBUG ] connected to host: mon01
[mon01][DEBUG ] detect platform information from remote host
[mon01][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: Ubuntu 16.04 xenial
[mon01][INFO  ] installing Ceph on mon01
[mon01][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive 
DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends 
install ca-certificates apt-transport-https
[mon01][DEBUG ] Reading package lists...
[mon01][DEBUG ] Building dependency tree...
[mon01][DEBUG ] Reading state information...
[mon01][DEBUG ] apt-transport-https is already the newest version (1.2.24).
[mon01][DEBUG ] ca-certificates is already the newest version 
(20170717~16.04.1).
[mon01][DEBUG ] 0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded.
[mon01][INFO  ] Running command: sudo wget -O release.asc 
https://download.ceph.com/keys/release.asc
[mon01][WARNIN] --2018-01-05 12:00:33--  
https://download.ceph.com/keys/release.asc
[mon01][WARNIN] Resolving download.ceph.com (download.ceph.com)... 
158.69.68.124, 2607:5300:201:2000::3:58a1
[mon01][WARNIN] Connecting to download.ceph.com 
(download.ceph.com)|158.69.68.124|:443... connected.
[mon01][WARNIN] ERROR: cannot verify download.ceph.com's certificate, issued by 
'CN=swcgint1.hvlnet.net':
[mon01][WARNIN]   Self-signed certificate encountered.
[mon01][WARNIN] To connect to download.ceph.com insecurely, use 
`--no-check-certificate'.
[mon01][WARNIN] command returned non-zero exit status: 5
[mon01][INFO  ] Running command: sudo apt-key add release.asc
[mon01][WARNIN] gpg: no valid OpenPGP data found.
[mon01][ERROR ] RuntimeError: command returned non-zero exit status: 2
[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: apt-key add 
release.asc

Is it possible to overcome this or do I need to use the manual installation? 
I'm using Ubuntu 16.04.

Thank you,
Atatür

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Friday, January 5, 2018 11:56 AM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

1.5.39 can be installed from "luminous" repo::

http://docs.ceph.com/docs/master/install/get-packages/


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Friday, January 5, 2018 9:16:48 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found out  
"pip install"  is the most reasonable one; normal software repo install (i.e.  
sudo apt install ceph-deploy)  always installs version 1.32.
Do you agree with this ?

Regards,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 3:46 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy.


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 2:01:57 PM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hi,


ceph-deploy --version
1.5.32

Thank you,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 12:51 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What is you "ceph-deploy --version" ?


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall'

Re: [ceph-users] "ceph -s" shows no osds

2018-01-05 Thread Sergey Malinin
1.5.39 can be installed from “luminous” repo:
http://docs.ceph.com/docs/master/install/get-packages/


From: Hüseyin Atatür YILDIRIM 
Sent: Friday, January 5, 2018 9:16:48 AM
To: Sergey Malinin; ceph-users@lists.ceph.com
Subject: RE: [ceph-users] "ceph -s" shows no osds

Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found out  
“pip install”  is the most reasonable one; normal software repo install (i.e.  
sudo apt install ceph-deploy)  always installs version 1.32.
Do you agree with this ?

Regards,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 3:46 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy.


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 2:01:57 PM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hi,


ceph-deploy --version
1.5.32

Thank you,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 12:51 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What is you “ceph-deploy --version” ?


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.

____________________
From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph –s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There’s no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D38605.E7F2BDC0]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D38605.E7F2BDC0]

+90 312 292 74 00

[cid:image004.png@01D38605.E7F2BDC0]

+90 312 219 57 97



[cid:image005.jpg@01D38605.E7F2BDC0]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-04 Thread Hüseyin Atatür YILDIRIM
Thanks a lot Sergey. I searched about the upgrade of ceph-deploy and found out  
"pip install"  is the most reasonable one; normal software repo install (i.e.  
sudo apt install ceph-deploy)  always installs version 1.32.
Do you agree with this ?

Regards,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 3:46 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy.


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 2:01:57 PM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hi,


ceph-deploy --version
1.5.32

Thank you,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 12:51 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What is you "ceph-deploy --version" ?


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.

____________
From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph -s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There's no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D38605.E7F2BDC0]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D38605.E7F2BDC0]

+90 312 292 74 00

[cid:image004.png@01D38605.E7F2BDC0]

+90 312 219 57 97



[cid:image005.jpg@01D38605.E7F2BDC0]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-04 Thread Sergey Malinin
Mgr installation was introduced in 1.5.38, you need to upgrade ceph-deploy.


From: Hüseyin Atatür YILDIRIM 
Sent: Thursday, January 4, 2018 2:01:57 PM
To: Sergey Malinin; ceph-users@lists.ceph.com
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hi,


ceph-deploy --version
1.5.32

Thank you,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 12:51 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

What is you “ceph-deploy --version” ?


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.


From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph –s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There’s no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D38564.91FFCA80]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D38564.91FFCA80]

+90 312 292 74 00

[cid:image004.png@01D38564.91FFCA80]

+90 312 219 57 97



[cid:image005.jpg@01D38564.91FFCA80]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-04 Thread Hüseyin Atatür YILDIRIM
Hi,


ceph-deploy --version
1.5.32

Thank you,
Atatür
From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Thursday, January 4, 2018 12:51 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

What is you "ceph-deploy --version" ?


From: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>; 
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.


From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph -s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There's no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D38564.91FFCA80]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D38564.91FFCA80]

+90 312 292 74 00

[cid:image004.png@01D38564.91FFCA80]

+90 312 219 57 97



[cid:image005.jpg@01D38564.91FFCA80]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-04 Thread Sergey Malinin
What is you “ceph-deploy --version” ?


From: Hüseyin Atatür YILDIRIM 
Sent: Thursday, January 4, 2018 9:14:39 AM
To: Sergey Malinin; ceph-users@lists.ceph.com
Subject: RE: [ceph-users] "ceph -s" shows no osds

Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.


From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph –s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There’s no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D3853C.6EC4A770]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D3853C.6EC4A770]

+90 312 292 74 00

[cid:image004.png@01D3853C.6EC4A770]

+90 312 219 57 97



[cid:image005.jpg@01D3853C.6EC4A770]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-03 Thread Hüseyin Atatür YILDIRIM
Hello Sergey,

I issued the mgr create command and it fails with

ceph-deploy  mgr create mon01
usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME]
   [--overwrite-conf] [--cluster NAME] [--ceph-conf CEPH_CONF]
   COMMAND ...
ceph-deploy: error: argument COMMAND: invalid choice: 'mgr' (choose from 'new', 
'install', 'rgw', 'mon', 'mds', 'gatherkeys', 'disk', 'osd', 'admin', 'repo', 
'config', 'uninstall', 'purge', 'purgedata', 'calamari', 'forgetkeys', 'pkg')

Any ideas?

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.


From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph -s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There's no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D3853C.6EC4A770]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D3853C.6EC4A770]

+90 312 292 74 00

[cid:image004.png@01D3853C.6EC4A770]

+90 312 219 57 97



[cid:image005.jpg@01D3853C.6EC4A770]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-03 Thread Hüseyin Atatür YILDIRIM
Latest version. Oh yes, I omitted the manager daemon setup. Let me check..

Thank you..

From: Sergey Malinin [mailto:h...@newmail.com]
Sent: Wednesday, January 3, 2018 5:56 PM
To: Hüseyin Atatür YILDIRIM ; 
ceph-users@lists.ceph.com
Subject: Re: [ceph-users] "ceph -s" shows no osds

What version are you using? Luminous needs mgr daemons running.


From: ceph-users 
mailto:ceph-users-boun...@lists.ceph.com>> 
on behalf of Hüseyin Atatür YILDIRIM 
mailto:hyildi...@havelsan.com.tr>>
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I've setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph -s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There's no  osds in the cluster. Can you please help?

Regards,
Atatur

[cid:image001.png@01D384BC.F2024730]<http://www.havelsan.com.tr>



Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ

Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE

[cid:image003.png@01D384BC.F2024730]

+90 312 292 74 00

[cid:image004.png@01D384BC.F2024730]

+90 312 219 57 97



[cid:image005.jpg@01D384BC.F2024730]

YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]

Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] "ceph -s" shows no osds

2018-01-03 Thread Sergey Malinin
What version are you using? Luminous needs mgr daemons running.


From: ceph-users  on behalf of Hüseyin 
Atatür YILDIRIM 
Sent: Wednesday, January 3, 2018 5:15:30 PM
To: ceph-users@lists.ceph.com
Subject: [ceph-users] "ceph -s" shows no osds


Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph –s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There’s no  osds in the cluster. Can you please help?

Regards,
Atatur


[cid:imageaa3447.PNG@f0efafdb.489ec152]<http://www.havelsan.com.tr> 
[cid:image99c333.JPG@b63449d5.448e22a1]
Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ
Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE
[cid:image1bff86.PNG@64ce8842.46a02b82] +90 312 292 74 00   
[cid:image448150.PNG@6bd70914.47a367ef] +90 312 219 57 97


[cid:image32c65d.JPG@4a85730c.4fb253b5]
YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>
LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 
<http://www.havelsan.com.tr/TR/Main/icerik/4513/mail-yasal-uyari>

[http://www.havelsan.com.tr/Library/images/mail/email.jpg]  Lütfen 
gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] "ceph -s" shows no osds

2018-01-03 Thread Hüseyin Atatür YILDIRIM

Hello,

I try to setup Ceph cluster on Ubuntu 16.04. I’ve setup 1 monitor-osd (hostname 
mon01) and 2 osd hosts (osd01 and osd02). At one stage, I issued

   ceph-deploy  osd create mon01:sdb1 osd01:sdb1 osd02:sdb1

and ran successfully.  But when I issued below from the admin host:

ssh mon01 sudo ceph –s

cluster 9c7303db-56ab-4ddf-9fb8-1882754a4411
 health HEALTH_ERR
64 pgs are stuck inactive for more than 300 seconds
64 pgs stuck inactive
64 pgs stuck unclean
no osds
 monmap e1: 1 mons at {mon01=192.168.122.158:6789/0}
election epoch 4, quorum 0 mon01
 osdmap e1: 0 osds: 0 up, 0 in
flags sortbitwise,require_jewel_osds
  pgmap v2: 64 pgs, 1 pools, 0 bytes data, 0 objects
0 kB used, 0 kB / 0 kB avail
  64 creating


There’s no  osds in the cluster. Can you please help?

Regards,
Atatur


[cid:imageaa3447.PNG@f0efafdb.489ec152] 
[cid:image99c333.JPG@b63449d5.448e22a1]
Hüseyin Atatür YILDIRIM
SİSTEM MÜHENDİSİ
Üniversiteler Mah. İhsan Doğramacı Bul. ODTÜ Teknokent Havelsan A.Ş. 23/B 
Çankaya Ankara TÜRKİYE
[cid:image1bff86.PNG@64ce8842.46a02b82] +90 312 292 74 00   
[cid:image448150.PNG@6bd70914.47a367ef] +90 312 219 57 97


[cid:image32c65d.JPG@4a85730c.4fb253b5]
YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul 
ve Şartlar dokümanına tabidir. 

LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which 
can be accessed with this link. 


[http://www.havelsan.com.tr/Library/images/mail/email.jpg]  Lütfen 
gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the 
environment before printing this email


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com