Re: [ceph-users] stuck ceph-deploy mon create-initial / giant
Hi Loic, this is the content of our ceph.conf [global] fsid = 719f14b2-7475-4b25-8c5f-3ffbcf594d13 mon_initial_members = ceph1, ceph2, ceph3 mon_host = 192.168.10.107,192.168.10.108,192.168.10.109 auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx filestore_xattr_use_omap = true osd pool default size = 2 public network = 192.168.10.0/24 cluster networt = 192.168.108.0/24 where public network is 10GBE native and cluster network a tagged VLAN on a lacp/802.3ad bond. Am Montag, den 23.02.2015, 23:24 +0100 schrieb Loic Dachary: > Hi Stephan, > > Could you share the /etc/ceph/ceph.conf content ? Maybe ceph-create-keys > cannot reach the monitor ? > > Cheers > > On 23/02/2015 22:53, Stephan Seitz wrote: > > Hi all, > > > > I'm currently facing a strange problem when deploying giant on Ubuntu > > 14.04. Following the docs, and reaching to > > ceph-deploy mon create-initial > > on the three mon hosts leads to every single mon stuck with a companion > > ceph-create-keys waiting forever. > > ceph-deploy quits after waiting for mon-qorum without success. Say: > > with > > error: for each mon. > > An strace shows repetively the very same bulk, with one line stating the > > mon state in "pending". > > Network has been double-checked. netstat / lsof shows "established" TCP > > connection between the mons. > > > > Trying to fiddle around the quorum and starting the cluster with only > > one mon, didn't help either. It behaves in the very same way: Having > > the > > mon stuck and the ceph-create-keys waiting forever. > > > > Could someone please shed some light, what this problem could be caused > > by? > > Except for deploying the first time giant, I didn't face that problem > > on > > former installations. > > > > Thanks in advance, > > > > - Stephan > > > -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-44 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] stuck ceph-deploy mon create-initial / giant
Hi all, I'm currently facing a strange problem when deploying giant on Ubuntu 14.04. Following the docs, and reaching to ceph-deploy mon create-initial on the three mon hosts leads to every single mon stuck with a companion ceph-create-keys waiting forever. ceph-deploy quits after waiting for mon-qorum without success. Say: with error: for each mon. An strace shows repetively the very same bulk, with one line stating the mon state in "pending". Network has been double-checked. netstat / lsof shows "established" TCP connection between the mons. Trying to fiddle around the quorum and starting the cluster with only one mon, didn't help either. It behaves in the very same way: Having the mon stuck and the ceph-create-keys waiting forever. Could someone please shed some light, what this problem could be caused by? Except for deploying the first time giant, I didn't face that problem on former installations. Thanks in advance, - Stephan -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-44 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph Supermicro hardware recommendation
Hi, Am Dienstag, den 03.02.2015, 15:16 + schrieb Colombo Marco: > Hi all, > I have to build a new Ceph storage cluster, after i‘ve read the > hardware recommendations and some mail from this mailing list i would > like to buy these servers: just FYI: SuperMicro already focuses on ceph with a productline: http://www.supermicro.com/solutions/datasheet_Ceph.pdf http://www.supermicro.com/solutions/storage_ceph.cfm regards, Stephan Seitz -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-44 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin signature.asc Description: This is a digitally signed message part ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph, LIO, VMWARE anyone?
Guiseppe, despite the fact I like SCST, I did a comparable setup with LIO (and the respective RBD LIO Backend) in userspace. It spans over at least three "bridge" nodes without any problems. In contrast to "usual" (two controller, one backplane) iSCSI portals, I have to discover every single portal on it's own. So the multipath-part is a little more work, but not that challenging... After a little more research, I'm going to hold a talk at the Chemnitzer Linuxtage about this topic. Please leave me a PM if you wan't to peek into the (currently not completely ready) slides. > > I'm working on a lab setup regarding Ceph serving rbd images as ISCSI > datastores to VMWARE via a LIO box. Is there someone that already did > something similar wanting to share some knowledge? Any production > deployments? What about LIO's HA and luns' performances? > Mit freundlichen Grüßen, Stephan Seitz -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-44 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin signature.asc Description: This is a digitally signed message part ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Typical 10GbE latency
> >> Indeed, there must be something! But I can't figure it out yet. Same > >> controllers, tried the same OS, direct cables, but the latency is 40% > >> higher. Wido, just an educated guess: Did you check the offload settings of your NIC? ethtool -k should you provide that. - Stephan -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-44 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin signature.asc Description: This is a digitally signed message part ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
