Re: [ceph-users] Ceph with Clos IP fabric

2017-04-22 Thread Richard Hesse
Out of curiosity, why are you taking a scale-up approach to building your ceph clusters instead of a scale-out approach? Ceph has traditionally been geared towards a scale-out, simple shared nothing mindset. These dual ToR deploys remind me of something from EMC, not ceph. Really curious as I'd rat

[ceph-users] PPPpppp

2017-04-22 Thread Puneet Zaroo
Pardon the brevity. Sent via iPhone. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] chooseleaf updates

2017-04-22 Thread Shinobu Kinjo
On Sun, Apr 23, 2017 at 4:09 AM, Donny Davis wrote: > Just in case anyone was curious as to how amazing ceph actually is, I did > the migration to ceph seamlessly. I was able to bring the other two nodes > into the cluster, and then turn on replication between them without a hitch. > And with zero

[ceph-users] Ceph built from source, can't start ceph-mon

2017-04-22 Thread Henry Ngo
I followed the install doc however after deploying the monitor, the doc states to start the mon using Upstart. I learned through digging around that the Upstart package is not installed using Make Install so it won't work. I tried running "ceph-mon -i [host]" and it gives an error. Any ideas? http

Re: [ceph-users] Ceph with Clos IP fabric

2017-04-22 Thread Aaron Bassett
FWIW, I use a CLOS fabric with layer 3 right down to the hosts and multiple ToRs to enable HA/ECMP to each node. I'm using Cumulus Linux's "redistribute neighbor" feature, which advertises a /32 for any ARP'ed neighbor. I set up the hosts with an IP on each physical interface and on an aliased l

Re: [ceph-users] chooseleaf updates

2017-04-22 Thread Donny Davis
Just in case anyone was curious as to how amazing ceph actually is, I did the migration to ceph seamlessly. I was able to bring the other two nodes into the cluster, and then turn on replication between them without a hitch. And with zero downtime. Just incredible software. On Thu, Apr 20, 2017 a

Re: [ceph-users] Ceph with Clos IP fabric

2017-04-22 Thread Maxime Guyot
Hi, >That only makes sense if you're running multiple ToR switches per rack for the >public leaf network. Multiple public ToR switches per rack is not very common; >most Clos crossbar networks run a single ToR switch. Several >guides on the >topic (including Arista & Cisco) suggest that you use

Re: [ceph-users] Question about the OSD host option

2017-04-22 Thread Henrik Korkuc
mon.* and osd.* sections are not mandatory in config. So unless you want to set something per daemon, you can skip them completely. On 17-04-21 19:07, Fabian wrote: Hi Everyone, I play a bit around with ceph on a test cluster with 3 servers (each MON and OSD at the same time). I use some self