[ceph-users] Re: Clarification of documentation

2020-05-19 Thread Nathan Fish
It is my understanding that it refers to running a single, normal ceph cluster with it's component hosts connected over WAN. This would require OSDs to connect to other OSDs and mons over WAN for nearly every operation, and is not likely to perform acceptably. __

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread Benjeman Meekhof
It is possible to run a ceph cluster over a WAN if you have reliable enough WAN with sites close enough for low-ish latency. The OSiRIS project is architected that way with Ceph services spread evenly across three university sites in Michigan. There's more information and contact on their website

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread Brian Topping
I have been running Ceph over a gigabit WAN for a few months now and have been happy with it. Mine is set up with Strongswan tunnels And dynamic routing with BIRD) (although I would have used transport Mode and iBGP in hindsight). I generally have 300-500kbps flow with 5ms latency. What I spec

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread Gregory Farnum
On Tue, May 19, 2020 at 10:34 AM Benjeman Meekhof wrote: > > It is possible to run a ceph cluster over a WAN if you have reliable > enough WAN with sites close enough for low-ish latency. The OSiRIS > project is architected that way with Ceph services spread evenly > across three university sites

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread John Zachary Dover
Greg, My name's Zac and I'm the docs guy for the Ceph Foundation. I have a long-term plan to create a document that collects error codes and failure cases, but I am only one man and it will be a few months before I can begin on it. Zac Dover Ceph Docs Guy On Wed, May 20, 2020 at 4:32 AM Gregory

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread CodingSpiderFox
Great, thanks already. I will study the publications of the project :) ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread CodingSpiderFox
Zac, can you confirm that this assumption is true? ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread CodingSpiderFox
What does tiebreaker monitor mean? What exactly is its purpose? ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread Nathan Fish
You need a third monitor in order to form a quorum if one of the two sites goes down. With only two sites, there is no safe way for them to decide who is down. On Tue, May 19, 2020 at 3:11 PM CodingSpiderFox wrote: > > What does tiebreaker monitor mean? What exactly is its purpose? >

[ceph-users] Re: Clarification of documentation

2020-05-19 Thread CodingSpiderFox
Hello Zac, I have some further questions on that page: Right before the section "Delete Default Zone Group and Zone" there is another warning that says: "The following steps assume a multi-site configuration using newly installed systems that aren’t storing data yet. DO NOT DELETE the default