[ceph-users] Re: How does client get the new active ceph-mgr endpoint when failover happens?

2022-10-06 Thread Burkhard Linke

Hi,


do clients (as in ceph clients like rbd/cephfs/rgw) connected to the mgr 
at all? IMHO the clients only need to be able to connect to the mon 
(host list in ceph.conf / DNS SRV entries) and osd (osd map in mons).



If certain clients need to retrieve data from the mgr (e.g. cephfs-top, 
rbd iostat), I would assume they will use the mgr map from the mons, 
which will be updated if the active mgr changes. I'm not sure whether 
these clients use permanent connections (which will need to be 
reestablished if mgr changes), or whether they will work with a 
request-reply-model.



Regards,

Burkhard Linke


___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


[ceph-users] Re: How does client get the new active ceph-mgr endpoint when failover happens?

2022-10-06 Thread Janne Johansson
> Thanks for the quick response!
>
> What if the node is down? The client cannot even connect to the mgr.

Then this mgr would not be in the list of possible mgrs to connect to at all.

-- 
May the most significant bit of your life be positive.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


[ceph-users] Re: How does client get the new active ceph-mgr endpoint when failover happens?

2022-10-06 Thread Zhongzhou Cai
Thanks for the quick response!

What if the node is down? The client cannot even connect to the mgr.

On Thu, Oct 6, 2022 at 2:17 AM Janne Johansson  wrote:

> Den tors 6 okt. 2022 kl 10:40 skrev Zhongzhou Cai  >:
> > Hi folks,
> > I have ceph-mgr bootstrapped on three nodes, and they are running in HA.
> > When the active mgr node goes down, it will failover to one of the
> > standbys. I'm wondering if there is a way for the client to be aware of
> the
> > leadership change and connect to the new active mgr? Do I need to set up
> > something like haproxy in front of the ceph-mgr daemons?
>
> No, I think the mgr you connect to will send the client to the active
> one if it is passive.
> In the very beginning you needed an internal LB, but this was long ago.
>
> "By default, the standby modules will answer incoming requests with a
> HTTP redirect to the active manager, allowing users to point their
> browser at any mgr node and find their way to an active mgr."
> from https://docs.ceph.com/en/latest/mgr/administrator/
>
> --
> May the most significant bit of your life be positive.
>
-- 
Thanks,
Zhongzhou Cai
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


[ceph-users] Re: How does client get the new active ceph-mgr endpoint when failover happens?

2022-10-06 Thread Janne Johansson
Den tors 6 okt. 2022 kl 10:40 skrev Zhongzhou Cai :
> Hi folks,
> I have ceph-mgr bootstrapped on three nodes, and they are running in HA.
> When the active mgr node goes down, it will failover to one of the
> standbys. I'm wondering if there is a way for the client to be aware of the
> leadership change and connect to the new active mgr? Do I need to set up
> something like haproxy in front of the ceph-mgr daemons?

No, I think the mgr you connect to will send the client to the active
one if it is passive.
In the very beginning you needed an internal LB, but this was long ago.

"By default, the standby modules will answer incoming requests with a
HTTP redirect to the active manager, allowing users to point their
browser at any mgr node and find their way to an active mgr."
from https://docs.ceph.com/en/latest/mgr/administrator/

-- 
May the most significant bit of your life be positive.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io