What is a saturated network with modern switched technologies? Links to
individual hosts? Uplinks from TORS (public)? Switch backplane (cluster)?
> That is correct.I didn't explain it clearly. I said that is because in
> some write only scenario the public network and cluster network will
>
Den tors 14 maj 2020 kl 10:46 skrev Amudhan P :
> Will EC based write benefit from Public network and Cluster network?
>
I guess this depends on what parameters you use.
All in all I think using one network is probably better, and the cases
where I have seen missing heartbeats, it's not the netw
Will EC based write benefit from Public network and Cluster network?
On Thu, May 14, 2020 at 1:39 PM lin yunfan wrote:
> That is correct.I didn't explain it clearly. I said that is because in
> some write only scenario the public network and cluster network will
> all be saturated the same tim
That is correct.I didn't explain it clearly. I said that is because in
some write only scenario the public network and cluster network will
all be saturated the same time.
linyunfan
Janne Johansson 于2020年5月14日周四 下午3:42写道：
>
> Den tors 14 maj 2020 kl 08:42 skrev lin yunfan :
>>
>> Besides the rec
Den tors 14 maj 2020 kl 08:42 skrev lin yunfan :
> Besides the recoverry scenario , in a write only scenario the cluster
> network will use the almost the same bandwith as public network.
>
That would depend on the replication factor. If it is high, I would assume
every MB from the client networ
Besides the recoverry scenario , in a write only scenario the cluster
network will use the almost the same bandwith as public network.
linyunfan
Anthony D'Atri 于2020年5月9日周六 下午4:32写道：
>
>
> > Hi,
> >
> > I deployed few clusters with two networks as well as only one network.
> > There has little
IT Risø Campus
Bygning 109, rum S14
____
From: Stefan Kooman
Sent: 13 May 2020 07:40
To: ceph-users@ceph.io
Subject: [ceph-users] Re: Cluster network and public network
On 2020-05-12 18:59, Anthony D'Atri wrote:
>
>> I think, however, that a dis
On 2020-05-12 18:59, Anthony D'Atri wrote:
I think, however, that a disappearing back network has no real consequences
as the heartbeats always go over both.
FWIW this has not been my experience, at least through Luminous.
What I’ve seen is that when the cluster/replication net is configu
dentical physical networking).
>
> Best regards,
> =
> Frank Schilder
> AIT Risø Campus
> Bygning 109, rum S14
>
> ________
> From: Stefan Kooman
> Sent: 13 May 2020 07:40
> To: ceph-users@ceph.io
> Subject: [ce
> I think, however, that a disappearing back network has no real consequences
> as the heartbeats always go over both.
FWIW this has not been my experience, at least through Luminous.
What I’ve seen is that when the cluster/replication net is configured but
unavailable, OSD heartbeats fail an
12 May 2020 13:12:47
To: ceph-users@ceph.io
Subject: [ceph-users] Re: Cluster network and public network
Hi,
On 11/05/2020 08:50, Wido den Hollander wrote:
> Great to hear! I'm still behind this idea and all the clusters I design
> have a single (or LACP) network going to the host.
&g
Hi,
On 11/05/2020 08:50, Wido den Hollander wrote:
Great to hear! I'm still behind this idea and all the clusters I design
have a single (or LACP) network going to the host.
One IP address per node where all traffic goes over. That's Ceph, SSH,
(SNMP) Monitoring, etc.
Wido
We have an 'old-st
===
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14
From: Anthony D'Atri
Sent: 09 May 2020 23:59:49
To: Phil Regnauld
Cc: ceph-users@ceph.io
Subject: [ceph-users] Re: Cluster network and public network
>> If your public network is satura
On 5/8/20 12:13 PM, Willi Schiegel wrote:
> Hello Nghia,
>
> I once asked a similar question about network architecture and got the
> same answer as Martin wrote from Wido den Hollander:
>
> There is no need to have a public and cluster network with Ceph. Working
> as a Ceph consultant I've dep
>> If your public network is saturated, that actually is a problem, last thing
>> you want is to add recovery traffic, or to slow down heartbeats. For most
>> people, it isn’t saturated.
>
>See Frank Schilder's post about a meltdown which he believes could have
>been caused by
Anthony D'Atri (anthony.datri) writes:
>
> During heavy recovery or backfill, including healing from failures,
> balancing, adding/removing drives, much more will be used.
>
> Convention wisdom has been to not let that traffic DoS clients, or clients to
> DoS heartbeats.
[...]
> If yo
Hi Anthony,
Thanks for the feedback!
The servers are using two bond interfaces for two networks.
And each interface is bonded with two 25Gb/s cards(active-backup mode).
You're right, I should have done the test in a havey recovery or backfill
situation. I will benchmark the cluster once again in
> Hi,
>
> I deployed few clusters with two networks as well as only one network.
> There has little impact between them for my experience.
>
> I did a performance test on nautilus cluster with two networks last week.
> What I found is that the cluster network has low bandwidth usage
During stea
Hi,
I deployed few clusters with two networks as well as only one network.
There has little impact between them for my experience.
I did a performance test on nautilus cluster with two networks last week.
What I found is that the cluster network has low bandwidth usage while
public network bandwi
Hello Nghia,
I once asked a similar question about network architecture and got the
same answer as Martin wrote from Wido den Hollander:
There is no need to have a public and cluster network with Ceph. Working
as a Ceph consultant I've deployed multi-PB Ceph clusters with a single
public netwo
Hi Martin,
Thanks for your response. You mean one network interface for only MON hosts or
for the whole cluster including OSD hosts? I’m confusing now because there are
some projects that only use one public network for the whole cluster. That
means the rebalancing, replicating objects and hear
Hello Nghia,
just use one network interface card and use frontend and backend traffic on
the same. No problem with that.
If you have a dual port card, use both ports as an LACP channel and maybe
separate it using VLANs if you want to, but not required as well.
--
Martin Verges
Managing director
22 matches
Mail list logo
