Re: LACP LAGG device problems
in the world of VSS/IRF switches or VCP switches, we used 2x10G active-active across switches for redundancy + availability + capacity usually with mode IP-HASH -- Email: ska...@trollkarl.net Contact me for ICQ,MSN,AIM,Yahoo,GTalk,Skype -- -- When things can't get any worse, they simplify themselves by getting a whole lot worse than complicated. A complete and utter disaster is the simplest thing in the world; it's preventing one that's complex. (Janet Morris) On 21 July 2013 at 13:08, wrote: > > Adrian, you're killing my spam filter! But yes, our use of FreeBSD at > Netflix is hardly a science project. Http://openconnect.netflix.com > > With my ISP hat on, I expect us to continue using LAGG with 10G member > links for many years - simply because 100G is so expensive. One can > hope that CFP2 and CFP4 will improve matters somewhat (though it won't > help much for the DWDM transport side). > > Steinar Haug, Nethelp consulting, sth...@nethelp.no > ___ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org" > ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
> Adrian, you're killing my spam filter! But yes, our use of FreeBSD at > Netflix is hardly a science project. Http://openconnect.netflix.com With my ISP hat on, I expect us to continue using LAGG with 10G member links for many years - simply because 100G is so expensive. One can hope that CFP2 and CFP4 will improve matters somewhat (though it won't help much for the DWDM transport side). Steinar Haug, Nethelp consulting, sth...@nethelp.no ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
Adrian, you're killing my spam filter! But yes, our use of FreeBSD at Netflix
is hardly a science project. Http://openconnect.netflix.com
Scott
On Jul 21, 2013, at 1:31 PM, Adrian Chadd wrote:
> Barney,
>
> I now work at netflix. We push >10gig per box. I'm working on making
> that much, much more than 10gig. It's not a "science project."
>
> sheesh. :-)
>
>
>
> -adrian
>
> On 21 July 2013 09:23, Barney Cordoba wrote:
>> I wasn't referring to science projects. Nor did I say it wasn't useful.
>> Only that 10g is cheap now and quite a bit better. LAGG isn't perfect.
>>
>>
>> - Original Message -
>> From: Adrian Chadd
>> To: Barney Cordoba
>> Cc: freebsd-net@freebsd.org; isp
>> Sent: Sunday, July 21, 2013 9:49 AM
>> Subject: Re: LACP LAGG device problems
>>
>> Hah!
>>
>> I'm pushing 20GE out using lagg right now (and fixing the er, amusing
>> behaviour of doing so.) I'm aiming to hit 40 once I get hardware that
>> doesn't get upset pushing that many bits. The netops people at ${JOB}
>> also point out that even today switches occasionally get confused and
>> "crash" a switchport. Ew.
>>
>> So yes, there are people using lagg, both for failover and throughput
>> reasons.
>>
>> I'm working on debugging/statistics right now as part of general "why
>> are things behaving crappy" debugging. I'll see about improving some
>> of the peer reporting at the same time.
>>
>>
>>
>> -adrian
>>
>> On 21 July 2013 06:03, Barney Cordoba wrote:
>>>
>>>
>>> On Sat, 7/20/13, isp wrote:
>>>
>>> Subject: LACP LAGG device problems
>>> To: freebsd-net@freebsd.org
>>> Date: Saturday, July 20, 2013, 10:04 AM
>>>
>>>
>>>
>>>
>>> Hi! Can anybody tell me, is there any plans to improve
>>> LAGG(802.3ad)
>>> device driver in FreeBSD?
>>> It will be greate to have a possibility to set LACP mode
>>> (active/passive)
>>> and system priority.
>>> Also there is no way to set hashing algorithm and master
>>> interface
>>> (port).
>>> And we can't see any information about our neighbor.
>>> The same function in Linux is named Bonding and it is much
>>> more better.
>>> I realy can donate some money to those who can make this
>>> improvements.
>>> Best regards.
>>>
>>> ___
>>>
>>> Why are you using LAGG when 10g cards are like $350? It's not
>>> a peering protocol nor it is PTP; can you see your "peer" info on
>>> an ethernet?
>>>
>>> Bonding is a late 90s concept designed to connect 2 slow links to
>>> get higher speeds, back in the day when 100Mb/s was ambitious.
>>> The point of LAGG is that it's transparent; you can load balance
>>> traffic to multiple hosts or create a redundant link without having
>>> to have equipment running some special applications, or any special
>>> logic above the LAGG device.
>>>
>>> Describing how you are using LAGG (and why) might be better
>>> than just asking for "improvements".
>>>
>>> BC
>>>
>>> ___
>>> freebsd-net@freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
Barney,
I now work at netflix. We push >10gig per box. I'm working on making
that much, much more than 10gig. It's not a "science project."
sheesh. :-)
-adrian
On 21 July 2013 09:23, Barney Cordoba wrote:
> I wasn't referring to science projects. Nor did I say it wasn't useful.
> Only that 10g is cheap now and quite a bit better. LAGG isn't perfect.
>
>
> - Original Message -
> From: Adrian Chadd
> To: Barney Cordoba
> Cc: freebsd-net@freebsd.org; isp
> Sent: Sunday, July 21, 2013 9:49 AM
> Subject: Re: LACP LAGG device problems
>
> Hah!
>
> I'm pushing 20GE out using lagg right now (and fixing the er, amusing
> behaviour of doing so.) I'm aiming to hit 40 once I get hardware that
> doesn't get upset pushing that many bits. The netops people at ${JOB}
> also point out that even today switches occasionally get confused and
> "crash" a switchport. Ew.
>
> So yes, there are people using lagg, both for failover and throughput reasons.
>
> I'm working on debugging/statistics right now as part of general "why
> are things behaving crappy" debugging. I'll see about improving some
> of the peer reporting at the same time.
>
>
>
> -adrian
>
> On 21 July 2013 06:03, Barney Cordoba wrote:
>>
>>
>> On Sat, 7/20/13, isp wrote:
>>
>> Subject: LACP LAGG device problems
>> To: freebsd-net@freebsd.org
>> Date: Saturday, July 20, 2013, 10:04 AM
>>
>>
>>
>>
>> Hi! Can anybody tell me, is there any plans to improve
>> LAGG(802.3ad)
>> device driver in FreeBSD?
>> It will be greate to have a possibility to set LACP mode
>> (active/passive)
>> and system priority.
>> Also there is no way to set hashing algorithm and master
>> interface
>> (port).
>> And we can't see any information about our neighbor.
>> The same function in Linux is named Bonding and it is much
>> more better.
>> I realy can donate some money to those who can make this
>> improvements.
>> Best regards.
>>
>> >
>> ___
>>
>> Why are you using LAGG when 10g cards are like $350? It's not
>> a peering protocol nor it is PTP; can you see your "peer" info on
>> an ethernet?
>>
>> Bonding is a late 90s concept designed to connect 2 slow links to
>> get higher speeds, back in the day when 100Mb/s was ambitious.
>> The point of LAGG is that it's transparent; you can load balance
>> traffic to multiple hosts or create a redundant link without having
>> to have equipment running some special applications, or any special
>> logic above the LAGG device.
>>
>> Describing how you are using LAGG (and why) might be better
>> than just asking for "improvements".
>>
>> BC
>>
>> ___
>> freebsd-net@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
>
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
I wasn't referring to science projects. Nor did I say it wasn't useful.
Only that 10g is cheap now and quite a bit better. LAGG isn't perfect.
- Original Message -
From: Adrian Chadd
To: Barney Cordoba
Cc: freebsd-net@freebsd.org; isp
Sent: Sunday, July 21, 2013 9:49 AM
Subject: Re: LACP LAGG device problems
Hah!
I'm pushing 20GE out using lagg right now (and fixing the er, amusing
behaviour of doing so.) I'm aiming to hit 40 once I get hardware that
doesn't get upset pushing that many bits. The netops people at ${JOB}
also point out that even today switches occasionally get confused and
"crash" a switchport. Ew.
So yes, there are people using lagg, both for failover and throughput reasons.
I'm working on debugging/statistics right now as part of general "why
are things behaving crappy" debugging. I'll see about improving some
of the peer reporting at the same time.
-adrian
On 21 July 2013 06:03, Barney Cordoba wrote:
>
> --------
> On Sat, 7/20/13, isp wrote:
>
> Subject: LACP LAGG device problems
> To: freebsd-net@freebsd.org
> Date: Saturday, July 20, 2013, 10:04 AM
>
>
>
>
> Hi! Can anybody tell me, is there any plans to improve
> LAGG(802.3ad)
> device driver in FreeBSD?
> It will be greate to have a possibility to set LACP mode
> (active/passive)
> and system priority.
> Also there is no way to set hashing algorithm and master
> interface
> (port).
> And we can't see any information about our neighbor.
> The same function in Linux is named Bonding and it is much
> more better.
> I realy can donate some money to those who can make this
> improvements.
> Best regards.
>
> >
> ___
>
> Why are you using LAGG when 10g cards are like $350? It's not
> a peering protocol nor it is PTP; can you see your "peer" info on
> an ethernet?
>
> Bonding is a late 90s concept designed to connect 2 slow links to
> get higher speeds, back in the day when 100Mb/s was ambitious.
> The point of LAGG is that it's transparent; you can load balance
> traffic to multiple hosts or create a redundant link without having
> to have equipment running some special applications, or any special
> logic above the LAGG device.
>
> Describing how you are using LAGG (and why) might be better
> than just asking for "improvements".
>
> BC
>
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re[2]: LACP LAGG device problems
I'm using LACP becasue: 1. 10G cards are much more expensive than 350$. They cost nearly 700$-800$. 2. I don't have switches with 10G interfaces. They are also very expensive. --- Message --- From: "Barney Cordoba" Date: 21 July 2013, 16:03:23 On Sat, 7/20/13, isp < ml...@ukr.net > wrote: Subject: LACP LAGG device problems To: freebsd-net@freebsd.org Date: Saturday, July 20, 2013, 10:04 AM Hi! Can anybody tell me, is there any plans to improve LAGG(802.3ad) device driver in FreeBSD? It will be greate to have a possibility to set LACP mode (active/passive) and system priority. Also there is no way to set hashing algorithm and master interface (port). And we can't see any information about our neighbor. The same function in Linux is named Bonding and it is much more better. I realy can donate some money to those who can make this improvements. Best regards. > ___ Why are you using LAGG when 10g cards are like $350? It's not a peering protocol nor it is PTP; can you see your "peer" info on an ethernet? Bonding is a late 90s concept designed to connect 2 slow links to get higher speeds, back in the day when 100Mb/s was ambitious. The point of LAGG is that it's transparent; you can load balance traffic to multiple hosts or create a redundant link without having to have equipment running some special applications, or any special logic above the LAGG device. Describing how you are using LAGG (and why) might be better than just asking for "improvements". BC ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
On Sun, Jul 21, 2013 at 6:49 AM, Adrian Chadd wrote:
> Hah!
>
> I'm pushing 20GE out using lagg right now (and fixing the er, amusing
> behaviour of doing so.) I'm aiming to hit 40 once I get hardware that
> doesn't get upset pushing that many bits. The netops people at ${JOB}
> also point out that even today switches occasionally get confused and
> "crash" a switchport. Ew.
>
> So yes, there are people using lagg, both for failover and throughput
> reasons.
>
> I'm working on debugging/statistics right now as part of general "why
> are things behaving crappy" debugging. I'll see about improving some
> of the peer reporting at the same time.
>
>
>
> -adrian
>
> On 21 July 2013 06:03, Barney Cordoba wrote:
> >
> >
> > On Sat, 7/20/13, isp wrote:
> >
> > Subject: LACP LAGG device problems
> > To: freebsd-net@freebsd.org
> > Date: Saturday, July 20, 2013, 10:04 AM
> >
> >
> >
> >
> > Hi! Can anybody tell me, is there any plans to improve
> > LAGG(802.3ad)
> > device driver in FreeBSD?
> > It will be greate to have a possibility to set LACP mode
> > (active/passive)
> > and system priority.
> > Also there is no way to set hashing algorithm and master
> > interface
> > (port).
> > And we can't see any information about our neighbor.
> > The same function in Linux is named Bonding and it is much
> > more better.
> > I realy can donate some money to those who can make this
> > improvements.
> > Best regards.
> >
> > >
> > ___
> >
> > Why are you using LAGG when 10g cards are like $350? It's not
> > a peering protocol nor it is PTP; can you see your "peer" info on
> > an ethernet?
> >
> > Bonding is a late 90s concept designed to connect 2 slow links to
> > get higher speeds, back in the day when 100Mb/s was ambitious.
> > The point of LAGG is that it's transparent; you can load balance
> > traffic to multiple hosts or create a redundant link without having
> > to have equipment running some special applications, or any special
> > logic above the LAGG device.
> >
> > Describing how you are using LAGG (and why) might be better
> > than just asking for "improvements".
> >
> > BC
>
I am aware of at least one case where 100G WAN links are being LAGGed
today. Only two ATM, but 4x100G is on the horizon. I suspect 4x100G or even
more is already in place in the data center, but I have no actual
knowledge. and 100G i still quite a bit more than $320 per port. And that
is ignoring the cost of 100G routing, switching, and optical gear.
LAGG is not going away any time soon. I'm sure we will see Nx400G as soon
as 400G Ethernet is available.
--
R. Kevin Oberman, Network Engineer
E-mail: rkober...@gmail.com
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
Hah!
I'm pushing 20GE out using lagg right now (and fixing the er, amusing
behaviour of doing so.) I'm aiming to hit 40 once I get hardware that
doesn't get upset pushing that many bits. The netops people at ${JOB}
also point out that even today switches occasionally get confused and
"crash" a switchport. Ew.
So yes, there are people using lagg, both for failover and throughput reasons.
I'm working on debugging/statistics right now as part of general "why
are things behaving crappy" debugging. I'll see about improving some
of the peer reporting at the same time.
-adrian
On 21 July 2013 06:03, Barney Cordoba wrote:
>
> ----
> On Sat, 7/20/13, isp wrote:
>
> Subject: LACP LAGG device problems
> To: freebsd-net@freebsd.org
> Date: Saturday, July 20, 2013, 10:04 AM
>
>
>
>
> Hi! Can anybody tell me, is there any plans to improve
> LAGG(802.3ad)
> device driver in FreeBSD?
> It will be greate to have a possibility to set LACP mode
> (active/passive)
> and system priority.
> Also there is no way to set hashing algorithm and master
> interface
> (port).
> And we can't see any information about our neighbor.
> The same function in Linux is named Bonding and it is much
> more better.
> I realy can donate some money to those who can make this
> improvements.
> Best regards.
>
> >
> ___
>
> Why are you using LAGG when 10g cards are like $350? It's not
> a peering protocol nor it is PTP; can you see your "peer" info on
> an ethernet?
>
> Bonding is a late 90s concept designed to connect 2 slow links to
> get higher speeds, back in the day when 100Mb/s was ambitious.
> The point of LAGG is that it's transparent; you can load balance
> traffic to multiple hosts or create a redundant link without having
> to have equipment running some special applications, or any special
> logic above the LAGG device.
>
> Describing how you are using LAGG (and why) might be better
> than just asking for "improvements".
>
> BC
>
> ___
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
___
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: LACP LAGG device problems
On Sat, 7/20/13, isp wrote: Subject: LACP LAGG device problems To: freebsd-net@freebsd.org Date: Saturday, July 20, 2013, 10:04 AM Hi! Can anybody tell me, is there any plans to improve LAGG(802.3ad) device driver in FreeBSD? It will be greate to have a possibility to set LACP mode (active/passive) and system priority. Also there is no way to set hashing algorithm and master interface (port). And we can't see any information about our neighbor. The same function in Linux is named Bonding and it is much more better. I realy can donate some money to those who can make this improvements. Best regards. > ___ Why are you using LAGG when 10g cards are like $350? It's not a peering protocol nor it is PTP; can you see your "peer" info on an ethernet? Bonding is a late 90s concept designed to connect 2 slow links to get higher speeds, back in the day when 100Mb/s was ambitious. The point of LAGG is that it's transparent; you can load balance traffic to multiple hosts or create a redundant link without having to have equipment running some special applications, or any special logic above the LAGG device. Describing how you are using LAGG (and why) might be better than just asking for "improvements". BC ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
LACP LAGG device problems
Hi! Can anybody tell me, is there any plans to improve LAGG(802.3ad) device driver in FreeBSD? It will be greate to have a possibility to set LACP mode (active/passive) and system priority. Also there is no way to set hashing algorithm and master interface (port). And we can't see any information about our neighbor. The same function in Linux is named Bonding and it is much more better. I realy can donate some money to those who can make this improvements. Best regards. > ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
