Re: Which cpu/mainboard for fast routing (bgp, full tables) ?
> Hi! > > > That class of processor has fairly limited memory bandwidth. An E5 v3 or > > greater should get you what you want, although finding a system that makes > > good use of available PCIe lanes with a single socket configuration can > > sometimes be maddening. AMD may have a variety of nice parts for this > > application, although I don?t have any personal experience with routing on > > such hardware. > > Thanks -- I searched for a pair of boxes in my infra with those > specs, found them: > > Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz > 82599ES 10-Gigabit SFI/SFP+ Network Connection > and > Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz > 82599ES 10-Gigabit SFI/SFP+ Network Connection > > and tested. Roughly the same performance, if we use only one > connection. These CPU's have a quad channel memory controller, to achive anything close to the maximal memory bandwidth of 68BG/s you need to have all 4 banks of the memory occupied with identical DIMM's, and preferable DDR4 2133 or DDR4 2400. Also iirc the 82599ES uses the iflib driver code, and I am not sure how performant that is. The Mellanox and Chelsio cards are preferable in places that high speed is needed. > > iperf3 -c > > The boxes were able to reach 10gbit, if we run 3 threads in parallel: > > iperf3 -c -P 3 > > So I have some area where I can investigate further. I am not sure if hyperthreading has any effect on this type setup, I usually disable it on anything I want to be "performant" unless I see some great need for more threads. > p...@freebsd.org +49 171 3101372 Now what ? -- Rod Grimes rgri...@freebsd.org ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: Which cpu/mainboard for fast routing (bgp, full tables) ?
Hi! > That class of processor has fairly limited memory bandwidth. An E5 v3 or > greater should get you what you want, although finding a system that makes > good use of available PCIe lanes with a single socket configuration can > sometimes be maddening. AMD may have a variety of nice parts for this > application, although I don’t have any personal experience with routing on > such hardware. Thanks -- I searched for a pair of boxes in my infra with those specs, found them: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz 82599ES 10-Gigabit SFI/SFP+ Network Connection and Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz 82599ES 10-Gigabit SFI/SFP+ Network Connection and tested. Roughly the same performance, if we use only one connection. iperf3 -c The boxes were able to reach 10gbit, if we run 3 threads in parallel: iperf3 -c -P 3 So I have some area where I can investigate further. -- p...@freebsd.org +49 171 3101372 Now what ? ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: Which cpu/mainboard for fast routing (bgp, full tables) ?
That class of processor has fairly limited memory bandwidth. An E5 v3 or greater should get you what you want, although finding a system that makes good use of available PCIe lanes with a single socket configuration can sometimes be maddening. AMD may have a variety of nice parts for this application, although I don’t have any personal experience with routing on such hardware. Probably equally important is the NICs, I’d go with Chelsio T5 or Mellanox ConnectX 4 Lx or greater. On Sat, Mar 27, 2021 at 1:08 PM Kurt Jaeger wrote: > Hi! > > We currently operate routers (FreeBSD 12.x, frr7) with > Xeon(R) CPU E3-1230 v6 @ 3.50GHz CPUs and 10g links. > They get to around 5-6 gbit/s throughput. > > What kind of hardware can you all suggest, if we stay > in the generic PC area, to improve the routing throughput ? > > -- > p...@freebsd.org +49 171 3101372 Now what ? > ___ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org" > ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Which cpu/mainboard for fast routing (bgp, full tables) ?
Hi! We currently operate routers (FreeBSD 12.x, frr7) with Xeon(R) CPU E3-1230 v6 @ 3.50GHz CPUs and 10g links. They get to around 5-6 gbit/s throughput. What kind of hardware can you all suggest, if we stay in the generic PC area, to improve the routing throughput ? -- p...@freebsd.org +49 171 3101372 Now what ? ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
