Re: [vpp-dev] Question on performance tests..

2020-08-18 Thread Christian Hopps


> On Aug 17, 2020, at 10:52 AM, Benoit Ganne (bganne) via lists.fd.io 
>  wrote:
> 
> Hi Christian,
> 
> I am CC'ing csit-dev but here are some elements.
> 
> AFAIK, CSIT results are not trustworthy for Mellanox NIC yet unfortunately: 
> T-Rex suffers from "stretch duration" when using Mellanox NIC to inject 
> traffic.
> Here is my understanding of what this means: when asked to send at X packets 
> in Y seconds (hence at a rate of X/Y pps), T-Rex effectively takes Y + Z 
> seconds. CSIT figures are based on the programmed rate (X/Y) and not the real 
> rate (X/(Y+Z)).
> In a nutshell: we are not really sure where we're at with Mellanox card in 
> CSIT.

This is very interesting. I believe I am seeing this stretch from trex as well; 
however, it happens with i710 as well as a cx5 cards in the trex tester.

Basically I tell trex to start then after the expected amount of time (for 
which I'm doing other sampling) I tell the trex client to wait for traffic to 
complete. I would expect this to return immediately as I've been timing things. 
Instead it is taking longer (perhaps much longer) depending on how high the 
rate was that I tried to send.

  c.start(ports=check_ports, mult=mult, duration=duration)
  [wait duration seconds doing sampling]
  c.wait_on_traffic(rx_delay_ms=100)

Thanks,
Chris.

> Your figures look similar to what I get on my setup (~20Mpps bi-directional 
> for IPv4 forwarding).
> 
> Best
> ben
> 
>> -Original Message-
>> From: vpp-dev@lists.fd.io  On Behalf Of Christian
>> Hopps
>> Sent: lundi 17 août 2020 15:00
>> To: vpp-dev 
>> Cc: Christian Hopps 
>> Subject: [vpp-dev] Question on performance tests..
>> 
>> [sent to csit-dev but perhaps since I'm not subscribed it didn't post]
>> 
>> I'm looking at this performance graph:
>> 
>> https://docs.fd.io/csit/master/trending/trending/ip4-2n-clx-cx556a.html
>> 
>> Is this a uni-directional or a bi-directional test?
>> 
>> There is a huge performance gain between June and July it seems. Do we
>> know which change this was? I'm on a current vpp master and I am only
>> getting about 9Mpps+ bidirectional (18Mpps total) with IPv4 forwarding of
>> 64 octet packets with 100GE Cx5 cards and Trex.
>> 
>> Thanks,
>> Chris.
> 



signature.asc
Description: Message signed with OpenPGP
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#17252): https://lists.fd.io/g/vpp-dev/message/17252
Mute This Topic: https://lists.fd.io/mt/76242714/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-


Re: [vpp-dev] Question on performance tests..

2020-08-17 Thread Benoit Ganne (bganne) via lists.fd.io
Hi Christian,

I am CC'ing csit-dev but here are some elements.

AFAIK, CSIT results are not trustworthy for Mellanox NIC yet unfortunately: 
T-Rex suffers from "stretch duration" when using Mellanox NIC to inject traffic.
Here is my understanding of what this means: when asked to send at X packets in 
Y seconds (hence at a rate of X/Y pps), T-Rex effectively takes Y + Z seconds. 
CSIT figures are based on the programmed rate (X/Y) and not the real rate 
(X/(Y+Z)).
In a nutshell: we are not really sure where we're at with Mellanox card in CSIT.

Your figures look similar to what I get on my setup (~20Mpps bi-directional for 
IPv4 forwarding).

Best
ben

> -Original Message-
> From: vpp-dev@lists.fd.io  On Behalf Of Christian
> Hopps
> Sent: lundi 17 août 2020 15:00
> To: vpp-dev 
> Cc: Christian Hopps 
> Subject: [vpp-dev] Question on performance tests..
> 
> [sent to csit-dev but perhaps since I'm not subscribed it didn't post]
> 
> I'm looking at this performance graph:
> 
>  https://docs.fd.io/csit/master/trending/trending/ip4-2n-clx-cx556a.html
> 
> Is this a uni-directional or a bi-directional test?
> 
> There is a huge performance gain between June and July it seems. Do we
> know which change this was? I'm on a current vpp master and I am only
> getting about 9Mpps+ bidirectional (18Mpps total) with IPv4 forwarding of
> 64 octet packets with 100GE Cx5 cards and Trex.
> 
> Thanks,
> Chris.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#17249): https://lists.fd.io/g/vpp-dev/message/17249
Mute This Topic: https://lists.fd.io/mt/76242714/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-