[vpp-dev] vpp stripped binary failed to start on icelake 8380 platform with ubuntu 22.04

[Pei, Yulong]

Hi vpp-dev and csit-dev,

Do you guys bumped into below issue on icelake 8380 platform with ubuntu 22.04 ?

1.  make build-release; make  pkg-deb

Built vpp from vpp repo master branch, the latest commit id as below,

commit 590a82c237337f560cc3d5beac47a235c5e97eac
Author: Tianyu Li tianyu...@arm.com
Date:   Sat Jan 28 07:58:45 2023 +

build: add missing dependences for centos 8

2. install vpp from deb packages,  here vpp binary were stripped,   running 
failed as below,

# /usr/bin/vpp -c /etc/vpp/startup.conf
unix_config:472: couldn't open log '/var/log/vpp/vpp.log'
vpp[1076183]: clib_socket_init: unknown input `(nil)/snort.sock'

#file  /usr/bin/vpp
/usr/bin/vpp: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), 
dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, 
BuildID[sha1]=9e31d428a67f39d3c523ecd6fadfc45e058e029d, for GNU/Linux 3.2.0, 
stripped


3.  vpp manage to run as below, also can connect by vppctl

#cd  vpp/build-root/install-vpp-native/vpp/bin
#./vpp -c /etc/vpp/startup.conf  &
#./vppctl
_____   _  ___
__/ __/ _ \  (_)__| | / / _ \/ _ \
_/ _// // / / / _ \   | |/ / ___/ ___/
/_/ /(_)_/\___/   |___/_/  /_/

vpp# show version
vpp v23.06-rc0~61-g590a82c23 built by root on fdio-ICX1 at 2023-02-14T14:02:50

#file ./vpp
./vpp: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically 
linked, interpreter /lib64/ld-linux-x86-64.so.2, 
BuildID[sha1]=f7df044e5b3b084240f5bed0cab3ec360057b9d4, for GNU/Linux 3.2.0, 
with debug_info, not stripped

Note: here startup.conf file was the default on from deb package.

Best Regards
Yulong Pei


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22594): https://lists.fd.io/g/vpp-dev/message/22594
Mute This Topic: https://lists.fd.io/mt/96960944/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] help with review

[Pei, Yulong]

Hi Benoit and vpp-dev,What is your opinion about this patch 
https://gerrit.fd.io/r/c/vpp/+/38135  ?  Could it be merged in FD.io 23.02 ? 

Best Regards
Yulong Pei

-Original Message-
From: vpp-dev@lists.fd.io  On Behalf Of Pei, Yulong
Sent: Tuesday, February 7, 2023 10:10 PM
To: Benoit Ganne (bganne) 
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] help with review

Hi Benoit,  A new one also need your help to review 
https://gerrit.fd.io/r/c/vpp/+/38135 , thanks a lot.

-Original Message-
From: vpp-dev@lists.fd.io  On Behalf Of Benoit Ganne 
(bganne) via lists.fd.io
Sent: Thursday, February 2, 2023 6:37 PM
To: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] help with review

Hi, thanks for the head's up.

> Please help to review below patches again, all your comments were 
> addressed. Thanks a lot.
> https://gerrit.fd.io/r/c/vpp/+/38008

Merged!

> https://gerrit.fd.io/r/c/vpp/+/38009

A few minor comments left on that one, but then we should be good to merge.

Thanks,
ben

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22569): https://lists.fd.io/g/vpp-dev/message/22569
Mute This Topic: https://lists.fd.io/mt/96695094/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] help with review

[Pei, Yulong]

Hi Benoit,  A new one also need your help to review 
https://gerrit.fd.io/r/c/vpp/+/38135 , thanks a lot.

-Original Message-
From: vpp-dev@lists.fd.io  On Behalf Of Benoit Ganne 
(bganne) via lists.fd.io
Sent: Thursday, February 2, 2023 6:37 PM
To: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] help with review

Hi, thanks for the head's up.

> Please help to review below patches again, all your comments were 
> addressed. Thanks a lot.
> https://gerrit.fd.io/r/c/vpp/+/38008

Merged!

> https://gerrit.fd.io/r/c/vpp/+/38009

A few minor comments left on that one, but then we should be good to merge.

Thanks,
ben

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22558): https://lists.fd.io/g/vpp-dev/message/22558
Mute This Topic: https://lists.fd.io/mt/96695094/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] help with review

[Pei, Yulong]

Hi Benoit,  Please help to review below patches again, all your comments were 
addressed. Thanks a lot.

https://gerrit.fd.io/r/c/vpp/+/38008
https://gerrit.fd.io/r/c/vpp/+/38009

From: vpp-dev@lists.fd.io  On Behalf Of Pei, Yulong
Sent: Thursday, January 12, 2023 8:42 PM
To: vpp-dev ; Benoit Ganne (bganne) 
Subject: [vpp-dev] help review for patch about update af_xdp plugin to depend 
on libxdp

Hi Benoit and vpp-dev,   Could you help review for patch about update af_xdp 
plugin to depend on libxdp  https://gerrit.fd.io/r/c/vpp/+/37869 .

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22535): https://lists.fd.io/g/vpp-dev/message/22535
Mute This Topic: https://lists.fd.io/mt/96695094/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] is VPP Gerrit server "No space left on device"

[Pei, Yulong]

When open patch link of gerrit, it pops up below message with web browser, and 
can not find patch contents any more,

[cid:image001.png@01D93493.3F911590]

From: vpp-dev@lists.fd.io  On Behalf Of Pei, Yulong
Sent: Saturday, January 28, 2023 10:30 PM
To: vpp-dev 
Subject: [vpp-dev] is VPP Gerrit server "No space left on device"

Hello vpp-dev,

Failed to run `git review`,  is VPP Gerrit server "No space left on device" ?

# git review
error: remote unpack failed: error No space left on device
fatal: Unpack error, check server log
To ssh://gerrit.fd.io:29418/vpp

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22514): https://lists.fd.io/g/vpp-dev/message/22514
Mute This Topic: https://lists.fd.io/mt/96587880/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] is VPP Gerrit server "No space left on device"

[Pei, Yulong]

Hello vpp-dev,

Failed to run `git review`,  is VPP Gerrit server "No space left on device" ?

# git review
error: remote unpack failed: error No space left on device
fatal: Unpack error, check server log
To ssh://gerrit.fd.io:29418/vpp

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22513): https://lists.fd.io/g/vpp-dev/message/22513
Mute This Topic: https://lists.fd.io/mt/96587880/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] help review for patch about update af_xdp plugin to depend on libxdp

[Pei, Yulong]

Hi Benoit and vpp-dev,   Could you help review for patch about update af_xdp 
plugin to depend on libxdp  https://gerrit.fd.io/r/c/vpp/+/37869 .

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22455): https://lists.fd.io/g/vpp-dev/message/22455
Mute This Topic: https://lists.fd.io/mt/96221395/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] Bumping dpdk to 22.11 in vpp 23.02 ?

[Pei, Yulong]

Add @Xu, Qian Q

-Original Message-
From: Maciek Konstantynowicz (mkonstan)  
Sent: Wednesday, January 11, 2023 11:53 PM
To: Ji, Kai ; Pei, Yulong ; Xu, Ting 
; Liu, Yong ; vpp-dev 
; csit-dev 
Cc: Fan Roy Zhang ; Andrew Yourtchenko (ayourtch) 
; Dave Wallace (dwallace) ; Peter Mikus 
-X (pmikus - PANTHEON TECH SRO at Cisco) 
Subject: Bumping dpdk to 22.11 in vpp 23.02 ?

Hi,

On CSIT call just now Kai made us aware of issues with above (cryptodev, sat), 
as captured in this patch:

37840: dpdk: make impact to VPP for changes in API for DPDK 22.11 | 
https://gerrit.fd.io/r/c/vpp/+/37840

23.02 RC1 is next week and in CSIT we start testing at RC1 milestone, so it’s 
very last minute …

Also, in the past we got burned by DPDK bump requiring bumping firmware 
versions on FVL and CVL NICs, which for our performance testbed fleet is a bit 
of an operation (e.g. on Arm we have to remove the NICs and put them into Xeon 
machines to do firmware upgrade, unless things improved recently).

Asking for views if we could delay dpdk ver bumping to avoid rushing it in, 
especially that there are open issues?

Thoughts?

Cheers,
-Maciek

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22453): https://lists.fd.io/g/vpp-dev/message/22453
Mute This Topic: https://lists.fd.io/mt/96202380/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] LoadBalancer SCTP Support

[Pei, Yulong]

Seems like that vpp/src/plugin/cnat can support sctp,

commit f284c14c7bd8731367ba3527cdfffa610a8c6de4
Author: Nathan Skrzypczak 
nathan.skrzypc...@gmail.com
Date:   Wed Feb 2 19:31:58 2022 +0100

cnat: Add sctp support

This patch adds SCTP support in the CNat translation primitives.
It also exposes a clib_crc32c_with_init function allowing to set
the init value to start the crc32 with instead of 0.

Type: feature

Change-Id: I86add4cfcac08f2a5a34d1e1841122fafd349fe7
Signed-off-by: Nathan Skrzypczak 
nathan.skrzypc...@gmail.com
From: vpp-dev@lists.fd.io  On Behalf Of Christopher Adigun
Sent: Thursday, December 29, 2022 4:00 PM
To: vpp-dev 
Subject: [vpp-dev] LoadBalancer SCTP Support

Hi,

Please, I will like to know if VPP can be used as an SCTP loadbalancer.

I could not find much reference about this..

Checking the help options for the lb command shows only tcp/udp

vpp#
vpp# lb ?
  lb aslb as  [protocol 
(tcp|udp) port ] [ [ [...]]] [del] [flush]
  lb conf  lb conf [ip4-src-address ] 
[ip6-src-address ] [buckets ] [timeout ]
  lb flush vip lb flush vip  [protocol 
(tcp|udp) port ]
  lb set interface nat4lb set interface nat4 in  
[del]
  lb set interface nat6lb set interface nat6 in  
[del]
  lb vip   lb vip  [protocol (tcp|udp) 
port ] [encap (gre6|gre4|l3dsr|nat4|nat6)] [dscp ] [type 
(nodeport|clusterip) target_port ] [new_len ] [del]


If yes, kindly share documentation reference (or sample config if possible).

Thanks

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22395): https://lists.fd.io/g/vpp-dev/message/22395
Mute This Topic: https://lists.fd.io/mt/95933876/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] RFC: move the “1”st instance of the community meeting 3 hours earlier to reduce impact for earlier time zone

[Pei, Yulong]

+1, Looking forward to join community meeting.

From: vpp-dev@lists.fd.io  On Behalf Of Ni, Hongjun
Sent: Wednesday, November 23, 2022 11:51 AM
To: vpp-dev@lists.fd.io
Cc: Li, Jokul 
Subject: Re: [vpp-dev] RFC: move the “1”st instance of the community meeting 3 
hours earlier to reduce impact for earlier time zone

+1. Hope more PRC guys will join and contribute to VPP community!

From: vpp-dev@lists.fd.io 
mailto:vpp-dev@lists.fd.io>> On Behalf Of qian xu
Sent: Wednesday, November 23, 2022 9:28 AM
To: vpp-dev@lists.fd.io
Cc: Li, Jokul mailto:jokul...@intel.com>>
Subject: Re: [vpp-dev] RFC: move the “1”st instance of the community meeting 3 
hours earlier to reduce impact for earlier time zone

+1, thanks for the inclusion for PRC contributors, looking forwards to joining 
the community meetings in near future!

From: vpp-dev@lists.fd.io 
mailto:vpp-dev@lists.fd.io>> On Behalf Of Dave Wallace
Sent: Wednesday, November 23, 2022 2:48 AM
To: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] RFC: move the “1”st instance of the community meeting 3 
hours earlier to reduce impact for earlier time zone

+1
On 11/22/22 11:28 AM, Andrew Yourtchenko wrote:

Hi all,



It came up that the current time of the community meeting is extremely 
unfriendly for our community members on China timezone - it makes it midnight 
their time.



So, as per discussion on the call today, I would like to propose to move every 
other of the meetings (the one in the second Tuesday of the month) three hours 
earlier.



I would also suggest that this proposal take effect starting with the upcoming 
meeting on December 13th.



Thoughts ?



--a









-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22238): https://lists.fd.io/g/vpp-dev/message/22238
Mute This Topic: https://lists.fd.io/mt/9526/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

[Pei, Yulong]

Hi Andrew,

cherry-pick for stable/2210:   https://gerrit.fd.io/r/c/vpp/+/37413

Thanks
Yulong Pei

From: Andrew  Yourtchenko 
Sent: Tuesday, October 18, 2022 1:58 PM
To: Pei, Yulong 
Cc: vpp-dev@lists.fd.io; Andrew Yourtchenko (ayourtch) ; 
Ji, Kai ; Zhang, Roy Fan ; Oginski, 
GabrielX 
Subject: Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

Hi Yulong,

Cool, thanks! Then could you please make a cherry-pick into stable/2210 branch, 
and add me as a reviewer ? I will merge it.
--a


On 18 Oct 2022, at 03:51, Pei, Yulong 
mailto:yulong@intel.com>> wrote:

Hi Andrew,

I have been working on CSIT IPSec test for a long time, CSIT IPSec test use VPP 
python API for configuration,
“SSWAN plugin https://gerrit.fd.io/r/c/vpp/+/36552”  have no impact for CSIT 
IPSec test since it is only plugin for strongswan,  and it do not build by 
defaut when building VPP,
Also it located at vpp/extra dir,  So it is no risk for VPP 22.10.

Best Regards
Yulong Pei

From: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io> 
mailto:vpp-dev@lists.fd.io>> On Behalf Of Andrew 
Yourtchenko
Sent: Friday, October 14, 2022 6:04 PM
To: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>
Subject: Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

Hi Kai,

Having a second look at it - the plugin is offloading IPSec;

So I would like some of the CSIT folks/IPSec maintainers to chime in with 
confirmation that they are comfortable with this… I think I might need to 
rescind the previous “no risk” assessment.

--a



On 14 Oct 2022, at 11:50, Ji, Kai mailto:kai...@intel.com>> 
wrote:

Hi Andrew,

Thank you for the reply, I’m agree with you, the 
https://gerrit.fd.io/r/c/vpp/+/36183 is way too big and risky for stable 22.10 
now.

In this case, can I kindly to ask you consider to merge VPP SSWAN plugin 
(https://gerrit.fd.io/r/c/vpp/+/36552) for 22.10 stable ?
This patches only update the plugin and test script itself, and no dependences 
on vlibapi refactor and library fix.

Regards

Kai

From: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io> 
mailto:vpp-dev@lists.fd.io>> On Behalf Of Andrew 
Yourtchenko
Sent: Friday, October 14, 2022 9:57 AM
To: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>
Subject: Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

Kaj,

*release manager hat on*

we are past RC2 milestone - which means only critical fixes for CSIT tests go 
in.

if the commit was just the plugin itself, in principle might be possible to 
entertain the idea, since a separate plugin is relatively low risk.

But https://gerrit.fd.io/r/c/vpp/+/36183 is *far* too much risk to back port at 
this point in time, and is again not a fix per se. So unfortunately I will have 
to say “no” on this one.

--a




On 14 Oct 2022, at 10:43, Ji, Kai mailto:kai...@intel.com>> 
wrote:

Hello

We recently added fix plugin for vpp-sswan 
(https://gerrit.fd.io/r/c/vpp/+/36552) and I wonder if is it too late for this 
patch to be picked to stable 22.10 ?

To make things more complicate,  there is also a fix linked library patch for 
vpp-sswan https://gerrit.fd.io/r/c/vpp/+/37388 where need to be applied on top 
of vlibapi refactor (https://gerrit.fd.io/r/c/vpp/+/36183).
Otherwise,  the fix patch is no longer required if the vlibapi refactor is out 
of scope of stable 22.10.

Regards

Kai Ji
-
Intel Research and Development Ireland Ltd
Co. Reg. #308263
Collinstown Industrial Park, Leixlip,
County Kildare, Ireland









-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22047): https://lists.fd.io/g/vpp-dev/message/22047
Mute This Topic: https://lists.fd.io/mt/94322720/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

[Pei, Yulong]

Hi Andrew,

I have been working on CSIT IPSec test for a long time, CSIT IPSec test use VPP 
python API for configuration,
“SSWAN plugin https://gerrit.fd.io/r/c/vpp/+/36552”  have no impact for CSIT 
IPSec test since it is only plugin for strongswan,  and it do not build by 
defaut when building VPP,
Also it located at vpp/extra dir,  So it is no risk for VPP 22.10.

Best Regards
Yulong Pei

From: vpp-dev@lists.fd.io  On Behalf Of Andrew Yourtchenko
Sent: Friday, October 14, 2022 6:04 PM
To: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

Hi Kai,

Having a second look at it - the plugin is offloading IPSec;

So I would like some of the CSIT folks/IPSec maintainers to chime in with 
confirmation that they are comfortable with this… I think I might need to 
rescind the previous “no risk” assessment.

--a


On 14 Oct 2022, at 11:50, Ji, Kai mailto:kai...@intel.com>> 
wrote:

Hi Andrew,

Thank you for the reply, I’m agree with you, the 
https://gerrit.fd.io/r/c/vpp/+/36183 is way too big and risky for stable 22.10 
now.

In this case, can I kindly to ask you consider to merge VPP SSWAN plugin 
(https://gerrit.fd.io/r/c/vpp/+/36552) for 22.10 stable ?
This patches only update the plugin and test script itself, and no dependences 
on vlibapi refactor and library fix.

Regards

Kai

From: vpp-dev@lists.fd.io 
mailto:vpp-dev@lists.fd.io>> On Behalf Of Andrew 
Yourtchenko
Sent: Friday, October 14, 2022 9:57 AM
To: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] VPP SSWAN plugin git cherry pick to stable 22.10

Kaj,

*release manager hat on*

we are past RC2 milestone - which means only critical fixes for CSIT tests go 
in.

if the commit was just the plugin itself, in principle might be possible to 
entertain the idea, since a separate plugin is relatively low risk.

But https://gerrit.fd.io/r/c/vpp/+/36183 is *far* too much risk to back port at 
this point in time, and is again not a fix per se. So unfortunately I will have 
to say “no” on this one.

--a



On 14 Oct 2022, at 10:43, Ji, Kai mailto:kai...@intel.com>> 
wrote:

Hello

We recently added fix plugin for vpp-sswan 
(https://gerrit.fd.io/r/c/vpp/+/36552) and I wonder if is it too late for this 
patch to be picked to stable 22.10 ?

To make things more complicate,  there is also a fix linked library patch for 
vpp-sswan https://gerrit.fd.io/r/c/vpp/+/37388 where need to be applied on top 
of vlibapi refactor (https://gerrit.fd.io/r/c/vpp/+/36183).
Otherwise,  the fix patch is no longer required if the vlibapi refactor is out 
of scope of stable 22.10.

Regards

Kai Ji
-
Intel Research and Development Ireland Ltd
Co. Reg. #308263
Collinstown Industrial Park, Leixlip,
County Kildare, Ireland







-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22044): https://lists.fd.io/g/vpp-dev/message/22044
Mute This Topic: https://lists.fd.io/mt/94322720/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] issue about linux-cp plugin can not sync network change from separate Linux network namespace to vpp

[Pei, Yulong]

Hello pim,

I  try to dry run linux-cp plugin,  refer to configuations in you blog  
https://ipng.ch/s/articles/2021/12/23/vpp-playground.html ,

It worked fine with linux network default,  but it can not work with separate 
Linux network namespace "dataplane",  Could you kind to give some suggestions 
about how to root cause the issue ? thanks in advance!

I tried VPP 22.02 and VPP 22.06 release,  both can not work with separate Linux 
network namespace "dataplane".

My configurations as below,

1.

cat /etc/vpp/startup.conf

unix
{
  log /tmp/vpe.log
  cli-listen /run/vpp/cli.sock
  nodaemon
  full-coredump
  exec /etc/vpp/bootstrap_clx4.vpp
}
socksvr
{
  socket-name /run/vpp/api.sock
}
memory
{
  main-heap-size 2G
  main-heap-page-size 2M
  default-hugepage-size 2M
}
statseg
{
  size 2G
  page-size 2M
  per-node-counters on
}
plugins
{
  plugin default
  {
disable
  }
  plugin dpdk_plugin.so
  {
enable
  }
  plugin perfmon_plugin.so
  {
enable
  }
  plugin linux_nl_plugin.so
  {
enable
  }
  plugin linux_cp_plugin.so
  {
enable
  }
}
ip6
{
  hash-buckets 200
  heap-size 4G
}
cpu
{
  main-core 25
  corelist-workers 26,27,28,29
}
buffers
{
  buffers-per-numa 107520
}
dpdk
{
  dev :d8:00.1
  dev :da:00.1
  no-tx-checksum-offload
  log-level debug
  uio-driver vfio-pci
  dev default
  {
num-rx-queues 4
  }
  no-multi-seg
}
logging
{
  default-log-level info
  default-syslog-log-level notice
}

2.

cat /etc/vpp/bootstrap_clx4.vpp

lcp default netns dataplane
lcp lcp-sync on
lcp lcp-auto-subint on

create loopback interface instance 0
lcp create loop0 host-if loop0
set interface state loop0 up
set interface ip address loop0 10.1.1.1/32

lcp create TwentyFiveGigabitEthernetd8/0/1 host-if tap0

lcp create TwentyFiveGigabitEthernetda/0/1 host-if tap1


3.

service vpp restart

root@clx4:~# vppctl
_____   _  ___
__/ __/ _ \  (_)__| | / / _ \/ _ \
_/ _// // / / / _ \   | |/ / ___/ ___/
/_/ /(_)_/\___/   |___/_/  /_/

vpp# show lcp
lcp default netns 'dataplane'
lcp lcp-auto-subint on
lcp lcp-sync on
itf-pair: [0] loop0 tap3 loop0 14 type tap netns dataplane
itf-pair: [1] TwentyFiveGigabitEthernetd8/0/1 tap1 tap0 15 type tap netns 
dataplane
itf-pair: [2] TwentyFiveGigabitEthernetda/0/1 tap2 tap1 16 type tap netns 
dataplane

vpp# show interface
  Name   IdxState  MTU (L3/IP4/IP6/MPLS) 
Counter  Count
TwentyFiveGigabitEthernetd8/0/1   1 down 2018/0/0/0
TwentyFiveGigabitEthernetda/0/1   2 down 2018/0/0/0
local00 down  0/0/0/0
loop0 3  up  9000/0/0/0 tx packets  
  36
tx bytes
2656
drops   
  18
ip6 
  17
tap1  5  up  2018/0/0/0
tap2  6  up   1634103909/0/0/0
tap3  4  up  9000/0/0/0 rx packets  
  17
rx bytes
1286
ip6 
  17

vpp# show interface addr
TwentyFiveGigabitEthernetd8/0/1 (dn):
TwentyFiveGigabitEthernetda/0/1 (dn):
local0 (dn):
loop0 (up):
  L3 10.1.1.1/32
tap1 (up):
tap2 (up):
tap3 (up):

4.  at linux host

root@clx4:~# ip netns exec dataplane ip addr show
1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group 
default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
   valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
   valid_lft forever preferred_lft forever
14: loop0:  mtu 9000 qdisc mq state UNKNOWN 
group default qlen 1000
link/ether de:ad:00:00:00:00 brd ff:ff:ff:ff:ff:ff
inet 10.1.1.1/32 scope global loop0
   valid_lft forever preferred_lft forever
inet6 fe80::dcad:ff:fe00:0/64 scope link
   valid_lft forever preferred_lft forever
15: tap0:  mtu 2018 qdisc mq state DOWN group default qlen 
1000
link/ether 3c:fd:fe:cf:33:55 brd ff:ff:ff:ff:ff:ff
16: tap1:  mtu 2018 qdisc mq state DOWN group default qlen 
1000
link/ether 3c:fd:fe:c0:e1:d9 brd ff:ff:ff:ff:ff:ff

root@clx4:~# ip netns exec dataplane ip link set tap0 up mtu 1500
root@clx4:~# ip netns exec dataplane ip addr add 192.168.2.1/24 dev tap0
root@clx4:~# ip netns exec dataplane ip link set tap1 up mtu 1500
root@clx4:~# ip netns exec dataplane ip addr add 192.168.1.1/24 dev tap1

root@clx4:~# ip netns exec dataplane ip addr show
1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group 
default qlen 1000
link/loopback 00:00:00:00:00:00 brd 

Re: [vpp-dev] make API_FUZZ=yes TEST=xxx test-debug

[Pei, Yulong]

Hi vpp-dev,

After read the source code of  "vpp/src/plugins/unittest/api_fuzz_test.c",  I 
understand that it only add the fuzz_hook,
Who can help to give some guidance about how to trigger the test for each API ?

Best Regards
Yulong Pei


From: vpp-dev@lists.fd.io  On Behalf Of Pei, Yulong
Sent: Wednesday, July 6, 2022 9:23 PM
To: vpp-dev@lists.fd.io; Dave Barach (dbarach) 
Subject: [vpp-dev] make API_FUZZ=yes TEST=xxx test-debug

Hello vpp-dev,

What is the expected output of  `make API_FUZZ=yes TEST=xxx test-debug` ?
I dry run `make API_FUZZ=yes TEST=test_srv6 test-debug`,  but no api fuzzing 
related output log I can get from /tmp directory,  any other configuration 
needed ? or something wrong ?

Best Regards
Yulong Pei

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21647): https://lists.fd.io/g/vpp-dev/message/21647
Mute This Topic: https://lists.fd.io/mt/92206102/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] make API_FUZZ=yes TEST=xxx test-debug

[Pei, Yulong]

Hello vpp-dev,

What is the expected output of  `make API_FUZZ=yes TEST=xxx test-debug` ?
I dry run `make API_FUZZ=yes TEST=test_srv6 test-debug`,  but no api fuzzing 
related output log I can get from /tmp directory,  any other configuration 
needed ? or something wrong ?

Best Regards
Yulong Pei

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21617): https://lists.fd.io/g/vpp-dev/message/21617
Mute This Topic: https://lists.fd.io/mt/92206102/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] Is there any plan to enable fuzzing for VPP ?

[Pei, Yulong]

Hello vpp-dev,   Is there any plan to enable fuzzing for VPP ? e. g. to use 
https://llvm.org/docs/LibFuzzer.html in VPP.



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21569): https://lists.fd.io/g/vpp-dev/message/21569
Mute This Topic: https://lists.fd.io/mt/91917379/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] src/vppinfra/test_mheap.c should be deleted ?

[Pei, Yulong]

Hi vpp-dev,

As subject,  Historical mheap memory allocator was removed,   seems that 
src/vppinfra/test_mheap.c  also should be deleted ?

Best Regards
Yulong Pei

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20474): https://lists.fd.io/g/vpp-dev/message/20474
Mute This Topic: https://lists.fd.io/mt/86958652/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] Issue while pushing code for gerrit review

[Pei, Yulong]

You need to use git-review version 1.28.0:

$ pip install git-review==1.28.0

Best Regards
Yulong Pei

From: vpp-dev@lists.fd.io  On Behalf Of Chinmaya Aggarwal
Sent: Wednesday, June 24, 2020 12:55 PM
To: vpp-dev@lists.fd.io
Subject: [vpp-dev] Issue while pushing code for gerrit review

Hi,
I have raised an issue on VPP mailing list 
(https://lists.fd.io/g/vpp-dev/topic/74894689). I have done the fix for this 
issue and want to submit the fix for gerrit review. I followed the steps 
described in 
https://wiki.fd.io/view/VPP/Pulling,_Building,_Running,_Hacking_and_Pushing_VPP_Code#Pushing_Code_with_git_review
But, on executing the command "git review" we get the below error : -
root@ggnlabvm-hnsnfvsdn03:~/vpp# git review
remote: error: branch refs/publish/master/fix/vpp_topic_74477804:
remote: You need 'Create' rights to create new references.
remote: User: ChinmayaAgarwal
remote: Contact an administrator to fix the permissions
remote:
remote: Processing changes: refs: 1
remote: Processing changes: refs: 1, done
To ssh://gerrit.fd.io:29418/vpp
 ! [remote rejected] HEAD -> refs/publish/master/fix/vpp_topic_74477804 
(prohibited by Gerrit: not permitted: create)
error: failed to push some refs to 
'ssh://chinmayaagar...@gerrit.fd.io:29418/vpp'
Can anyone please suggest what is wrong here?
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#16800): https://lists.fd.io/g/vpp-dev/message/16800
Mute This Topic: https://lists.fd.io/mt/75076228/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] How to trigger the perf test?

[Pei, Yulong]

csit-2n-clx-perftest 
mrrAND1cAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf
From: vpp-dev@lists.fd.io  On Behalf Of Dave Wallace
Sent: Tuesday, June 2, 2020 10:07 PM
To: Yang, Zhiyong ; vpp-dev@lists.fd.io; 
csit-...@lists.fd.io
Subject: Re: [vpp-dev] How to trigger the perf test?

+ csit-...@lists.fd.io

On 6/2/2020 6:10 AM, Zhiyong Yang wrote:
Hi vpp/csit experts,

I have submitted one patch that tries to optimize l2 input node.  
https://gerrit.fd.io/r/c/vpp/+/27191
Want to see if it can help enhance the perf or not. But don't how to trigger 
the L2 BD perf test case on CSIT.
Who can help me about it ? Thanks a lot in advancement.

BR
Zhiyong





-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#16620): https://lists.fd.io/g/vpp-dev/message/16620
Mute This Topic: https://lists.fd.io/mt/74624445/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] vpp master branch can not build with ubuntu 16.04

[Pei, Yulong]

Dear All,

vpp master branch can not build with ubuntu 16.04, anyone can kindly help on 
the fix ?

error info as below,


VPP version : 20.09-rc0~28-g53b8dc8
VPP library version : 20.09
GIT toplevel dir: /root/download_vpp/vpp
Build type  : release
C flags : -Wno-address-of-packed-member -g -fPIC -Werror -Wall 
-march=corei7 -mtune=corei7-avx -O2 -fstack-protector -DFORTIFY_SOURCE=2 
-fno-common
Linker flags (apps) : -pie
Linker flags (libs) :
Host processor  : x86_64
Target processor: x86_64
Prefix path : 
/opt/vpp/external/x86_64;/root/download_vpp/vpp/build-root/install-vpp-native/external
Install prefix  : /root/download_vpp/vpp/build-root/install-vpp-native/vpp
-- Configuring done
-- Generating done
-- Build files have been written to: 
/root/download_vpp/vpp/build-root/build-vpp-native/vpp
 Building vpp in /root/download_vpp/vpp/build-root/build-vpp-native/vpp 
[796/2008] Building C object vat/CMakeFiles/vpp_api_test.dir/types.c.o
FAILED: ccache /usr/lib/ccache/gcc-9  -Dvpp_api_test_EXPORTS 
-I/root/download_vpp/vpp/src -I. -Iinclude -Wno-address-of-packed-member -g 
-fPIC -Werror -Wall -march=corei7 -mtune=corei7-avx  -O2 -fstack-protector 
-DFORTIFY_SOURCE=2 -fno-common-pthread -MMD -MT 
vat/CMakeFiles/vpp_api_test.dir/types.c.o -MF 
vat/CMakeFiles/vpp_api_test.dir/types.c.o.d -o 
vat/CMakeFiles/vpp_api_test.dir/types.c.o   -c 
/root/download_vpp/vpp/src/vat/types.c
/root/download_vpp/vpp/src/vat/types.c: In function 
'format_vl_api_address_family':
/root/download_vpp/vpp/src/vat/types.c:28:31: error: 'vl_api_address_family_t' 
{aka 'enum '} is promoted to 'int' when passed through '...' 
[-Werror]
   28 |   vl_api_address_family_t af = va_arg (*args, vl_api_address_family_t);
/root/download_vpp/vpp/src/vat/types.c:28:31: note: (so you should pass 'int' 
not 'vl_api_address_family_t' {aka 'enum '} to 'va_arg')
/root/download_vpp/vpp/src/vat/types.c:28:31: note: if this code is reached, 
the program will abort
/root/download_vpp/vpp/src/vat/types.c: In function 
'format_vl_api_address_union':
/root/download_vpp/vpp/src/vat/types.c:56:31: error: 'vl_api_address_family_t' 
{aka 'enum '} is promoted to 'int' when passed through '...' 
[-Werror]
   56 |   vl_api_address_family_t af = va_arg (*args, vl_api_address_family_t);
/root/download_vpp/vpp/src/vat/types.c:56:31: note: if this code is reached, 
the program will abort
cc1: all warnings being treated as errors
[796/2008] Building C object vnet/CMakeFiles/vnet_icl.dir/ipsec/esp_decrypt.c.o
ninja: build stopped: subcommand failed.
Makefile:693: recipe for target 'vpp-build' failed
make[1]: *** [vpp-build] Error 1
make[1]: Leaving directory '/root/download_vpp/vpp/build-root'
Makefile:403: recipe for target 'build-release' failed
make: *** [build-release] Error 2


root@fdio-vpp:~/download_vpp/vpp# cat /etc/issue
Ubuntu 16.04.4 LTS \n \l

root@fdio-vpp:~/download_vpp/vpp# uname -r
4.13.0-36-generic

root@fdio-vpp:~/download_vpp/vpp# gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/9/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none:hsa
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 
9.3.0-10ubuntu2~16.04' --with-bugurl=file:///usr/share/doc/gcc-9/README.Bugs 
--enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --prefix=/usr 
--with-gcc-major-version-only --program-suffix=-9 
--program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id 
--libexecdir=/usr/lib --without-included-gettext --enable-threads=posix 
--libdir=/usr/lib --enable-nls --enable-clocale=gnu --enable-libstdcxx-debug 
--enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new 
--enable-gnu-unique-object --disable-vtable-verify --enable-plugin 
--with-system-zlib --with-target-system-zlib=auto --enable-objc-gc=auto 
--enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 
--with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic 
--enable-offload-targets=nvptx-none,hsa --without-cuda-driver 
--enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu 
--target=x86_64-linux-gnu
Thread model: posix
gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2~16.04)

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#16447): https://lists.fd.io/g/vpp-dev/message/16447
Mute This Topic: https://lists.fd.io/mt/74318066/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] why VAT can not link libvnet.so library ?

[Pei, Yulong]

Hello Dave,

I noticed that you are maintainer of VPP API TEST (VAT),  could you help me 
about this issue ?

Best Regards
Yulong Pei

From: vpp-dev@lists.fd.io  On Behalf Of Pei, Yulong
Sent: Tuesday, December 31, 2019 5:47 PM
To: vpp-dev@lists.fd.io
Subject: [vpp-dev] why VAT can not link libvnet.so library ?

Dear VPP-dev,

I  bumped into an issue as below  since I called  ip_address_encode() function 
in  src/plugins/lb/lb_test.c

./vpp_api_test: symbol lookup error: 
/root/vpp/build-root/build-vpp-native/vpp/lib/vpp_api_test_plugins/lb_test_plugin.so:
 undefined symbol: ip_address_encode

But actually   ip_address_encode() was compiled in libvnet.so,

vpp/build-root/install-vpp-native/vpp/lib# nm libvnet.so |grep ip_address_encode
00623d30 T ip_address_encode

So I do below changes in order to let VAT can link with libvnet.so,   but it 
did not take effect.

diff --git a/src/vat/CMakeLists.txt b/src/vat/CMakeLists.txt
index d512d9c17..81b99bd3d 100644
--- a/src/vat/CMakeLists.txt
+++ b/src/vat/CMakeLists.txt
@@ -16,7 +16,7 @@
##
add_vpp_library(vatplugin
   SOURCES plugin_api.c
-  LINK_LIBRARIES vppinfra
+  LINK_LIBRARIES vnet vppinfra
)

##
@@ -33,6 +33,7 @@ add_vpp_executable(vpp_api_test ENABLE_EXPORTS
   DEPENDS api_headers

   LINK_LIBRARIES
+  vnet
   vlibmemoryclient
   svm
   vatplugin


Could you guys help me about this issue ?


Best Regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#15043): https://lists.fd.io/g/vpp-dev/message/15043
Mute This Topic: https://lists.fd.io/mt/69345918/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] why VAT can not link libvnet.so library ?

[Pei, Yulong]

Dear VPP-dev,

I  bumped into an issue as below  since I called  ip_address_encode() function 
in  src/plugins/lb/lb_test.c

./vpp_api_test: symbol lookup error: 
/root/vpp/build-root/build-vpp-native/vpp/lib/vpp_api_test_plugins/lb_test_plugin.so:
 undefined symbol: ip_address_encode

But actually   ip_address_encode() was compiled in libvnet.so,

vpp/build-root/install-vpp-native/vpp/lib# nm libvnet.so |grep ip_address_encode
00623d30 T ip_address_encode

So I do below changes in order to let VAT can link with libvnet.so,   but it 
did not take effect.

diff --git a/src/vat/CMakeLists.txt b/src/vat/CMakeLists.txt
index d512d9c17..81b99bd3d 100644
--- a/src/vat/CMakeLists.txt
+++ b/src/vat/CMakeLists.txt
@@ -16,7 +16,7 @@
##
add_vpp_library(vatplugin
   SOURCES plugin_api.c
-  LINK_LIBRARIES vppinfra
+  LINK_LIBRARIES vnet vppinfra
)

##
@@ -33,6 +33,7 @@ add_vpp_executable(vpp_api_test ENABLE_EXPORTS
   DEPENDS api_headers

   LINK_LIBRARIES
+  vnet
   vlibmemoryclient
   svm
   vatplugin


Could you guys help me about this issue ?


Best Regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#15002): https://lists.fd.io/g/vpp-dev/message/15002
Mute This Topic: https://lists.fd.io/mt/69345918/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] make: yamllint: Command not found

[Pei, Yulong]

Hello vpp-dev & csit-dev,


https://jenkins.fd.io/job/vpp-checkstyle-verify-master/12407/console

16:56:10 ***
16:56:10 * VPP CHECKSTYLE SUCCESSFULLY COMPLETED
16:56:10 ***
16:56:10 yamllint /w/workspace/vpp-checkstyle-verify-master/src
16:56:10 make: yamllint: Command not found
16:56:10 Makefile:561: recipe for target 'checkstyle' failed
16:56:10 make: *** [checkstyle] Error 127
16:56:10 Build step 'Execute shell' marked build as failure

It seems that the server that scheduled by Jenkins lack the command `yamllint`  
that caused  vpp checkstyle failure,
Who can help install `yamllint` on the servers to fix the issue ?

Best Regards
Yulong Pei

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14592): https://lists.fd.io/g/vpp-dev/message/14592
Mute This Topic: https://lists.fd.io/mt/57093164/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] iommu_group value is always -1 when run vpp with dpdk plugin

[Pei, Yulong]

Hello vpp-dev and csit-dev,

When run CSIT test,  it first run  verify_vpp_on_all_duts  with default  
startup.conf without uio-driver field setup in it,
Then VPP will probe uio-driver automatically, due to iommu_group=-1,  VPP will 
change the value of
/sys/module/vfio/parameters/enable_unsafe_noiommu_mode  in the system  from N 
to Y,   this will cause that VPP always  mistake
to run with vfio-noiommu driver within the platform that is on intel_iommu=on 
state.

I proposed a patch [1] to fix this issue, please kindly help to review to see 
if it is acceptable.
[1]  https://gerrit.fd.io/r/c/vpp/+/22805
Normally  to configure vfio-noiommu with intel_iommu=on on the platform that 
has IOMMU should be regarded as invalid config,
But below test result(on intel cascadelake platform) made me puzzled,

1. VPP worked fine with vfio noiommu driver and intel_iommu=on when running 
with 1G hugepages.
2. VPP do not work with vfio noiommu driver and intel_iommu=on when running 
with 2M hugepages.

So here need your expert's comment  if vfio noiommu driver and intel_iommu=on 
is a valid configuration for VPP ?
If Yes, it may to your expert to fix issue of running with 2M hugepages.

Best Regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14248): https://lists.fd.io/g/vpp-dev/message/14248
Mute This Topic: https://lists.fd.io/mt/35943087/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] How to solve "No problems were identified. If you know why this problem occurred, please add a suitable..." #automation

[Pei, Yulong]

I  had ever met this build issue with centos 7.6 before,  upgrade ninja-build 
to version 1.7.2 help me fix the issue,
Not know if it can fix your situation.

Best Regards
Yulong Pei

From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of Sun, Chenmin
Sent: Saturday, October 12, 2019 9:49 AM
To: Dave Wallace ; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] How to solve "No problems were identified. If you know 
why this problem occurred, please add a suitable..." #automation

Thanks for the feedback.

Best Regards,
Sun, Chenmin

From: Dave Wallace [mailto:dwallac...@gmail.com]
Sent: Friday, October 11, 2019 11:57 PM
To: Sun, Chenmin mailto:chenmin@intel.com>>; 
vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] How to solve "No problems were identified. If you know 
why this problem occurred, please add a suitable..." #automation

It looks like there was some state in the build executor that didn't get 
cleaned up correctly.
I'm guessing that a new executor was used in the 'recheck' which did pass.

We'll keep an eye on this to see if it is a recurring issue.

Thanks for reporting it.
-daw-

On 10/11/2019 9:46 AM, Sun, Chenmin wrote:
Hi,
Here's my patch link. https://gerrit.fd.io/r/c/vpp/+/22637
You can see the 4th compiling passed without that error, however, I didn't 
change any code.

Best Regards,
Sun, Chenmin

From: Dave Wallace [mailto:dwallac...@gmail.com]
Sent: Friday, October 11, 2019 9:43 PM
To: Sun, Chenmin ; 
vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] How to solve "No problems were identified. If you know 
why this problem occurred, please add a suitable..." #automation

Please provide the link to your gerrit patch.

Thanks,
-daw-

On 10/10/2019 10:04 PM, Sun, Chenmin wrote:
Hi,
I found my patch always met an automation compiling error, stating "No problems 
were identified. If you know why this problem occurred, please add a 
suitable...".  Opening the log I can see "ninja: error: manifest 'build.ninja' 
still dirty after 100 tries". I have met 3 times on my latest patch(the 4th 
compiling is ongoing).

Does anyone know what does this error means? How to solve this problem?



-=-=-=-=-=-=-=-=-=-=-=-

Links: You receive all messages sent to this group.



View/Reply Online (#14157): https://lists.fd.io/g/vpp-dev/message/14157

Mute This Topic: https://lists.fd.io/mt/34482502/675079

Mute #automation: https://lists.fd.io/mk?hashtag=automation=1480517

Group Owner: vpp-dev+ow...@lists.fd.io

Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  
[dwallac...@gmail.com]

-=-=-=-=-=-=-=-=-=-=-=-


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14170): https://lists.fd.io/g/vpp-dev/message/14170
Mute This Topic: https://lists.fd.io/mt/34482502/21656
Mute #automation: https://lists.fd.io/mk?hashtag=automation=1480452
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] Trex can not work with Mellanox ConnectX-5 MT27800 25G nic on ubuntu 18.04.2

[Pei, Yulong]

Hello all,

Who has experience about run Trex  with  Mellanox ConnectX-5 MT27800 25G NIC on 
ubuntu 18.04.2  ?
I tried trex-core-2.57 and trex-core-2.60  by follow the guide [1] 
https://trex-tgn.cisco.com/trex/doc/trex_appendix_mellanox.html,
but Trex can not work correctly,  the packets statistics is totally not correct.

The guide [1] mentioned that  Trex only tested with MLNX_OFED_LINUX-4.6-1.0.1.1 
on centos 7.6,
But I am wondering that why Trex can not work with Ubuntu 18.04.2,  why it 
depend on OS distributions ?


Best Regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#13657): https://lists.fd.io/g/vpp-dev/message/13657
Mute This Topic: https://lists.fd.io/mt/32696990/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] Issues of VPP deb packages on packagecloud.io

[Pei, Yulong]

Hello vpp-dev,

Recently VPP deb packages for  ubuntu/xenial  on packagecloud.io  always have 
issues,
for example,   
https://packagecloud.io/app/fdio/master/search?q=19.08-rc0~744-gde85e7f~b7679,
only  have 4  deb packages ,  but usually it should have 9 deb packages,
please help to advise how to fix this issue ?


[cid:image001.jpg@01D543D7.4233D360]


Best Regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#13590): https://lists.fd.io/g/vpp-dev/message/13590
Mute This Topic: https://lists.fd.io/mt/32607517/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] [csit-dev] how to know data type mapping between *.api.json with PYTHON API ?

[Pei, Yulong]

Hi Ole,

Currently I  have below issue as describe in your 
https://gerrit.fd.io/r/#/c/19389/,

"""
An IPv4 or IPv6 address was previously defined like:
```
u8 is_ip6;
u8 address[16];
```

Which made it hard for language bindings to represent the
address as anything but a byte string.
The new explicit address types are shown above.
"""

I bumped into ip address defined like above,   then what is the correct way to 
pass ip address to python api ?

I tried below way, but it seems that is not corrent,

vip_addr = ''.join(list(inet_pton(AF_INET, '90.1.2.1')))

pass `vip_addr` to a python api that need ip address,  I can not get the 
correct result.

Best Regards
Yulong Pei

-Original Message-
From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of Ole Troan
Sent: Wednesday, May 8, 2019 4:45 PM
To: Pei, Yulong 
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io; Ni, Hongjun 
; Liu, Yu Y ; Kinsella, Ray 

Subject: Re: [vpp-dev] [csit-dev] how to know data type mapping between 
*.api.json with PYTHON API ?

Hi again,

> Thanks for you kindly help.  Now I know the data type mapping, and I 
> have another question, When I pass parameters to a python api, the api 
> excuted successfully,  no error reported,  but the final result is not 
> what I want to get, So I want to debug to know where the issue existed,  Does 
> python api have debug mode to step in an python api internal to know the 
> parameter that pass to the api is valid ?

You can enable logging in the Python mode that gives quite a bit of 
information. Feel free to add to that btw.
There is also API tracing on the VPP side you can enable. And of course you can 
run both the Python side and the VPP side in debuggers.

But yes, any suggestions for how debuggability of developing new API messages 
are welcome.

Cheers,
Ole

> -Original Message-
> From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of 
> Ole Troan
> Sent: Tuesday, May 7, 2019 3:20 PM
> To: Pei, Yulong 
> Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io; Ni, Hongjun 
> ; Liu, Yu Y ; Kinsella, Ray 
> 
> Subject: Re: [vpp-dev] [csit-dev] how to know data type mapping between 
> *.api.json with PYTHON API ?
> 
> Hi Yulong,
> 
> Good question. That has been on my list of things to document for a while.
> Does
> https://gerrit.fd.io/r/#/c/19389/
> 
> answer your question?
> Please suggest improvements and improve the text as you notice gaps.
> 
> Best regards,
> Ole
> 
> 
>> On 7 May 2019, at 07:49, Pei, Yulong  wrote:
>> 
>> Hello vpp-dev & csit-dev,
>> 
>> I  have a question about how to know data type mapping between  *.api.json 
>> with PYTHON API ?
>> 
>> Let me use “./src/vnet/ip/ip.api” as example,  as I know,   vppapigen will 
>> autogenerate  “ip.api.json” from “ip.api”
>> 
>> And then vpp_papi can autogenerate  its python api from “ip.api.json”, is 
>> there any way to know data type mapping between  *.api.json with PYTHON API ?
>> 
>> For example:
>> 
>> In “./src/vnet/ip/ip.api”,
>> 
>> define ip6_fib_details
>> {
>>  u32 context;
>>  u32 table_id;
>>  u8  table_name[64];
>>  u8  address_length;
>>  u8  address[16];
>>  u32 count;
>>  u32 stats_index;
>>  vl_api_fib_path_t path[count];
>> };
>> 
>> Then in   “ip.api.json”, I  got,
>> 
>>[
>>"ip6_fib_details",
>>[
>>"u16",
>>"_vl_msg_id"
>>],
>>[
>>"u32",
>>"context"
>>],
>>[
>>"u32",
>>"table_id"
>>],
>>[
>>"u8",
>>"table_name",
>>64
>>],
>>[
>>"u8",
>>"address_length"
>>],
>>[
>>"u8",
>>"address",
>>16
>>],
>>[
>>"u32",
>>"count"
>>],
>>[
>>"u32",
>>"stats_index"
>>],
>>[
>>"vl_api_fib_path_t",
>>"path",
>>0,
>>"count"
>>],
>>{
>>&q

Re: [vpp-dev] [csit-dev] how to know data type mapping between *.api.json with PYTHON API ?

[Pei, Yulong]

Hi Ole,

Thanks for you kindly help.  Now I know the data type mapping, and I have 
another question,
When I pass parameters to a python api, the api excuted successfully,  no error 
reported,  but the final result is not what I want to get, 
So I want to debug to know where the issue existed,  Does python api have debug 
mode to step in an python api internal to know the parameter
that pass to the api is valid ?

Best Regards
Yulong Pei

-Original Message-
From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of Ole Troan
Sent: Tuesday, May 7, 2019 3:20 PM
To: Pei, Yulong 
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io; Ni, Hongjun 
; Liu, Yu Y ; Kinsella, Ray 

Subject: Re: [vpp-dev] [csit-dev] how to know data type mapping between 
*.api.json with PYTHON API ?

Hi Yulong,

Good question. That has been on my list of things to document for a while.
Does 
https://gerrit.fd.io/r/#/c/19389/

answer your question?
Please suggest improvements and improve the text as you notice gaps.

Best regards,
Ole


> On 7 May 2019, at 07:49, Pei, Yulong  wrote:
> 
> Hello vpp-dev & csit-dev,
>  
> I  have a question about how to know data type mapping between  *.api.json 
> with PYTHON API ?
>  
> Let me use “./src/vnet/ip/ip.api” as example,  as I know,   vppapigen will 
> autogenerate  “ip.api.json” from “ip.api”
>  
> And then vpp_papi can autogenerate  its python api from “ip.api.json”, is 
> there any way to know data type mapping between  *.api.json with PYTHON API ?
>  
> For example:
>  
> In “./src/vnet/ip/ip.api”,
>  
> define ip6_fib_details
> {
>   u32 context;
>   u32 table_id;
>   u8  table_name[64];
>   u8  address_length;
>   u8  address[16];
>   u32 count;
>   u32 stats_index;
>   vl_api_fib_path_t path[count];
> };
>  
> Then in   “ip.api.json”, I  got,
>  
> [
> "ip6_fib_details",
> [
> "u16",
> "_vl_msg_id"
> ],
> [
> "u32",
> "context"
> ],
> [
> "u32",
> "table_id"
> ],
> [
> "u8",
> "table_name",
> 64
> ],
> [
> "u8",
> "address_length"
> ],
> [
> "u8",
> "address",
> 16
> ],
> [
> "u32",
> "count"
> ],
> [
> "u32",
> "stats_index"
> ],
> [
> "vl_api_fib_path_t",
> "path",
> 0,
> "count"
> ],
> {
> "crc": "0xef11e94d"
> }
> ],
>  
> My question is that which kind of python data type can be used to map below 
> json types ?
> [
> "u8",
> "table_name",
> 64
> ],
>  
> [
> "u8",
> "address",
> 16
> ],
>  
> [
> "vl_api_fib_path_t",
> "path",
> 0,
> "count"
> ],
>  
> Best Regards
> Yulong Pei
>  
>  
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> 
> View/Reply Online (#3484): https://lists.fd.io/g/csit-dev/message/3484
> Mute This Topic: https://lists.fd.io/mt/31529209/675193
> Group Owner: csit-dev+ow...@lists.fd.io
> Unsubscribe: https://lists.fd.io/g/csit-dev/unsub  [otr...@employees.org]
> -=-=-=-=-=-=-=-=-=-=-=-

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12952): https://lists.fd.io/g/vpp-dev/message/12952
Mute This Topic: https://lists.fd.io/mt/31529576/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] how to know data type mapping between *.api.json with PYTHON API ?

[Pei, Yulong]

Hello vpp-dev & csit-dev,

I  have a question about how to know data type mapping between  *.api.json with 
PYTHON API ?

Let me use "./src/vnet/ip/ip.api" as example,  as I know,   vppapigen will 
autogenerate  "ip.api.json" from "ip.api"

And then vpp_papi can autogenerate  its python api from "ip.api.json", is there 
any way to know data type mapping between  *.api.json with PYTHON API ?

For example:

In "./src/vnet/ip/ip.api",

define ip6_fib_details
{
  u32 context;
  u32 table_id;
  u8  table_name[64];
  u8  address_length;
  u8  address[16];
  u32 count;
  u32 stats_index;
  vl_api_fib_path_t path[count];
};

Then in   "ip.api.json", I  got,

[
"ip6_fib_details",
[
"u16",
"_vl_msg_id"
],
[
"u32",
"context"
],
[
"u32",
"table_id"
],
[
"u8",
"table_name",
64
],
[
"u8",
"address_length"
],
[
"u8",
"address",
16
],
[
"u32",
"count"
],
[
"u32",
"stats_index"
],
[
"vl_api_fib_path_t",
"path",
0,
"count"
],
{
"crc": "0xef11e94d"
}
],

My question is that which kind of python data type can be used to map below 
json types ?
[
"u8",
"table_name",
64
],

[
"u8",
"address",
16
],

[
"vl_api_fib_path_t",
"path",
0,
"count"
],

Best Regards
Yulong Pei


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12943): https://lists.fd.io/g/vpp-dev/message/12943
Mute This Topic: https://lists.fd.io/mt/31529208/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] questions about Computation of the Internet Checksum via Incremental Update "ip_csum_update_inline "

[Pei, Yulong]

Hello vpp-dev,

Please help on  two  questions about " ip_csum_update_inline" ,

1 .  Is the  implementation of  "ip_csum_update_inline"  follow rfc1624 
(https://tools.ietf.org/html/rfc1624)  ?

2.  I am not quite understand of  " ip_csum_sub_even",  it named "sub" but the 
implementation in the function seems that  do the "add",
What is the intention of this ?

Best regards
Yulong Pei
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#10718): https://lists.fd.io/g/vpp-dev/message/10718
Mute This Topic: https://lists.fd.io/mt/26429040/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] CSIT - sw_interface_set_flags admin-up link-up failing

[Pei, Yulong]

Hi  Peter & Vratko,

I noticed " FD.io CSIT-18.07 v1.0 report published",  then this issue was fixed 
in csit-18.07,  right ?
Can you help to tell me how to fix this issue ?

Best Regards
Yulong Pei 

-Original Message-
From: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) 
[mailto:vrpo...@cisco.com] 
Sent: Thursday, August 2, 2018 12:13 AM
To: Peter Mikus -X (pmikus - PANTHEON TECHNOLOGIES at Cisco) 
; Ray Kinsella ; vpp-dev@lists.fd.io
Cc: csit-...@lists.fd.io; Pei, Yulong 
Subject: RE: [vpp-dev] CSIT - sw_interface_set_flags admin-up link-up failing

> VPP is not crashing so no core dump are available.

I tried to use "gcore" command to create a core dump from running VPP.
So far I got this [0] archive, compressed to around 25 MB, but the core file 
inside is around 160 GB big.

Not sure how to make it smaller, even with small numbers in startup.conf, the 
core file has around 140 GB.

Vratko.

[0] 
https://jenkins.fd.io/sandbox/job/csit-vpp-perf-verify-master-2n-skx/13/artifact/archive/DUT1_cores.tar.xz

-Original Message-
From: Peter Mikus -X (pmikus - PANTHEON TECHNOLOGIES at Cisco)
Sent: Tuesday, 2018-July-31 13:25
To: Ray Kinsella ; vpp-dev@lists.fd.io
Cc: csit-...@lists.fd.io; Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at 
Cisco) ; yulong@intel.com
Subject: RE: [vpp-dev] CSIT - sw_interface_set_flags admin-up link-up failing

Hello,

Thanks to Vratko (cc), he tested latest master with DPDK 18.02.2 [0]. The issue 
is there as well.

I cannot confirm if "no JSON data.VAT" is related. The bad thing is that there 
is no meaningful return message with more verbose output.

(we do see this on pretty much on all NIC cards in LF and all TBs)

[0] 
https://jenkins.fd.io/sandbox/job/vpp-csit-verify-hw-perf-master-2n-skx/6/consoleFull

Peter Mikus
Engineer – Software
Cisco Systems Limited

-Original Message-
From: Ray Kinsella [mailto:m...@ashroe.eu]
Sent: Tuesday, July 31, 2018 12:06 PM
To: Peter Mikus -X (pmikus - PANTHEON TECHNOLOGIES at Cisco) 
; vpp-dev@lists.fd.io; yulong@intel.com
Subject: Re: [vpp-dev] CSIT - sw_interface_set_flags admin-up link-up failing

Hi Peter,

It may be unrelated, but I think we see this issue also pretty regularly with 
FD.io VPP 18.04 and the x520, on our local test rig.

The error we typically see is "VAT command sw_interface_set_flags sw_if_index 1 
admin-up: no JSON data.VAT".

Do think it is the same or a separate issue?

Ray K


On 30/07/2018 08:02, Peter Mikus via Lists.Fd.Io wrote:
> Hello vpp-dev,
> 
> I am looking for consultation. We started to test VPP for report on 
> all LF CSIT testbeds Skylakes and Haswells.
> 
> We are observing weird behavior. In each test we are using sequence to 
> first bring the both interfaces (physical up) by VAT:
> 
>    sw_interface_set_flags sw_if_index  admin-up (I 
> also tried sw_interface_set_flags sw_if_index idx admin-up link-up)
> 
> After setting all interfaces UP we are testing if interfaces are 
> really UP by VAT (loop 30times, 1s between API call check): 
> “sw_interface_dump”.
> 
> It wasn’t an issue in past but recently we start seeing that 
> sw_interface_dump is reporting interfaces as link_down (admin-up).
> 
> Notes/symptoms:
> 
> -Our sw_interface_dump check is running 30x (1s interval) in loop.
> 
> -Link-down is random, sometimes both interfaces are link-up sometimes 
> just one and sometimes both link are down.
> 
> -_It is not TB related_, nor cabling related, we see it on 
> Haswells-3node in like 1 out of 70 tests, Skylakes-2node 1 out of 70, 
> but on Skylake-3node more than half of the tests.
> 
> -Checking state during test reveals that interfaces are link-down 
> (show
> int) so “sw_interface_dump” is reporting state correctly.
> 
> -Doing CLI during test “set interface state … up” does bring 
> interfaces UP -> (but it is hard to check the timing here).
> 
> -Affected are mostly x520 and x710, but that is most probably because 
> of statistics (low coverage of other NICs like xxv710 and xl710).
> 
> -We have seen this in master vpp as well as rc2 vpp.
> 
> -It is not clear when this starts to happen, so bisecting would take 
> lot of time.
> 
> -This was spotted on VIRL as well also on Memif interface which bring 
> us to suspicious that this is related to API not HW.
> 
> Do you have an idea what we could check further? VPP is not crashing 
> so no core dump are available. This issue is not 100% replicable which 
> makes it hard to debug.
> 
> Is there a way to get more verbose error from the api call mentioned 
> to reveal more information?
> 
> **
> 
> Thank you.
> 
> *Peter Mikus*
> Engineer – Software
> 
> *Cisco Systems Limited*
> 
> http://www.cisco.com/web/europe/images/email/signatu