[vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hello all,

I am working with VPP 19_04. I noticed that the VSZ of VPP is showing 200+
GB.

On further debugging, I discovered that the 'dpdk_plugin' is the one
causing this. If I disable the dpdk plugin, the VSZ falls below 20G.

Can anyone help me understand what is it in the dpdk plugin that is
causing this bulge in VSZ? Is there anyway to reduce it ?

Any help would be appreciated

Regards,
Siddarth Rai
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14860): https://lists.fd.io/g/vpp-dev/message/14860
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[chetan bhasin]

Hi,

I am also looking for the solution of the below stated problem.

Can anybody please provide direction regarding the same.

Thanks,
Chetan Bhasin

On Wed, Dec 11, 2019 at 11:30 AM siddarth rai  wrote:

> Hello all,
>
> I am working with VPP 19_04. I noticed that the VSZ of VPP is showing 200+
> GB.
>
> On further debugging, I discovered that the 'dpdk_plugin' is the one
> causing this. If I disable the dpdk plugin, the VSZ falls below 20G.
>
> Can anyone help me understand what is it in the dpdk plugin that is
> causing this bulge in VSZ? Is there anyway to reduce it ?
>
> Any help would be appreciated
>
> Regards,
> Siddarth Rai
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
>
> View/Reply Online (#14860): https://lists.fd.io/g/vpp-dev/message/14860
> Mute This Topic: https://lists.fd.io/mt/68143971/856484
> Group Owner: vpp-dev+ow...@lists.fd.io
> Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [
> chetan.bhasin...@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14896): https://lists.fd.io/g/vpp-dev/message/14896
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[Benoit Ganne (bganne) via Lists.Fd.Io]

No idea why DPDK is so greedy, however what do you use the DPDK for? In a lot 
of scenario we can run VPP without DPDK. In this case, you could disable the 
dpdk plugin.

Best
ben 

> -Original Message-
> From: vpp-dev@lists.fd.io  On Behalf Of chetan bhasin
> Sent: lundi 16 décembre 2019 06:50
> To: siddarth rai 
> Cc: vpp-dev 
> Subject: Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin
> 
> Hi,
> 
> I am also looking for the solution of the below stated problem.
> 
> Can anybody please provide direction regarding the same.
> 
> Thanks,
> Chetan Bhasin
> 
> On Wed, Dec 11, 2019 at 11:30 AM siddarth rai  <mailto:sid...@gmail.com> > wrote:
> 
> 
>   Hello all,
> 
>   I am working with VPP 19_04. I noticed that the VSZ of VPP is
> showing 200+ GB.
> 
>   On further debugging, I discovered that the 'dpdk_plugin' is the one
> causing this. If I disable the dpdk plugin, the VSZ falls below 20G.
> 
>   Can anyone help me understand what is it in the dpdk plugin that is
> causing this bulge in VSZ? Is there anyway to reduce it ?
> 
>   Any help would be appreciated
> 
>   Regards,
>   Siddarth Rai
>   -=-=-=-=-=-=-=-=-=-=-=-
>   Links: You receive all messages sent to this group.
> 
>   View/Reply Online (#14860): https://lists.fd.io/g/vpp-
> dev/message/14860
>   Mute This Topic: https://lists.fd.io/mt/68143971/856484
>   Group Owner: vpp-dev+ow...@lists.fd.io <mailto:vpp-
> dev%2bow...@lists.fd.io>
>   Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub
> [chetan.bhasin...@gmail.com <mailto:chetan.bhasin...@gmail.com> ]
>   -=-=-=-=-=-=-=-=-=-=-=-
> 

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14897): https://lists.fd.io/g/vpp-dev/message/14897
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hi Benoit,

Unfortunately, that is not an option for me. I am using dpdk plugin.

Regards,
Siddarth

On Mon, Dec 16, 2019 at 2:50 PM Benoit Ganne (bganne) 
wrote:

> No idea why DPDK is so greedy, however what do you use the DPDK for? In a
> lot of scenario we can run VPP without DPDK. In this case, you could
> disable the dpdk plugin.
>
> Best
> ben
>
> > -Original Message-
> > From: vpp-dev@lists.fd.io  On Behalf Of chetan
> bhasin
> > Sent: lundi 16 décembre 2019 06:50
> > To: siddarth rai 
> > Cc: vpp-dev 
> > Subject: Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin
> >
> > Hi,
> >
> > I am also looking for the solution of the below stated problem.
> >
> > Can anybody please provide direction regarding the same.
> >
> > Thanks,
> > Chetan Bhasin
> >
> > On Wed, Dec 11, 2019 at 11:30 AM siddarth rai  > <mailto:sid...@gmail.com> > wrote:
> >
> >
> >   Hello all,
> >
> >   I am working with VPP 19_04. I noticed that the VSZ of VPP is
> > showing 200+ GB.
> >
> >   On further debugging, I discovered that the 'dpdk_plugin' is the
> one
> > causing this. If I disable the dpdk plugin, the VSZ falls below 20G.
> >
> >   Can anyone help me understand what is it in the dpdk plugin that is
> > causing this bulge in VSZ? Is there anyway to reduce it ?
> >
> >   Any help would be appreciated
> >
> >   Regards,
> >   Siddarth Rai
> >   -=-=-=-=-=-=-=-=-=-=-=-
> >   Links: You receive all messages sent to this group.
> >
> >   View/Reply Online (#14860): https://lists.fd.io/g/vpp-
> > dev/message/14860
> >   Mute This Topic: https://lists.fd.io/mt/68143971/856484
> >   Group Owner: vpp-dev+ow...@lists.fd.io <mailto:vpp-
> > dev%2bow...@lists.fd.io>
> >   Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub
> > [chetan.bhasin...@gmail.com <mailto:chetan.bhasin...@gmail.com> ]
> >   -=-=-=-=-=-=-=-=-=-=-=-
> >
>
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14898): https://lists.fd.io/g/vpp-dev/message/14898
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[Damjan Marion via Lists.Fd.Io]

What is exact problem here? vsz is just virual memory size, it doesn’t mean 
that memory is allocated...

Can you share your startup.conf?

— 
Damjan


> On 16 Dec 2019, at 13:59, siddarth rai  wrote:
> 
> Hi Benoit,
> 
> Unfortunately, that is not an option for me. I am using dpdk plugin.
> 
> Regards,
> Siddarth
> 
> On Mon, Dec 16, 2019 at 2:50 PM Benoit Ganne (bganne)  <mailto:bga...@cisco.com>> wrote:
> No idea why DPDK is so greedy, however what do you use the DPDK for? In a lot 
> of scenario we can run VPP without DPDK. In this case, you could disable the 
> dpdk plugin.
> 
> Best
> ben 
> 
> > -Original Message-
> > From: vpp-dev@lists.fd.io <mailto:vpp-dev@lists.fd.io>  > <mailto:vpp-dev@lists.fd.io>> On Behalf Of chetan bhasin
> > Sent: lundi 16 décembre 2019 06:50
> > To: siddarth rai mailto:sid...@gmail.com>>
> > Cc: vpp-dev mailto:vpp-dev@lists.fd.io>>
> > Subject: Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin
> > 
> > Hi,
> > 
> > I am also looking for the solution of the below stated problem.
> > 
> > Can anybody please provide direction regarding the same.
> > 
> > Thanks,
> > Chetan Bhasin
> > 
> > On Wed, Dec 11, 2019 at 11:30 AM siddarth rai  > <mailto:sid...@gmail.com>
> > <mailto:sid...@gmail.com <mailto:sid...@gmail.com>> > wrote:
> > 
> > 
> >   Hello all,
> > 
> >   I am working with VPP 19_04. I noticed that the VSZ of VPP is
> > showing 200+ GB.
> > 
> >   On further debugging, I discovered that the 'dpdk_plugin' is the one
> > causing this. If I disable the dpdk plugin, the VSZ falls below 20G.
> > 
> >   Can anyone help me understand what is it in the dpdk plugin that is
> > causing this bulge in VSZ? Is there anyway to reduce it ?
> > 
> >   Any help would be appreciated
> > 
> >   Regards,
> >   Siddarth Rai
> >   -=-=-=-=-=-=-=-=-=-=-=-
> >   Links: You receive all messages sent to this group.
> > 
> >   View/Reply Online (#14860): https://lists.fd.io/g/vpp- 
> > <https://lists.fd.io/g/vpp->
> > dev/message/14860
> >   Mute This Topic: https://lists.fd.io/mt/68143971/856484 
> > <https://lists.fd.io/mt/68143971/856484>
> >   Group Owner: vpp-dev+ow...@lists.fd.io 
> > <mailto:vpp-dev%2bow...@lists.fd.io> <mailto:vpp- <mailto:vpp->
> > dev%2bow...@lists.fd.io <mailto:dev%252bow...@lists.fd.io>>
> >   Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub 
> > <https://lists.fd.io/g/vpp-dev/unsub>
> > [chetan.bhasin...@gmail.com <mailto:chetan.bhasin...@gmail.com> 
> > <mailto:chetan.bhasin...@gmail.com <mailto:chetan.bhasin...@gmail.com>> ]
> >   -=-=-=-=-=-=-=-=-=-=-=-
> > 
> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> 
> View/Reply Online (#14898): https://lists.fd.io/g/vpp-dev/message/14898
> Mute This Topic: https://lists.fd.io/mt/68143971/675642
> Group Owner: vpp-dev+ow...@lists.fd.io
> Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [dmar...@me.com]
> -=-=-=-=-=-=-=-=-=-=-=-

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14899): https://lists.fd.io/g/vpp-dev/message/14899
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hi Damjan,

The issue here is that huge core files are generated, which take up a lot
of space and the system down time is huge too.
Even if I compress it, I will have to de-compress wherever I try to debug
it and the disk space requirement will be huge.
It will be interesting to get a hint on what is exactly contributing to
such high virtual memory.

I have created a jira for this: https://jira.fd.io/browse/VPP-1810

Also, please find attached the startup conf I am using.

Regards,
Siddarth


On Mon, Dec 16, 2019 at 6:50 PM Damjan Marion  wrote:

>
> What is exact problem here? vsz is just virual memory size, it doesn’t
> mean that memory is allocated...
>
> Can you share your startup.conf?
>
> —
> Damjan
>
>
> On 16 Dec 2019, at 13:59, siddarth rai  wrote:
>
> Hi Benoit,
>
> Unfortunately, that is not an option for me. I am using dpdk plugin.
>
> Regards,
> Siddarth
>
> On Mon, Dec 16, 2019 at 2:50 PM Benoit Ganne (bganne) 
> wrote:
>
>> No idea why DPDK is so greedy, however what do you use the DPDK for? In a
>> lot of scenario we can run VPP without DPDK. In this case, you could
>> disable the dpdk plugin.
>>
>> Best
>> ben
>>
>> > -Original Message-
>> > From: vpp-dev@lists.fd.io  On Behalf Of chetan
>> bhasin
>> > Sent: lundi 16 décembre 2019 06:50
>> > To: siddarth rai 
>> > Cc: vpp-dev 
>> > Subject: Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin
>> >
>> > Hi,
>> >
>> > I am also looking for the solution of the below stated problem.
>> >
>> > Can anybody please provide direction regarding the same.
>> >
>> > Thanks,
>> > Chetan Bhasin
>> >
>> > On Wed, Dec 11, 2019 at 11:30 AM siddarth rai > > <mailto:sid...@gmail.com> > wrote:
>> >
>> >
>> >   Hello all,
>> >
>> >   I am working with VPP 19_04. I noticed that the VSZ of VPP is
>> > showing 200+ GB.
>> >
>> >   On further debugging, I discovered that the 'dpdk_plugin' is the
>> one
>> > causing this. If I disable the dpdk plugin, the VSZ falls below 20G.
>> >
>> >   Can anyone help me understand what is it in the dpdk plugin that
>> is
>> > causing this bulge in VSZ? Is there anyway to reduce it ?
>> >
>> >   Any help would be appreciated
>> >
>> >   Regards,
>> >   Siddarth Rai
>> >   -=-=-=-=-=-=-=-=-=-=-=-
>> >   Links: You receive all messages sent to this group.
>> >
>> >   View/Reply Online (#14860): https://lists.fd.io/g/vpp-
>> > dev/message/14860
>> >   Mute This Topic: https://lists.fd.io/mt/68143971/856484
>> >   Group Owner: vpp-dev+ow...@lists.fd.io <mailto:vpp-
>> > dev%2bow...@lists.fd.io>
>> >   Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub
>> > [chetan.bhasin...@gmail.com <mailto:chetan.bhasin...@gmail.com> ]
>> >   -=-=-=-=-=-=-=-=-=-=-=-
>> >
>>
>> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
>
> View/Reply Online (#14898): https://lists.fd.io/g/vpp-dev/message/14898
> Mute This Topic: https://lists.fd.io/mt/68143971/675642
> Group Owner: vpp-dev+ow...@lists.fd.io
> Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [dmar...@me.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>
>


startup.conf
Description: Binary data
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14906): https://lists.fd.io/g/vpp-dev/message/14906
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[Benoit Ganne (bganne) via Lists.Fd.Io]

Hi Siddarth,

> The issue here is that huge core files are generated, which take up a lot
> of space and the system down time is huge too.
> Even if I compress it, I will have to de-compress wherever I try to debug
> it and the disk space requirement will be huge.

I know this will not fix your issue, however that might help:
 - when the core file is generated, if the VA is not in use it should not take 
space on the disk because it should be stored as a sparse file. Here is an 
example I have locally (note the 117M allocated on disk vs the 2.6G "virtual" 
size):
bganne@ubuntu1804:~$ ls -lsh core
117M -rw-rw-r-- 1 bganne bganne 2.6G Nov 12 15:34 core
Also, if you do not compress it at generation time (via 
/proc/sys/kernel/core_pattern or similar) it should not impact the downtime as 
it is simply not written nor processed
 - if you compress/decompress it with gzip, it will not produce a sparse file 
but you can 're-sparse' it using eg. dd:
bganne@ubuntu1804:~$ zcat core.gz | dd conv=sparse of=core

Ben
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14911): https://lists.fd.io/g/vpp-dev/message/14911
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hi,

Thanks a lot for the tip.

I would still like to know what is causing DPDK plugin to take up so much
VSZ.
If any one can give me any pointers I will try and debug it further to
hopefully control the VSZ.

Regards,
Siddarth

On Tue, Dec 17, 2019 at 2:57 PM Benoit Ganne (bganne) 
wrote:

> Hi Siddarth,
>
> > The issue here is that huge core files are generated, which take up a lot
> > of space and the system down time is huge too.
> > Even if I compress it, I will have to de-compress wherever I try to debug
> > it and the disk space requirement will be huge.
>
> I know this will not fix your issue, however that might help:
>  - when the core file is generated, if the VA is not in use it should not
> take space on the disk because it should be stored as a sparse file. Here
> is an example I have locally (note the 117M allocated on disk vs the 2.6G
> "virtual" size):
> bganne@ubuntu1804:~$ ls -lsh core
> 117M -rw-rw-r-- 1 bganne bganne 2.6G Nov 12 15:34 core
> Also, if you do not compress it at generation time (via
> /proc/sys/kernel/core_pattern or similar) it should not impact the downtime
> as it is simply not written nor processed
>  - if you compress/decompress it with gzip, it will not produce a sparse
> file but you can 're-sparse' it using eg. dd:
> bganne@ubuntu1804:~$ zcat core.gz | dd conv=sparse of=core
>
> Ben
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#15243): https://lists.fd.io/g/vpp-dev/message/15243
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[Damjan Marion via Lists.Fd.Io]

Can you capture "cat /proc/$(pgrep vpp)/maps” and put it into pastebin?

— 
Damjan

> On 24 Jan 2020, at 09:07, siddarth rai  wrote:
> 
> Hi, 
> 
> Thanks a lot for the tip.
> 
> I would still like to know what is causing DPDK plugin to take up so much 
> VSZ. 
> If any one can give me any pointers I will try and debug it further to 
> hopefully control the VSZ.
> 
> Regards,
> Siddarth
> 
> On Tue, Dec 17, 2019 at 2:57 PM Benoit Ganne (bganne)  > wrote:
> Hi Siddarth,
> 
> > The issue here is that huge core files are generated, which take up a lot
> > of space and the system down time is huge too.
> > Even if I compress it, I will have to de-compress wherever I try to debug
> > it and the disk space requirement will be huge.
> 
> I know this will not fix your issue, however that might help:
>  - when the core file is generated, if the VA is not in use it should not 
> take space on the disk because it should be stored as a sparse file. Here is 
> an example I have locally (note the 117M allocated on disk vs the 2.6G 
> "virtual" size):
> bganne@ubuntu1804:~$ ls -lsh core
> 117M -rw-rw-r-- 1 bganne bganne 2.6G Nov 12 15:34 core
> Also, if you do not compress it at generation time (via 
> /proc/sys/kernel/core_pattern or similar) it should not impact the downtime 
> as it is simply not written nor processed
>  - if you compress/decompress it with gzip, it will not produce a sparse file 
> but you can 're-sparse' it using eg. dd:
> bganne@ubuntu1804:~$ zcat core.gz | dd conv=sparse of=core
> 
> Ben

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#15244): https://lists.fd.io/g/vpp-dev/message/15244
Mute This Topic: https://lists.fd.io/mt/68143971/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hi,

Here is the output :

0040-004ca000 r-xp  fd:01 188780472
 /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
006c9000-006ca000 r--p 000c9000 fd:01 188780472
 /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
006ca000-006cb000 rw-p 000ca000 fd:01 188780472
 /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
006cb000-006cc000 rw-p  00:00 0
01b4b000-01c8b000 rw-p  00:00 0
 [heap]
1-10002f000 rw-p  00:00 0
130008000-130029000 rw-s  00:13 779982
/dev/shm/global_vm
130029000-13104a000 rw-s  00:13 779983
/dev/shm/vpe-api
13104a000-134008000 rw-s 01042000 00:13 779982
/dev/shm/global_vm
14000-94000 r--p  00:00 0
94000-940001000 rw-p  00:00 0
ac0001000-ac0002000 rw-p  00:00 0
c40002000-c40003000 rw-p  00:00 0
dc0003000-dc0064000 rw-p  00:00 0
dc0c64000-dc0cc5000 rw-p  00:00 0
dc18c5000-dc1926000 rw-p  00:00 0
dc2526000-dc2587000 rw-p  00:00 0
10-100280 rw-s  00:27 779981
/buffers-numa-0
100280-14 ---p  00:00 0
7ef98864f000-7efa3f80 rw-p  00:00 0
7efa3f80-7efe3f80 r--p  00:00 0
7efe3fa0-7f023fa0 r--p  00:00 0
7f023fc0-7f063fc0 r--p  00:00 0
7f063fe0-7f064000 rw-p  00:0e 780006
/anon_hugepage (deleted)
7f064000-7f064020 rw-p  00:0e 780008
/anon_hugepage (deleted)
7f064020-7f064040 rw-p  00:0e 780009
/anon_hugepage (deleted)
7f064040-7f0a3fe0 r--p  00:00 0
7f0a4000-7f124000 r--p  00:00 0
7f128000-7f1a8000 r--p  00:00 0
7f1a8c00-7f1a8c021000 rw-p  00:00 0
7f1a8c021000-7f1a9000 ---p  00:00 0
7f1a93ff4000-7f1a9800 rw-p  00:00 0
7f1a9800-7f1a98021000 rw-p  00:00 0
7f1a98021000-7f1a9c00 ---p  00:00 0
7f1a9c00-7f1a9c021000 rw-p  00:00 0
7f1a9c021000-7f1aa000 ---p  00:00 0
7f1aa000-7f1aa0021000 rw-p  00:00 0
7f1aa0021000-7f1aa400 ---p  00:00 0
7f1aa49b8000-7f1aa52da000 rw-p  00:00 0
7f1aa52da000-7f1aa52db000 ---p  00:00 0
7f1aa52db000-7f1ac000 rw-p  00:00 0
7f1ac000-7f22c000 r--p  00:00 0
7f22c000-7f22c0001000 rw-s febd2000 00:12 11698
 /sys/devices/pci:00/:00:04.0/resource1
7f22c0001000-7f22c0005000 rw-s fe004000 00:12 11699
 /sys/devices/pci:00/:00:04.0/resource4
7f22c043a000-7f22c1a59000 rw-p  00:00 0
7f22c1a59000-7f22c1a5c000 r-xp  fd:01 138716319
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
7f22c1a5c000-7f22c1c5b000 ---p 3000 fd:01 138716319
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
7f22c1c5b000-7f22c1c5c000 r--p 2000 fd:01 138716319
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
7f22c1c5c000-7f22c1c5d000 rw-p 3000 fd:01 138716319
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
7f22c1c5d000-7f22c1c5f000 r-xp  fd:01 138561791
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
7f22c1c5f000-7f22c1e5e000 ---p 2000 fd:01 138561791
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
7f22c1e5e000-7f22c1e5f000 r--p 1000 fd:01 138561791
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
7f22c1e5f000-7f22c1e6 rw-p 2000 fd:01 138561791
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
7f22c1e6-7f22c1e63000 r-xp  fd:01 138561788
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
7f22c1e63000-7f22c2062000 ---p 3000 fd:01 138561788
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
7f22c2062000-7f22c2063000 r--p 2000 fd:01 138561788
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
7f22c2063000-7f22c2064000 rw-p 3000 fd:01 138561788
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
7f22c2064000-7f22c2067000 r-xp  fd:01 138561787
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsh_test_plugin.so
7f22c2067000-7f22c2266000 ---p 3000 fd:01 138561787
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsh_test_plugin.so
7f22c2266000-7f22c2267000 r--p 2000 fd:01 138561787
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsh_test_plugin.so
7f22c2267000-7f22c2268000 rw-p 3000 fd:01 138561787
 
/root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsh_test_plugin.so
7f22c2268000-7f22c2271000 r-xp  fd:01 138561786
 
/root/vpp/build-root/install-vpp-native/vp

Re: [vpp-dev] VPP VSZ shoots to 200GB because of DPDK plugin

[siddarth rai]

Hi Damjan,

Output for  cat /proc/$(pgrep vpp)/maps  :
https://pastebin.com/9TfbcPkV

cat /proc/$(pgrep vpp)/numa_maps
https://pastebin.com/wJeEKf5f

Regards,
Siddarth

On Fri, Jan 24, 2020 at 7:18 PM Damjan Marion  wrote:

>
> I asked pastebin to avoid bothering other people of the list with the long
> ouptut…
>
> Can you also capture "cat /proc/$(pgrep vpp)/numa_maps”
>
> —
> Damjan
>
> On 24 Jan 2020, at 14:02, siddarth rai  wrote:
>
> Hi,
>
> Here is the output :
>
> 0040-004ca000 r-xp  fd:01 188780472
>  /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
> 006c9000-006ca000 r--p 000c9000 fd:01 188780472
>  /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
> 006ca000-006cb000 rw-p 000ca000 fd:01 188780472
>  /root/vpp/build-root/install-vpp-native/vpp/bin/vpp
> 006cb000-006cc000 rw-p  00:00 0
> 01b4b000-01c8b000 rw-p  00:00 0
>  [heap]
> 1-10002f000 rw-p  00:00 0
> 130008000-130029000 rw-s  00:13 779982
> /dev/shm/global_vm
> 130029000-13104a000 rw-s  00:13 779983
> /dev/shm/vpe-api
> 13104a000-134008000 rw-s 01042000 00:13 779982
> /dev/shm/global_vm
> 14000-94000 r--p  00:00 0
> 94000-940001000 rw-p  00:00 0
> ac0001000-ac0002000 rw-p  00:00 0
> c40002000-c40003000 rw-p  00:00 0
> dc0003000-dc0064000 rw-p  00:00 0
> dc0c64000-dc0cc5000 rw-p  00:00 0
> dc18c5000-dc1926000 rw-p  00:00 0
> dc2526000-dc2587000 rw-p  00:00 0
> 10-100280 rw-s  00:27 779981
> /buffers-numa-0
> 100280-14 ---p  00:00 0
> 7ef98864f000-7efa3f80 rw-p  00:00 0
> 7efa3f80-7efe3f80 r--p  00:00 0
> 7efe3fa0-7f023fa0 r--p  00:00 0
> 7f023fc0-7f063fc0 r--p  00:00 0
> 7f063fe0-7f064000 rw-p  00:0e 780006
> /anon_hugepage (deleted)
> 7f064000-7f064020 rw-p  00:0e 780008
> /anon_hugepage (deleted)
> 7f064020-7f064040 rw-p  00:0e 780009
> /anon_hugepage (deleted)
> 7f064040-7f0a3fe0 r--p  00:00 0
> 7f0a4000-7f124000 r--p  00:00 0
> 7f128000-7f1a8000 r--p  00:00 0
> 7f1a8c00-7f1a8c021000 rw-p  00:00 0
> 7f1a8c021000-7f1a9000 ---p  00:00 0
> 7f1a93ff4000-7f1a9800 rw-p  00:00 0
> 7f1a9800-7f1a98021000 rw-p  00:00 0
> 7f1a98021000-7f1a9c00 ---p  00:00 0
> 7f1a9c00-7f1a9c021000 rw-p  00:00 0
> 7f1a9c021000-7f1aa000 ---p  00:00 0
> 7f1aa000-7f1aa0021000 rw-p  00:00 0
> 7f1aa0021000-7f1aa400 ---p  00:00 0
> 7f1aa49b8000-7f1aa52da000 rw-p  00:00 0
> 7f1aa52da000-7f1aa52db000 ---p  00:00 0
> 7f1aa52db000-7f1ac000 rw-p  00:00 0
> 7f1ac000-7f22c000 r--p  00:00 0
> 7f22c000-7f22c0001000 rw-s febd2000 00:12 11698
>  /sys/devices/pci:00/:00:04.0/resource1
> 7f22c0001000-7f22c0005000 rw-s fe004000 00:12 11699
>  /sys/devices/pci:00/:00:04.0/resource4
> 7f22c043a000-7f22c1a59000 rw-p  00:00 0
> 7f22c1a59000-7f22c1a5c000 r-xp  fd:01 138716319
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
> 7f22c1a5c000-7f22c1c5b000 ---p 3000 fd:01 138716319
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
> 7f22c1c5b000-7f22c1c5c000 r--p 2000 fd:01 138716319
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
> 7f22c1c5c000-7f22c1c5d000 rw-p 3000 fd:01 138716319
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/vmxnet3_test_plugin.so
> 7f22c1c5d000-7f22c1c5f000 r-xp  fd:01 138561791
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
> 7f22c1c5f000-7f22c1e5e000 ---p 2000 fd:01 138561791
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
> 7f22c1e5e000-7f22c1e5f000 r--p 1000 fd:01 138561791
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
> 7f22c1e5f000-7f22c1e6 rw-p 2000 fd:01 138561791
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/stn_test_plugin.so
> 7f22c1e6-7f22c1e63000 r-xp  fd:01 138561788
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
> 7f22c1e63000-7f22c2062000 ---p 3000 fd:01 138561788
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
> 7f22c2062000-7f22c2063000 r--p 2000 fd:01 138561788
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
> 7f22c2063000-7f22c2064000 rw-p 3000 fd:01 138561788
>  
> /root/vpp/build-root/install-vpp-native/vpp/lib/vpp_api_test_plugins/nsim_test_plugin.so
> 7f22c2064000-7f22c2067000 r-xp  fd:01 1