Re: [vpp-dev] vnet buffer leaking on 20.09RC2?
> On 30.09.2020., at 03:49, Chan Wai wrote: > > Hi, vpp-dev, > I am using vpp 20.09RC2. When I bring up the interface, the vnet buffers will > dramatically decreased. > Is this a memory leaking? > > DBGvpp# show version > vpp v20.09-rc2~0-ga87deb77d built by ubuntu on ubuntu-740-1 at > 2020-09-30T01:45:40 > > DBGvpp# show dpdk version > DPDK Version: DPDK 20.08.0 > DPDK EAL init args: -c 552 -n 4 --in-memory --file-prefix vpp -w > :65:00.0 --master-lcore 1 > > DBGvpp# show buffers > Pool NameIndex NUMA Size Data Size Total Avail Cached Used > default-numa-0 0 0 2496 204816800 16800 0 0 > > DBGvpp# show interface > Name IdxState MTU (L3/IP4/IP6/MPLS) > Counter Count > TwentyFiveGigabitEthernet65/0/0 1 down 9000/0/0/0 > local00 down 0/0/0/0 > > DBGvpp# set interface state TwentyFiveGigabitEthernet65/0/0 up > > DBGvpp# show buffers > Pool NameIndex NUMA Size Data Size Total Avail Cached Used > default-numa-0 0 0 2496 204816800 384 0 16416 There is no enough information to help you here. This can be valid state if you are using larger number of RX queues and/or bigger ring sizes… — Damjan -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17620): https://lists.fd.io/g/vpp-dev/message/17620 Mute This Topic: https://lists.fd.io/mt/77210359/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] vnet buffer leaking on 20.09RC2?
Hi, vpp-dev, I am using vpp 20.09RC2. When I bring up the interface, the vnet buffers will dramatically decreased. Is this a memory leaking? DBGvpp# show version vpp v20.09-rc2~0-ga87deb77d built by ubuntu on ubuntu-740-1 at 2020-09-30T01:45:40 DBGvpp# show dpdk version DPDK Version: DPDK 20.08.0 DPDK EAL init args: -c 552 -n 4 --in-memory --file-prefix vpp -w :65:00.0 --master-lcore 1 DBGvpp# show buffers Pool NameIndex NUMA Size Data Size Total Avail Cached Used default-numa-0 0 0 2496 204816800 16800 0 0 DBGvpp# show interface Name IdxState MTU (L3/IP4/IP6/MPLS) Counter Count TwentyFiveGigabitEthernet65/0/0 1 down 9000/0/0/0 local00 down 0/0/0/0 DBGvpp# set interface state TwentyFiveGigabitEthernet65/0/0 up DBGvpp# show buffers Pool NameIndex NUMA Size Data Size Total Avail Cached Used default-numa-0 0 0 2496 204816800 384 0 16416 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17613): https://lists.fd.io/g/vpp-dev/message/17613 Mute This Topic: https://lists.fd.io/mt/77210359/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] vnet buffer leaking on 20.09RC2?
Hi, Yes VPP default to 1024 descriptors per RX and per TX queue for DPDK interface. By default, the number of txq is determined by the number of threads (main thread + worker threads). So if you have 1 interface, 16 rxq and 16 workers, you will allocate 1024 * (16 + (1 + 16)) = 33792 buffers for the interface. You can tweak those parameters (number of descriptors per queue, total number of buffers etc), see [1] and [2]. Best Ben [1] https://fd.io/docs/vpp/master/gettingstarted/users/configuring/startup.html#the-dpdk-section [2] https://fd.io/docs/vpp/master/gettingstarted/users/configuring/startup.html#the-buffers-section > -Original Message- > From: vpp-dev@lists.fd.io On Behalf Of > chanwai1...@gmail.com > Sent: mercredi 30 septembre 2020 05:06 > To: vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] vnet buffer leaking on 20.09RC2? > > #9 0x7fff6da8fae4 in ice_alloc_rx_queue_mbufs (rxq=0x7fe2406de580) at > /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk- > 20.08/drivers/net/ice/ice_rxtx.c:193 > #10 0x7fff6da9fa4b in ice_rx_queue_start (dev=0x7fff7146dec0 > , rx_queue_id=5) at /home/ubuntu/vpp/build-root/build- > vpp_debug-native/external/dpdk-20.08/drivers/net/ice/ice_rxtx.c:391 > #11 0x7fff6da6b5b2 in ice_dev_start (dev=0x7fff7146dec0 > ) at /home/ubuntu/vpp/build-root/build-vpp_debug- > native/external/dpdk-20.08/drivers/net/ice/ice_ethdev.c:3324 > #12 0x7fff6c6318c2 in rte_eth_dev_start (port_id=0) at > /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk- > 20.08/lib/librte_ethdev/rte_ethdev.c:1636 > #13 0x7fff707a82c2 in dpdk_device_start (xd=0x7fff78ebe700) at > /home/ubuntu/vpp/src/plugins/dpdk/device/common.c:173 > > It seems that the ice driver will reserve 1024 buffers per rx queue. > let me try do some more test to check if vlib_buffer_alloc will failed > when there is enough buffers. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17603): https://lists.fd.io/g/vpp-dev/message/17603 Mute This Topic: https://lists.fd.io/mt/77210359/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] vnet buffer leaking on 20.09RC2?
#9 0x7fff6da8fae4 in ice_alloc_rx_queue_mbufs (rxq=0x7fe2406de580) at /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk-20.08/drivers/net/ice/ice_rxtx.c:193 #10 0x7fff6da9fa4b in ice_rx_queue_start (dev=0x7fff7146dec0 , rx_queue_id=5) at /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk-20.08/drivers/net/ice/ice_rxtx.c:391 #11 0x7fff6da6b5b2 in ice_dev_start (dev=0x7fff7146dec0 ) at /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk-20.08/drivers/net/ice/ice_ethdev.c:3324 #12 0x7fff6c6318c2 in rte_eth_dev_start (port_id=0) at /home/ubuntu/vpp/build-root/build-vpp_debug-native/external/dpdk-20.08/lib/librte_ethdev/rte_ethdev.c:1636 #13 0x7fff707a82c2 in dpdk_device_start (xd=0x7fff78ebe700) at /home/ubuntu/vpp/src/plugins/dpdk/device/common.c:173 It seems that the ice driver will reserve 1024 buffers per rx queue. let me try do some more test to check if vlib_buffer_alloc will failed when there is enough buffers. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17598): https://lists.fd.io/g/vpp-dev/message/17598 Mute This Topic: https://lists.fd.io/mt/77210359/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] vnet buffer leaking on 20.09RC2?
[Edited Message Follows]
I think the problem has some relationship with rx queue number of NIC.
dpdk {
dev :65:00.0 { num-rx-queues 16 }
}
Using this config, when bring up interface. There would be 384 buffers
available.
dpdk {
dev :65:00.0 { num-rx-queues 8 }
}
Using this config, when bring up interface. There would be 8576 buffers
available.
dpdk {
dev :65:00.0 { num-rx-queues 2 }
}
Using this config, when bring up interface. There would be 14720 buffers
available.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#17597): https://lists.fd.io/g/vpp-dev/message/17597
Mute This Topic: https://lists.fd.io/mt/77210359/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] vnet buffer leaking on 20.09RC2?
I think the problem has some relationship with rx queue number of NIC.
>
> dpdk {
> dev :65:00.0 { num-rx-queues 16 }
> }
> Using this config, when bring up interface. There would be 384 buffers
> available.
>
>
>
> dpdk {
> dev :65:00.0 { num-rx-queues 8 }
> }
> Using this config, when bring up interface. There would be 8576 buffers
> available.
>
>
> dpdk {
> dev :65:00.0 { num-rx-queues 2 }
> }
> Using this config, when bring up interface. There would be 14720 buffers
> available.
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#17597): https://lists.fd.io/g/vpp-dev/message/17597
Mute This Topic: https://lists.fd.io/mt/77210359/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] vnet buffer leaking on 20.09RC2?
Hi, vpp-dev, I am using vpp 20.09RC2. When I bring up the interface, the vnet buffers will dramatically decreased. Is this a memory leaking? > > > > DBGvpp# show version > > > > vpp v20.09-rc2~0-ga87deb77d built by ubuntu on ubuntu-740-1 at > 2020-09-30T01:45:40 > > > > > > > > DBGvpp# show dpdk version > > > > DPDK Version: DPDK 20.08.0 > > > > DPDK EAL init args: -c 552 -n 4 --in-memory --file-prefix vpp -w > :65:00.0 --master-lcore 1 > > > > > > > > DBGvpp# show buffers > > > > Pool Name Index NUMA Size Data Size Total Avail Cached > Used > > > > default-numa-0 0 0 2496 2048 16800 16800 0 > 0 > > > > > > > > DBGvpp# show interface > > > > Name Idx State MTU (L3/IP4/IP6/MPLS) Counter > Count > > > > TwentyFiveGigabitEthernet65/0/0 1 down 9000/0/0/0 > > > > local0 0 down 0/0/0/0 > > > > > > > > DBGvpp# set interface state TwentyFiveGigabitEthernet65/0/0 up > > > > > > > > DBGvpp# show buffers > > > > Pool Name Index NUMA Size Data Size Total Avail Cached > Used > > > > default-numa-0 0 0 2496 2048 16800 384 0 > 16416 > > Some time later, there is some error message from console: > > > > 0: ip6_ra_process_timer_event:1544: buffer allocation failure > > > > 0: ip6_ra_process_timer_event:1544: buffer allocation failure > > > > 0: ip6_ra_process_timer_event:1544: buffer allocation failure > > -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17596): https://lists.fd.io/g/vpp-dev/message/17596 Mute This Topic: https://lists.fd.io/mt/77210359/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
