[vpp-dev] mysql proxy by using vpp host stack #vpp-hoststack
Hi, Now I implement mysql proxy by using libevent.so. And I want to implement mysql proxy by vpp hoststack. But I find the dynamic library libevent.so can not callback the libvcl_preload. Is this plan possible? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21807): https://lists.fd.io/g/vpp-dev/message/21807 Mute This Topic: https://lists.fd.io/mt/93155793/21656 Mute #vpp-hoststack:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp-hoststack Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi,
I try adding to session stanza in startup.conf: session { poll-main }. But the
performance is still exists.
Thanks.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21381): https://lists.fd.io/g/vpp-dev/message/21381
Mute This Topic: https://lists.fd.io/mt/90793836/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, We have only one numa node. Just as the following picture show. vpp# sh hardware-interfaces verbose Name Idx Link Hardware ens1f0 1 up ens1f0 Link speed: 10 Gbps RX Queues: queue thread mode 0 main (0) polling 1 main (0) polling Ethernet address 00:13:95:0a:58:03 Intel 82599 carrier up full duplex max-frame-size 2056 flags: admin-up intel-phdr-cksum rx-ip4-cksum Devargs: rx: queues 2 (max 128), desc 512 (min 32 max 4096 align 8) tx: queues 2 (max 64), desc 512 (min 32 max 4096 align 8) pci: device 8086:10fb subsystem : address :09:00.00 numa 0 max rx packet len: 15872 promiscuous: unicast off all-multicast on vlan offload: strip off filter off qinq off rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum tcp-lro macsec-strip vlan-filter vlan-extend scatter security keep-crc rss-hash rx offload active: ipv4-cksum tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum sctp-cksum tcp-tso macsec-insert multi-segs security tx offload active: none rss avail: ipv4-tcp ipv4-udp ipv4 ipv6-tcp-ex ipv6-udp-ex ipv6-tcp ipv6-udp ipv6-ex ipv6 rss active: ipv4-tcp ipv4-udp ipv4 tx burst function: ixgbe_recv_scattered_pkts_vec rx burst function: (not available) rx frames ok 5 rx bytes ok 415 extended stats: rx_good_packets 5 rx_good_bytes 415 rx_q0_packets 5 rx_q0_bytes 415 mac_remote_errors 1 rx_size_65_to_127_packets 5 rx_multicast_packets 5 rx_total_packets 5 rx_total_bytes 415 ens1f1 2 up ens1f1 Link speed: 10 Gbps RX Queues: queue thread mode 0 main (0) polling 1 main (0) polling Ethernet address 00:13:95:0a:58:04 Intel 82599 carrier up full duplex max-frame-size 2056 flags: admin-up intel-phdr-cksum rx-ip4-cksum Devargs: rx: queues 2 (max 128), desc 512 (min 32 max 4096 align 8) tx: queues 2 (max 64), desc 512 (min 32 max 4096 align 8) pci: device 8086:10fb subsystem : address :09:00.01 numa 0 max rx packet len: 15872 promiscuous: unicast off all-multicast on vlan offload: strip off filter off qinq off rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum tcp-lro macsec-strip vlan-filter vlan-extend scatter security keep-crc rss-hash rx offload active: ipv4-cksum tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum sctp-cksum tcp-tso macsec-insert multi-segs security tx offload active: none rss avail: ipv4-tcp ipv4-udp ipv4 ipv6-tcp-ex ipv6-udp-ex ipv6-tcp ipv6-udp ipv6-ex ipv6 rss active: ipv4-tcp ipv4-udp ipv4 tx burst function: ixgbe_recv_scattered_pkts_vec rx burst function: (not available) rx frames ok 5 rx bytes ok 415 extended stats: rx_good_packets 5 rx_good_bytes 415 rx_q0_packets 5 rx_q0_bytes 415 mac_local_errors 28 mac_remote_errors 1 rx_size_65_to_127_packets 5 rx_multicast_packets 5 rx_total_packets 5 rx_total_bytes 415 local0 0 down local0 Link speed: unknown local In addition, I don't use worker on core 0. Instead, I don't config the worker. So the vpp have only one thread. Just as the following picture show. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21377): https://lists.fd.io/g/vpp-dev/message/21377 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, Now I configure main-core to 2 and corelist-workers to 0, and find that the performance has improved significantly. When I execute the following conmand, I find that vpp have main thread only. #show threads What does this situation show？ Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21370): https://lists.fd.io/g/vpp-dev/message/21370 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, Just as you see, I check the patch. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21368): https://lists.fd.io/g/vpp-dev/message/21368 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, When I set a long connection, the performance of vpp proxy is higher than before. But we need to set a short connection between vpp and upstream server. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21362): https://lists.fd.io/g/vpp-dev/message/21362 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, I test the performance of upstream server. Just as you see, the performance of upstream is more higher than vpp proxy. In addition, I don't find any drops. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21359): https://lists.fd.io/g/vpp-dev/message/21359 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
According to your suggestion, I test with multiple source ips. But the performance is still low. The ip is as follows. vpp#tcp src-address 192.168.6.6-192.168.6.9 Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21354): https://lists.fd.io/g/vpp-dev/message/21354 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, Is this the reason for the low performance? In general, the main threads handles management functions(debug CLI, API, stats collection) and one or more worker threads handle packet processing from input to output of the packet. Why does the main core handle the session? Does the condition influence the performance? If yes, what should I do? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21352): https://lists.fd.io/g/vpp-dev/message/21352 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, When I use wrk to test the performance of nginx proxy using vpp host stack, I execute the command "show session" by vppctl. The result is following. The main core has most of sessions. Is this normal? If not, what should I DO? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21350): https://lists.fd.io/g/vpp-dev/message/21350 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, I wanted to ask if you have tested the performance of nginx proxy using vpp host stack as a short connection, i.e. after vpp send GET request to upstream server, vpp close the connection. If yes, please tell me the result. Thank you for your suggestion about adding multiple source IPs. But we want to make the performance of the vpp protocol stack higher than that of the kernel in the same condition. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21345): https://lists.fd.io/g/vpp-dev/message/21345 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, The short link means that after the client send GET request, the client send tcp FIN packet. Instead, the long link means that after the client send GET request, the client send next http GET request by using the same link and don't need to send syn packet. We found that when vpp and the upstream servers used the short link, the performance is lower than nginx proxy using kernel host stack. The picture shows the performance of nginx proxy using vpp host stack. Actually, the performance of nginx proxy using vpp host stack is higher than nginx proxy using kernel host stack. I don't understand why? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21318): https://lists.fd.io/g/vpp-dev/message/21318 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, I set the timewait_time which is equal to 1s in tcp's configuration. But the performance of nginx proxy using vpp host stack is still lower than nginx proxy using kernel host stack. Now I want to know what can I do to improve the performance? And does nginx proxy using vpp host stack support short link? In addition, just as you said above, do I need to sets time-wait to 0? And I don't set tcp-src address. I hope the performance of nginx proxy using vpp host stack is higher than the performance of nginx proxy using kernel host stack in the hardware environment. Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21314): https://lists.fd.io/g/vpp-dev/message/21314 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, I test nginx proxy using RPS. And nginx proxy only towards one IP. Now I test the performance of nginx proxy using vpp host stack and by configuring nginx, it is a short connection between the nginx reverse proxy and the upstream server. The result of test show that the performance of nginx proxy using vpp host stack is lower than nginx proxy using kernel host stack. In kernel host stack, I config tcp_max_tw_bucket. But when it is a long connection between the nginx reverse proxy and the upstream server, the performance of nginx proxy using vpp host stack is higher than nginx proxy using kernel host stack. So what should I do to improve the performance of nginx proxy using vpp host stack when it is a short connection between the nginx reverse proxy and the upstream server? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21312): https://lists.fd.io/g/vpp-dev/message/21312 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#vpp-hoststack
Hi, Now I use nginx which uses vpp host stack as a proxy to test the performance. But I find the performance of nginx using vpp host stack is lower than nginx using kernel host stack. The reason is that I config the tcp_max_tw_bucket in kernel host stack. So does the vpp stack support the setting tcp_max_tw_bucket? If not, can I modify the vpp host stack? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21308): https://lists.fd.io/g/vpp-dev/message/21308 Mute This Topic: https://lists.fd.io/mt/90793836/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] Can vpp receive packet of 5G/4G module? #dpdk
Hi, Can vpp receive packets of 5G/4G module? And can the dpdk bind 5G NIC? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21256): https://lists.fd.io/g/vpp-dev/message/21256 Mute This Topic: https://lists.fd.io/mt/90455824/21656 Mute #dpdk:https://lists.fd.io/g/vpp-dev/mutehashtag/dpdk Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: Private: Re: [vpp-dev] increase nginx performace using vpp host stack#nginx #vpp-hoststack
Hi, I describe our scene in detail. We use nginx in vpp host stack as a proxy. And we add some features in nginx. For example, nginx close upstream tcp links actively and this causes a lot of TIME_WAIT states in nginx proxy when we test the performance of nginx using vpp host stack. So we configure kernel parameters to multiplex tcp port and recycle port quickly. But I can't find vpp host stack parameters which is similar with kernel parameters. How can we configure vpp parameters to reuse tcp port and recycle port quickly? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21176): https://lists.fd.io/g/vpp-dev/message/21176 Mute This Topic: https://lists.fd.io/mt/90157992/21656 Mute #vpp-hoststack:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp-hoststack Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: Private: Re: [vpp-dev] increase nginx performace using vpp host stack#nginx #vpp-hoststack
Hi, >From this test results, can you see some errors? Why is the performance of >nginx using vpp low? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21174): https://lists.fd.io/g/vpp-dev/message/21174 Mute This Topic: https://lists.fd.io/mt/90157992/21656 Mute #vpp-hoststack:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp-hoststack Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] increase nginx performace using vpp host stack#nginx #vpp-hoststack
Hi, The version of vpp is 22.06. The configs are in the attachment. The nginx using vpp host stack is low. The most important test indicators is RPS. How can we increase the performance of nginx using vpp host stack? nginx.conf Description: Binary data startup.conf Description: Binary data vcl.conf Description: Binary data -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21163): https://lists.fd.io/g/vpp-dev/message/21163 Mute This Topic: https://lists.fd.io/mt/90154397/21656 Mute #vpp-hoststack:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp-hoststack Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] increase nginx performace using vpp host stack#nginx #vpp-hoststack
Now, we develop some functions in nginx and test nginx performance in kernel host stack and vpp host stack. We found the performance of nginx in vpp is lower than nginx in kernel. So I want to ask how to debug to increase the performance of nginx in vpp. Besides, we modify some parameter in kernel. For example, in file /etc/sysctl.conf, we add the following parameters: net.ipv4.tcp_max_tw_buckets = 3000 net.ipv4.tcp_tw_reuse = 1 net.ipv4.tcp_tw_recycle = 1 In file /etc/security/limited.conf, we add the following parameters: * soft nofile 102400 * hard nofile 102400 So how can we add those parameters in vpp host stack? And how can we increase the performance of nginx in vpp? Thanks. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21161): https://lists.fd.io/g/vpp-dev/message/21161 Mute This Topic: https://lists.fd.io/mt/90154397/21656 Mute #vpp-hoststack:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp-hoststack Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#nginx
Yes, I use a debug version. Thank you. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#20772): https://lists.fd.io/g/vpp-dev/message/20772 Mute This Topic: https://lists.fd.io/mt/88456731/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] test performance of nginx using vpp host stack#nginx
The version of vpp is: The config of vpp and nginx is the attachment. The vcl config is attachment. The type of nic is: nginx.conf Description: Binary data startup.conf Description: Binary data vcl_test.conf Description: Binary data -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#20754): https://lists.fd.io/g/vpp-dev/message/20754 Mute This Topic: https://lists.fd.io/mt/88456731/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
