Hi Dave, I recompiled vpp v18.10-rc0~229-g869031c5 using master on 08-23-18 and have been running it since. I ran a few tests with various loads and it hasn't crash so far. So, I guess it was some kind of mistake on my part.
I will report back if anything changes. Thank you. On Thu, Aug 23, 2018 at 5:36 AM Dave Barach (dbarach) <dbar...@cisco.com> wrote: > > Looks like a NULL pointer - please decode the pc. It would help if you could > repro the problem with a debug image and send a full backtrace. > > vnet[10192]: received signal SIGSEGV, PC 0x7fa62aecade3, faulting address 0x0 > > D. > > -----Original Message----- > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of carlito nueno > Sent: Wednesday, August 22, 2018 4:07 PM > To: vpp-dev@lists.fd.io > Subject: [vpp-dev] received signal SIGSEGV and vpp restarts continuously > > Hi all, > > I am using vpp 18.10 master branch and have 6 tap devices: lstack[1...6] > > startup.conf > unix { > nodaemon > log /var/log/vpp/vpp.log > full-coredump > cli-listen /run/vpp/cli.sock > gid vpp > startup-config /home/testvpp/vpp.conf > } > > api-trace { > on > } > > api-segment { > gid vpp > } > > cpu { > main-core 2 > corelist-workers 3 > } > > nat { > translation hash buckets 16000 > translation hash memory 268435456 > max translations per user 128 > } > > dpdk { > num-mbufs 32768 > } > > Error: > Started vector packet processing engine. > vpp[10192]: vlib_plugin_early_init:361: plugin path > /usr/lib/vpp_plugins:/usr/lib64/vpp_plugins > vpp[10192]: load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based > Forwarding) > vpp[10192]: load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control > Lists) > vpp[10192]: load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive > Virtual Function (AVF) Device Plugin) > vpp[10192]: load_one_plugin:191: Loaded plugin: cdp_plugin.so > vpp[10192]: load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane > Development Kit (DPDK)) > vpp[10192]: load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per > Packet) > vpp[10192]: load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based > Policy) > vpp[10192]: load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U) > vpp[10192]: load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP > messaging) > vpp[10192]: load_one_plugin:189: Loaded plugin: ila_plugin.so > (Identifier-locator addressing for IPv6) > vpp[10192]: load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM) > vpp[10192]: load_one_plugin:117: Plugin disabled (default): ixge_plugin.so > vpp[10192]: load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation) > vpp[10192]: load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link > Aggregation Control Protocol) > vpp[10192]: load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer) > vpp[10192]: load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based > MAC source-address filter) > vpp[10192]: load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of > address and port (MAP)) > vpp[10192]: load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet > Memory Interface (experimetal)) > vpp[10192]: load_one_plugin:189: Loaded plugin: nat_plugin.so (Network > Address Translation) > vpp[10192]: load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE) > vpp[10192]: load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic > SRv6 proxy) > vpp[10192]: load_one_plugin:189: Loaded plugin: srv6am_plugin.so > (Masquerading SRv6 proxy) > vpp[10192]: load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 > proxy) > vpp[10192]: load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the > NIC for Container integration) > vpp[10192]: load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls > based TLS Engine) > vpp[10192]: load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl > based TLS Engine) > vpp[10192]: load_one_plugin:117: Plugin disabled (default): unittest_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: clib_elf_parse_file: open > `linux-vdso.so.1': No such file or directory > /usr/bin/vpp[10192]: clib_elf_parse_file: open `linux-vdso.so.1': No such > file or directory > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: cdp_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: vxlan_gpe_ioam_export_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: udp_ping_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > vxlan_gpe_ioam_export_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: dpdk_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: memif_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: nat_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > udp_ping_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: lacp_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: mactime_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: ioam_pot_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > dpdk_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: ioam_trace_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: avf_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: stn_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > memif_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: map_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: lb_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: acl_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: ioam_export_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: flowprobe_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > lacp_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: gtpu_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: pppoe_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded > plugin: ioam_vxlan_gpe_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > mactime_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > ioam_pot_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > ioam_trace_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: map_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > ioam_export_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > flowprobe_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > gtpu_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > pppoe_test_plugin.so > /usr/bin/vpp[10192]: load_one_vat_plugin:67: Loaded plugin: > ioam_vxlan_gpe_test_plugin.so > vpp[10192]: /usr/bin/vpp[10192]: dpdk: Unsupported PCI device > 0x8086:0x19e2 found at PCI address 0000:01:00.0 > /usr/bin/vpp[10192]: dpdk: Unsupported PCI device 0x8086:0x19e2 found at PCI > address 0000:01:00.0 > vpp[10192]: /usr/bin/vpp[10192]: dpdk: EAL init args: -c c -n 4 --huge-dir > /run/vpp/hugepages --file-prefix vpp --master-lcore 2 --socket-mem 64 > /usr/bin/vpp[10192]: dpdk: EAL init args: -c c -n 4 --huge-dir > /run/vpp/hugepages --file-prefix vpp --master-lcore 2 --socket-mem 64 > vnet[10192]: dpdk_ipsec_process:1018: not enough DPDK crypto resources, > default to OpenSSL > systemd-udevd[10208]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > kernel: [ 2697.697594] lstack1: renamed from tap0 > systemd-udevd[10208]: link_config: could not set ethtool features for tap0 > systemd-udevd[10208]: Could not set offload features of tap0: > Operation not permitted > systemd-udevd[10208]: Could not generate persistent MAC address for > tap0: No such file or directory > kernel: [ 2697.731976] lstack2: renamed from tap0 > systemd-udevd[10212]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > systemd-udevd[10212]: link_config: could not get ethtool features for tap0 > systemd-udevd[10212]: Could not set offload features of tap0: No such device > kernel: [ 2697.754319] lstack3: renamed from tap0 > systemd-udevd[10212]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > systemd-udevd[10212]: link_config: could not get ethtool features for tap0 > systemd-udevd[10212]: Could not set offload features of tap0: No such device > kernel: [ 2697.778077] lstack4: renamed from tap0 > systemd-udevd[10212]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > systemd-udevd[10212]: link_config: could not get ethtool features for tap0 > systemd-udevd[10212]: Could not set offload features of tap0: No such device > kernel: [ 2697.802294] lstack5: renamed from tap0 > systemd-udevd[10212]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > systemd-udevd[10212]: link_config: could not get ethtool features for tap0 > systemd-udevd[10212]: Could not set offload features of tap0: No such device > kernel: [ 2697.825952] lstack6: renamed from tap0 > systemd-udevd[10212]: link_config: autonegotiation is unset or enabled, the > speed and duplex are not writable. > systemd-udevd[10212]: link_config: could not get ethtool features for tap0 > systemd-udevd[10212]: Could not set offload features of tap0: No such device > systemd[1]: Found device /sys/devices/virtual/net/lstack6. > vnet[10192]: acl_plugin: ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: > 100, clear_all: 0 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 0, pending clear bitmap: 100 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 4294967295, pending clear > bitmap: 100 > vnet[10192]: acl_plugin: CLEANER mains len: 2 per-worker len: 2 > vnet[10192]: acl_plugin: ACL_FA_NODE_CLEAN: cleaning done > vnet[10192]: acl_plugin: ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: > 800, clear_all: 0 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 0, pending clear bitmap: 800 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 4294967295, pending clear > bitmap: 800 > vnet[10192]: acl_plugin: CLEANER mains len: 2 per-worker len: 2 > vnet[10192]: acl_plugin: ACL_FA_NODE_CLEAN: cleaning done > vnet[10192]: acl_plugin: ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: > 4000, clear_all: 0 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 0, pending clear bitmap: 4000 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 4294967295, pending clear > bitmap: 4000 > vnet[10192]: acl_plugin: CLEANER mains len: 2 per-worker len: 2 > vnet[10192]: acl_plugin: ACL_FA_NODE_CLEAN: cleaning done > vnet[10192]: acl_plugin: ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: > 20000, clear_all: 0 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 0, pending clear bitmap: 20000 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 4294967295, pending clear > bitmap: 20000 > vnet[10192]: acl_plugin: CLEANER mains len: 2 per-worker len: 2 > vnet[10192]: acl_plugin: ACL_FA_NODE_CLEAN: cleaning done > vnet[10192]: acl_plugin: ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: > 8, clear_all: 0 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 0, pending clear bitmap: 8 > vnet[10192]: acl_plugin: ACL_FA_CLEANER: thread 4294967295, pending clear > bitmap: 8 > vnet[10192]: acl_plugin: CLEANER mains len: 2 per-worker len: 2 > vnet[10192]: acl_plugin: ACL_FA_NODE_CLEAN: cleaning done > bash[10248]: vac_disconnect:407: vac_disconnect cancel > bash[10248]: vl_client_disconnect:322: queue drain: 7 > bash[10248]: msg_handler_internal:432: no handler for msg id 7 > vnet[10192]: nat_user_get_or_create:323: 192.168.6.109 0 > vnet[10192]: nat_user_get_or_create:323: 192.168.0.2 0 > vnet[10192]: nat_user_get_or_create:323: 192.168.4.109 0 > vnet[10192]: received signal SIGSEGV, PC 0x7fa62aecade3, faulting address 0x0 > vnet[10192]: #0 0x00007fa62b7770fd 0x7fa62b7770fd > vnet[10192]: #1 0x00007fa62a5f9890 0x7fa62a5f9890 > vnet[10192]: #2 0x00007fa62aecade3 0x7fa62aecade3 > vnet[10192]: #3 0x00007fa62b73a4df 0x7fa62b73a4df > vnet[10192]: #4 0x00007fa62b73b08f vlib_worker_loop + 0x23f > vnet[10192]: #5 0x00007fa62a834034 0x7fa62a834034 > systemd[1]: vpp.service: Main process exited, code=killed, status=6/ABRT > systemd[1]: vpp.service: Failed with result 'signal'. > systemd[1]: vpp.service: Service hold-off time over, scheduling restart. > systemd[1]: vpp.service: Scheduled restart job, restart counter is at 2. > > > Thanks!
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#10305): https://lists.fd.io/g/vpp-dev/message/10305 Mute This Topic: https://lists.fd.io/mt/24923431/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-