os_out_of_memory() tells you you are lacking memory, try to increase the main heap size by adding a line "heapsize 4G" in your startup.conf.
ben > -----Original Message----- > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Soundarya > Rajan > Sent: vendredi 7 mai 2021 11:43 > To: vpp-dev@lists.fd.io > Subject: [vpp-dev] Regarding GTP tunnel scaling > > Hi All, > > I am trying to scale GTP tunnel creation to 50k in vpp v21.06, but getting > crash with below bt after 48k tunnel. > > > > > The commands used are : > > > > create gtpu tunnel src 10.43.67.108 dst 172.16.224.176 teid 49816 tteid > 50816 decap-next ip4 > set interface ip address gtpu_tunnel48816 3.224.176.3/24 > <http://3.224.176.3/24> > ip route add 192.168.224.176/32 <http://192.168.224.176/32> via > gtpu_tunnel48816 > > > > > > > > > #0 0x00007ffff51f33d7 in __GI_raise (sig=sig@entry=6) at > ../nptl/sysdeps/unix/sysv/linux/raise.c:55 > > #1 0x00007ffff51f4ac8 in __GI_abort () at abort.c:90 > > #2 0x00007ffff6032d4d in os_panic () at /home/UPF/vpp/src/vppinfra/unix- > misc.c:177 > > #3 0x00007ffff6032e90 in os_out_of_memory () at > /home/UPF/vpp/src/vppinfra/unix-misc.c:221 > > #4 0x00007ffff603bb5b in clib_mem_alloc_aligned_at_offset (size=2430228, > align=64, align_offset=8, os_out_of_memory_on_failure=1) > > at /home/UPF/vpp/src/vppinfra/mem.h:243 > > #5 0x00007ffff603bee8 in vec_resize_allocate_memory (v=0x7fffae100e80, > length_increment=1, data_bytes=1620168, header_bytes=8, data_align=64, > numa_id=255) > > at /home/UPF/vpp/src/vppinfra/vec.c:107 > > #6 0x00007ffff7e6d540 in _vec_resize_inline (v=0x7fffae100e80, > length_increment=1, data_bytes=1620160, header_bytes=0, data_align=64, > numa_id=255) > > at /home/UPF/vpp/src/vppinfra/vec.h:170 > > #7 0x00007ffff7e6e21a in vlib_validate_combined_counter > (cm=0x7ffff7d6a1a0 <load_balance_main>, index=101259) at > /home/UPF/vpp/src/vlib/counter.c:133 > > #8 0x00007ffff722f61d in load_balance_alloc_i () at > /home/UPF/vpp/src/vnet/dpo/load_balance.c:126 > > #9 0x00007ffff722fb54 in load_balance_create_i (num_buckets=0, > lb_proto=DPO_PROTO_IP4, > > fhc=(IP_FLOW_HASH_SRC_ADDR | IP_FLOW_HASH_DST_ADDR | > IP_FLOW_HASH_SRC_PORT | IP_FLOW_HASH_DST_PORT | IP_FLOW_HASH_PROTO | > IP_FLOW_HASH_FL)) > > at /home/UPF/vpp/src/vnet/dpo/load_balance.c:247 > > #10 0x00007ffff722fd37 in load_balance_create (n_buckets=0, > lb_proto=DPO_PROTO_IP4, > > fhc=(IP_FLOW_HASH_SRC_ADDR | IP_FLOW_HASH_DST_ADDR | > IP_FLOW_HASH_SRC_PORT | IP_FLOW_HASH_DST_PORT | IP_FLOW_HASH_PROTO | > IP_FLOW_HASH_FL)) > > at /home/UPF/vpp/src/vnet/dpo/load_balance.c:270 > > #11 0x00007ffff71b4f87 in fib_entry_src_mk_lb (fib_entry=0x7fffc4dcc380, > source=FIB_SOURCE_INTERFACE, fct=FIB_FORW_CHAIN_TYPE_UNICAST_IP4, > dpo_lb=0x7fffc4dcc3a8) > > at /home/UPF/vpp/src/vnet/fib/fib_entry_src.c:678 > > #12 0x00007ffff71b5154 in fib_entry_src_action_install > (fib_entry=0x7fffc4dcc380, source=FIB_SOURCE_INTERFACE) at > /home/UPF/vpp/src/vnet/fib/fib_entry_src.c:752 > > #13 0x00007ffff71b5c25 in fib_entry_src_action_activate > (fib_entry=0x7fffc4dcc380, source=FIB_SOURCE_INTERFACE) at > /home/UPF/vpp/src/vnet/fib/fib_entry_src.c:1125 > > #14 0x00007ffff71ab8e5 in fib_entry_create (fib_index=0, > prefix=0x7fffa6aa8080, source=FIB_SOURCE_INTERFACE, > > flags=(FIB_ENTRY_FLAG_CONNECTED | FIB_ENTRY_FLAG_ATTACHED), > paths=0x7fffbecf0a10) at /home/UPF/vpp/src/vnet/fib/fib_entry.c:746 > > #15 0x00007ffff71929bd in fib_table_entry_update (fib_index=0, > prefix=0x7fffa6aa8080, source=FIB_SOURCE_INTERFACE, > > flags=(FIB_ENTRY_FLAG_CONNECTED | FIB_ENTRY_FLAG_ATTACHED), > paths=0x7fffbecf0a10) at /home/UPF/vpp/src/vnet/fib/fib_table.c:790 > > #16 0x00007ffff7192c67 in fib_table_entry_update_one_path (fib_index=0, > prefix=0x7fffa6aa8080, source=FIB_SOURCE_INTERFACE, > > flags=(FIB_ENTRY_FLAG_CONNECTED | FIB_ENTRY_FLAG_ATTACHED), > next_hop_proto=DPO_PROTO_IP4, next_hop=0x0, next_hop_sw_if_index=16876, > > next_hop_fib_index=4294967295, next_hop_weight=1, next_hop_labels=0x0, > path_flags=FIB_ROUTE_PATH_FLAG_NONE) at > /home/UPF/vpp/src/vnet/fib/fib_table.c:841 > > #17 0x00007ffff6c3755b in ip4_add_interface_prefix_routes > (im=0x7ffff7db9d40 <ip4_main>, sw_if_index=16876, fib_index=0, > a=0x7fffc1e9b4a4) > > at /home/UPF/vpp/src/vnet/ip/ip4_forward.c:387 > > #18 0x00007ffff6c3773c in ip4_add_interface_routes (sw_if_index=16876, > im=0x7ffff7db9d40 <ip4_main>, fib_index=0, a=0x7fffc1e9b4a4) > > at /home/UPF/vpp/src/vnet/ip/ip4_forward.c:460 > > #19 0x00007ffff6c38f64 in ip4_add_del_interface_address_internal > (vm=0x7fffb3a82680, sw_if_index=16876, address=0x7fffa6aa8300, > address_length=24, is_del=0) > > ---Type <return> to continue, or q <return> to quit--- > > at /home/UPF/vpp/src/vnet/ip/ip4_forward.c:816 > > #20 0x00007ffff6c39098 in ip4_add_del_interface_address > (vm=0x7fffb3a82680, sw_if_index=16876, address=0x7fffa6aa8300, > address_length=24, is_del=0) > > at /home/UPF/vpp/src/vnet/ip/ip4_forward.c:838 > > #21 0x00007ffff6c21e42 in add_del_ip_address (vm=0x7fffb3a82680, > input=0x7fffa6aa8b00, cmd=0x7fffb54cce58) at > /home/UPF/vpp/src/vnet/ip/ip46_cli.c:171 > > #22 0x00007ffff7e67777 in vlib_cli_dispatch_sub_commands > (vm=0x7fffb3a82680, cm=0x7ffff7f7fea0 <vlib_global_main+32>, > input=0x7fffa6aa8b00, > > parent_command_index=480) at /home/UPF/vpp/src/vlib/cli.c:591 > > #23 0x00007ffff7e67502 in vlib_cli_dispatch_sub_commands > (vm=0x7fffb3a82680, cm=0x7ffff7f7fea0 <vlib_global_main+32>, > input=0x7fffa6aa8b00, > > parent_command_index=104) at /home/UPF/vpp/src/vlib/cli.c:548 > > #24 0x00007ffff7e67502 in vlib_cli_dispatch_sub_commands > (vm=0x7fffb3a82680, cm=0x7ffff7f7fea0 <vlib_global_main+32>, > input=0x7fffa6aa8b00, > > parent_command_index=21) at /home/UPF/vpp/src/vlib/cli.c:548 > > #25 0x00007ffff7e67502 in vlib_cli_dispatch_sub_commands > (vm=0x7fffb3a82680, cm=0x7ffff7f7fea0 <vlib_global_main+32>, > input=0x7fffa6aa8b00, parent_command_index=0) > > at /home/UPF/vpp/src/vlib/cli.c:548 > > #26 0x00007ffff7e67ca2 in vlib_cli_input (vm=0x7fffb3a82680, > input=0x7fffa6aa8b00, function=0x0, function_arg=0) at > /home/UPF/vpp/src/vlib/cli.c:694 > > #27 0x00007ffff7f162d5 in unix_cli_exec (vm=0x7fffb3a82680, > input=0x7fffa6aa8ef0, cmd=0x7fffb54d0e88) at > /home/UPF/vpp/src/vlib/unix/cli.c:3438 > > #28 0x00007ffff7e67777 in vlib_cli_dispatch_sub_commands > (vm=0x7fffb3a82680, cm=0x7ffff7f7fea0 <vlib_global_main+32>, > input=0x7fffa6aa8ef0, parent_command_index=0) > > at /home/UPF/vpp/src/vlib/cli.c:591 > > #29 0x00007ffff7e67ca2 in vlib_cli_input (vm=0x7fffb3a82680, > input=0x7fffa6aa8ef0, function=0x7ffff7f0af4b <unix_vlib_cli_output>, > function_arg=0) > > at /home/UPF/vpp/src/vlib/cli.c:694 > > #30 0x00007ffff7f1224d in unix_cli_process_input (cm=0x7ffff7f802c0 > <unix_cli_main>, cli_file_index=0) at > /home/UPF/vpp/src/vlib/unix/cli.c:2613 > > #31 0x00007ffff7f12fe7 in unix_cli_process (vm=0x7fffb3a82680, > rt=0x7fffb7c87180, f=0x0) at /home/UPF/vpp/src/vlib/unix/cli.c:2731 > > #32 0x00007ffff7eaff85 in vlib_process_bootstrap (_a=140736127497952) at > /home/UPF/vpp/src/vlib/main.c:1299 > > #33 0x00007ffff5fb4b90 in clib_calljmp () at > /home/UPF/vpp/src/vppinfra/longjmp.S:123 > > #34 0x00007fffaee2f6b0 in ?? () > > #35 0x00007ffff7eb00ae in vlib_process_startup (vm=0x7fffb8601728, > p=0x7fffb3a823b8, f=0x7ffff5f76274 <mspace_usable_size_with_delta+60>) > > at /home/UPF/vpp/src/vlib/main.c:1324 > > #36 0x00007fffb8601728 in ?? () > > #37 0x00007fffaee2f730 in ?? () > > #38 0x00007fffb8423ce0 in ?? () > > #39 0x00007ffff7f05d54 in vec_header_bytes (header_bytes=140736284736720) > at /home/UPF/vpp/src/vppinfra/vec_bootstrap.h:81 > > #40 0x00007ffff5f76274 in mspace_usable_size_with_delta (p=0x7fffb8423ce8) > at /home/UPF/vpp/src/vppinfra/dlmalloc.c:4333 > > #41 0x00007ffff7f05c14 in clib_mem_size_nocheck (p=0x7fffb8423ce8) at > /home/UPF/vpp/src/vppinfra/mem.h:217 > > #42 0x00007ffff7f05d31 in clib_mem_size (p=0x7fffb8423ce8) at > /home/UPF/vpp/src/vppinfra/mem.h:346 > > #43 0x00007ffff7f05ee1 in _vec_resize_inline (v=0x7fffb8423cf0, > length_increment=1, data_bytes=4, header_bytes=0, data_align=4, > numa_id=255) > > at /home/UPF/vpp/src/vppinfra/vec.h:157 > > ---Type <return> to continue, or q <return> to quit--- > > #44 0x00007ffff7f08b65 in vlib_process_signal_event_helper > (nm=0x7fffb3a827f0, n=0x7fffb8596100, p=0x7fffb7c87180, t=0, > n_data_elts=1, n_data_elt_bytes=8) > > at /home/UPF/vpp/src/vlib/node_funcs.h:903 > > #45 0x0000000000000010 in ?? () > > #46 0x00007fffaee2f958 in ?? () > > #47 0x00007ffff60154f6 in vec_aligned_header (v=<error reading variable: > Cannot access memory at address 0x6>, > > header_bytes=<error reading variable: Cannot access memory at address > 0xfffffffffffffffe>, > > align=<error reading variable: Cannot access memory at address > 0xfffffffffffffff6>) at /home/UPF/vpp/src/vppinfra/vec_bootstrap.h:118 > > Backtrace stopped: previous frame inner to this frame (corrupt stack?) > > > > Please help with the same. > > > > Thanks, > > Soundarya
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19359): https://lists.fd.io/g/vpp-dev/message/19359 Mute This Topic: https://lists.fd.io/mt/82651244/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
