hi, llya and Michael
1. The stack trace can be found in attachment, the position of the crash is not
fixed, is random.
2. For packets that have been successfully reassembled and have not timed out,
they will exist in the frag_complete_list and can be added to the batch；For
packets that have not yet been successfully reassembled, as long as the timeout
does not exceed IPF-FRAG-LIST-TIMEOUT+IPF-FRAG-LIST-PURGE-TIME-ADJ, all
fragments of the packet can still be added to the batch once the reassembly is
successful.
As follow is the crash reproduction method，It is occasional, but the
probability is relatively high.
netperf performance test command：
client：
#!/bin/bash
server_ip=192.168.1.3
for j in `seq 64`; do
port=$[16000+j]
netperf -H ${server_ip} -l ${1:-300} -t UDP_STREAM -p $port > /dev/null
2>&1 &
done
server：
#!/bin/bash
for j in `seq 64`; do
netserver -p $[16000+j] > server_$[16000+j].netperf > /dev/null 2>&1 &
done
--
它山之石，可以攻玉。
At 2024-05-28 23:16:46, "Ilya Maximets" <i.maxim...@ovn.org> wrote:
>On 5/23/24 09:40, laixiangwu wrote:
>> Description:
>>
>> when 1) The fragment timeout is between 15 seconds and 25 seconds; 2)
>> The ipf_list currently has received more than 32 fragments, and there
>> are other fragments of same big packet that have not been received.
>>
>> When the above two scenario conditions are met, due to exceeding the
>> capacity of the packet batch(here is 32), ipf_dp_packet_batch_add
>> returns false, and ipf_list will not be cleared. However, the 32
>> fragments packets added to the packet batch will be processed normally.
>> When receiving the subsequent fragments of the ipf_list, because the
>> first 32 fragments have been processed, when processing subsequent
>> fragment packets, relevant information about the processed fragment
>> packets will be read，therefore will occur carsh.
>> One solution is do not forward timeout fragment packets from the above
>> scenarios, that is, do not add them to the packet batch, and handle
>> other scenarios according to the original logic.
>> Signed-off-by: laixiangwu <15310488...@163.com>
>> ---
>> lib/ipf.c | 10 ++++------
>> 1 file changed, 4 insertions(+), 6 deletions(-)
>
>Hi, laixiangwu. This version of the patch looks the same as the
>previous one here:
>
> https://patchwork.ozlabs.org/project/openvswitch/patch/20240522021957.2292-1-15310488...@163.com/
>
>And I see Mike asked a few questions for the approach there.
>Could you, please, answer those?
>
>For now, I'll mark this patch with 'Changes Requested'.
>
>If you plan to send a new version based on Mike's comments, please, add
>'v6' to the subject prefix, i.e. [PATCH v6], since it's technically a
>6th version of it.
>
>Best regards, Ilya Maximets.
Thread 22 (Thread 0x7f03f504b000 (LWP 36639)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x000000000262cd40 in ?? ()
No symbol table info available.
#2 0x0000000002444940 in ?? ()
No symbol table info available.
#3 0x00007ffcf35bacd8 in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 21 (Thread 0x7f03cf7c0700 (LWP 36661)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03b00240d0 in ?? ()
No symbol table info available.
#2 0x00007f03b0000a60 in ?? ()
No symbol table info available.
#3 0x0000000002582e10 in ?? ()
No symbol table info available.
#4 0x0000000000801001 in ?? ()
No symbol table info available.
#5 0x000000000000000a in ?? ()
No symbol table info available.
#6 0x000000023aeace9d in ?? ()
No symbol table info available.
#7 0x00007f03e510333c in poll_block () at lib/poll-loop.c:364
loop = 0x20
node = 0x0
pollfds = 0x7f03b0000020
elapsed = 0
retval = <optimized out>
i = <optimized out>
#8 0x00007f03e56bc3c7 in udpif_revalidator (arg=0x2582e10) at
ofproto/ofproto-dpif-upcall.c:960
flow_limit = <optimized out>
duration = <optimized out>
revalidator = 0x2582e10
udpif = 0x2487430
leader = true
start_time = 9578401437
---Type <return> to continue, or q <return> to quit---
last_reval_seq = <optimized out>
n_flows = 10
#9 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e56bc200 <udpif_revalidator>, arg = 0x2582e10,
name = "revalidator\000\000\000\000"}
id = 7
subprogram_name = 0x7f03b00008c0 ""
#10 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#11 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#12 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 20 (Thread 0x7f03de898700 (LWP 36657)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03c40008c0 in ?? ()
No symbol table info available.
#2 0x00007f03c4000970 in ?? ()
No symbol table info available.
#3 0x00007f03d7fc2da0 in ?? ()
No symbol table info available.
#4 0x00007f03d7febdd0 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 19 (Thread 0x7f03de097700 (LWP 36658)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03c00008c0 in ?? ()
No symbol table info available.
#2 0x00007f03c0000970 in ?? ()
No symbol table info available.
#3 0x00000000024863c8 in ?? ()
No symbol table info available.
#4 0x0000000002486350 in ?? ()
No symbol table info available.
#5 0x00000000024863a8 in ?? ()
No symbol table info available.
#6 0x00000000024863b8 in ?? ()
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#7 0x00007f03e510333c in poll_block () at lib/poll-loop.c:364
loop = 0x10
node = 0x0
pollfds = 0x7f03c0000020
elapsed = 2
retval = <optimized out>
i = <optimized out>
#8 0x00007f03e50766b3 in ipf_clean_thread_main (f=0x2486350) at lib/ipf.c:1288
now = 9578401562
ipf = 0x2486350
#9 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e5076560 <ipf_clean_thread_main>, arg = 0x2486350,
name = "ipf_clean\000\000\000\000\000\000"}
id = 3
subprogram_name = 0x7f03c00008c0 "\t"
#10 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#11 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#12 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 18 (Thread 0x7f03f509e300 (LWP 5311)):
#0 0x00007f03e441dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f03e420c86c in handle_fildes_io () from /lib64/librt.so.1
No symbol table info available.
#2 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 17 (Thread 0x7f03cefbf700 (LWP 36662)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03b40008c0 in ?? ()
No symbol table info available.
#2 0x00007f03b40009f0 in ?? ()
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#3 0x0000000002582e28 in ?? ()
No symbol table info available.
#4 0x0000000000801000 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 16 (Thread 0x7f03cffc1700 (LWP 36660)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03bc0008c0 in ?? ()
No symbol table info available.
#2 0x00007f03bc000970 in ?? ()
No symbol table info available.
#3 0x0000000002487430 in ?? ()
No symbol table info available.
#4 0x0000000002487470 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 15 (Thread 0x7f03dcfcd700 (LWP 36659)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03b80008c0 in ?? ()
No symbol table info available.
#2 0x00007f03b8000970 in ?? ()
No symbol table info available.
#3 0x0000000002487430 in ?? ()
No symbol table info available.
#4 0x0000000002487470 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 14 (Thread 0x7f03df099700 (LWP 36656)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03c80192a0 in ?? ()
No symbol table info available.
#2 0x00007f03c80009f0 in ?? ()
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#3 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 13 (Thread 0x7f03df89a700 (LWP 36653)):
#0 0x00007f03e36bde2d in sleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03e544b370 in dpdk_mp_mutex () from
/usr/lib64/libopenvswitch-2.10.so.0.0.1
No symbol table info available.
#2 0x0000000000801000 in ?? ()
No symbol table info available.
#3 0x00007f03e51245ff in xsleep (seconds=1341147520) at lib/util.c:2264
No locals.
#4 0x00007f03e5151776 in dpdk_watchdog (dummy=<optimized out>) at
lib/netdev-dpdk.c:1008
dev = 0x7f03e544a298 <rl.23363+24>
#5 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e51516d0 <dpdk_watchdog>, arg = 0x0, name =
"dpdk_watchdog\000\000"}
id = 1
subprogram_name = 0x7f03d80008c0 ""
#6 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#7 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#8 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 12 (Thread 0x7f03e009b700 (LWP 36641)):
#0 0x00007f03e4420b4d in recvmsg () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f03f2731e66 in read_msg (s=0x7f03e0098fd0, m=0x7f03e00991b0) at
/usr/src/debug/dpdk-18.11/lib/librte_eal/common/eal_common_proc.c:267
msglen = <optimized out>
control = '\000' <repeats 47 times>
cmsg = <optimized out>
iov = {iov_base = 0x7f03e00991b0, iov_len = 332}
msgh = {msg_name = 0x7f03e0098fd0, msg_namelen = 110, msg_iov =
0x7f03e0098f90, msg_iovlen = 1, msg_control = 0x7f03e0098fa0, msg_controllen =
48, msg_flags = 0}
#2 mp_handle (arg=<optimized out>) at
/usr/src/debug/dpdk-18.11/lib/librte_eal/common/eal_common_proc.c:360
msg = {type = 0, msg = {name = '\000' <repeats 63 times>, len_param =
0, num_fds = 0,
param = '\000' <repeats 148 times>,
"\260\313H\002\000\000\000\000й\t\340\003\177\000\000\246\345A\344\003\177",
'\000' <repeats 82 times>..., fds = {0, 38325168, 0,
-227336816, 32515, 0, 0, 0}}}
sa = {sun_family = 0, sun_path = '\000' <repeats 107 times>}
#3 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#4 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 11 (Thread 0x7f03a9342700 (LWP 36677)):
#0 0x00007f03e36ec20d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03a9342700 in ?? ()
No symbol table info available.
#2 0x00007f03a9342700 in ?? ()
No symbol table info available.
#3 0xef2371f2c57b659e in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 10 (Thread 0x7f03a9b43700 (LWP 36676)):
#0 0x00007f03e36bde2d in sleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 9 (Thread 0x7f03e089c700 (LWP 36640)):
#0 0x00007f03e36f7483 in ?? () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 8 (Thread 0x7f03aa344700 (LWP 36675)):
#0 rte_rdtsc () at /usr/include/dpdk/rte_cycles.h:49
No locals.
#1 rte_get_tsc_cycles () at /usr/include/dpdk/rte_cycles.h:60
No locals.
#2 cycles_counter_update (s=0x7f03aabf5210) at lib/dpif-netdev-perf.h:201
No locals.
#3 pmd_perf_end_iteration (s=s@entry=0x7f03aabf5210,
rx_packets=rx_packets@entry=0, tx_packets=tx_packets@entry=0,
full_metrics=false) at lib/dpif-netdev-perf.c:475
cycles = <optimized out>
cycles_per_pkt = <optimized out>
reason = <optimized out>
#4 0x00007f03e50635a3 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5980
rx_packets = <optimized out>
---Type <return> to continue, or q <return> to quit---
tx_packets = <optimized out>
pmd = <optimized out>
s = <optimized out>
lc = 300
poll_list = 0x7f037c004a10
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#5 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03aa345010,
name = "pmd", '\000' <repeats 12 times>}
id = 15
subprogram_name = 0x7f037c0008c0 "\320r"
#6 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#7 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#8 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 7 (Thread 0x7f03ac4d8700 (LWP 36673)):
#0 rte_prefetch0 (p=0x22501dc3d0) at
/usr/src/debug/dpdk-18.11/x86_64-default-linuxapp-gcc/include/rte_prefetch.h:17
No locals.
#1 _recv_raw_pkts_vec (split_packet=0x7f03ac4d5f80 "", nb_pkts=32,
rx_pkts=0x7f03ac4d60e0, rxq=0x22501ea280) at
/usr/src/debug/dpdk-18.11/drivers/net/ixgbe/ixgbe_rxtx_vec_sse.c:358
rxdp = 0x22501dc3d0
pos = <optimized out>
sw_ring = <optimized out>
nb_pkts_recd = <optimized out>
use_ipsec = <error reading variable use_ipsec (Cannot access memory at
address 0x22501ea2dd)>
var = <optimized out>
vlan_flags = <optimized out>
#2 ixgbe_recv_scattered_pkts_vec (rx_queue=0x22501ea280,
rx_pkts=0x7f03ac4d60e0, nb_pkts=<optimized out>) at
/usr/src/debug/dpdk-18.11/drivers/net/ixgbe/ixgbe_rxtx_vec_sse.c:592
rxq = 0x22501ea280
split_flags = '\000' <repeats 31 times>
split_fl64 = <optimized out>
i = <optimized out>
#3 0x00007f03e5156dbc in rte_eth_rx_burst (nb_pkts=32, rx_pkts=0x7f03ac4d60e0,
queue_id=0, port_id=<optimized out>) at /usr/include/dpdk/rte_ethdev.h:3879
dev = 0x7f03f24883c0 <rte_eth_devices+16512>
nb_rx = <optimized out>
#4 netdev_dpdk_rxq_recv (rxq=0x224ff060c0, batch=0x7f03ac4d60d0, qfill=0x0) at
lib/netdev-dpdk.c:2975
policer = 0x0
---Type <return> to continue, or q <return> to quit---
nb_rx = <optimized out>
dropped = 0
#5 0x00007f03e5095716 in netdev_rxq_recv (rx=<optimized out>,
batch=batch@entry=0x7f03ac4d60d0, qfill=<optimized out>) at lib/netdev.c:714
retval = <optimized out>
#6 0x00007f03e5062e97 in dp_netdev_process_rxq_port
(pmd=pmd@entry=0x7f03ac4d9010, rxq=0x24977e0, port_no=4) at
lib/dpif-netdev.c:4673
s = 0x7f03acd89210
batch = {count = 0, trunc = false, packets = {0x225059d940,
0x2255c37a00, 0x2255c36e40, 0x225059cd80, 0x0, 0x0, 0x770000006e, 0x0,
0x7f03ac4d614f, 0x7f03880233f0,
0x6430382d00000000, 0x7f0388016880, 0x7f03e5453500
<monotonic_clock>, 0x0, 0x7f03ac4d61d0, 0x7f03e370cc6d <__get_clockfreq+253>,
0x7f03e5446ee0 <seq_mutex>,
0x7f03e511aa79 <xclock_gettime+9>, 0x7f03e5453500
<monotonic_clock>, 0x0, 0x7f03ac4d6200, 0x7f03e370cc6d <__get_clockfreq+253>,
0x7f03880076d0,
0x7f03e511aa79 <xclock_gettime+9>, 0x48, 0x7f03e511ab5b
<time_timespec__+187>, 0x0, 0x48, 0x7f03e5446ee0 <seq_mutex>, 0x4f, 0x48, 0x0}}
timer = {start = 31919442047803188, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#7 0x00007f03e5063363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 80
poll_list = 0x7f03880049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#8 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03ac4d9010,
name = "pmd", '\000' <repeats 12 times>}
id = 14
subprogram_name = 0x7f03880008c0 ""
#9 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#10 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#11 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 6 (Thread 0x7f03ab40e700 (LWP 36674)):
#0 0x00007f03e5062ff0 in rte_rdtsc () at /usr/include/dpdk/rte_cycles.h:46
No locals.
#1 rte_get_tsc_cycles () at /usr/include/dpdk/rte_cycles.h:60
---Type <return> to continue, or q <return> to quit---
No locals.
#2 cycles_counter_update (s=0x7f03abcbf210) at lib/dpif-netdev-perf.h:201
No locals.
#3 cycle_timer_stop (timer=0x7f03ab40c0b0, s=0x7f03abcbf210) at
lib/dpif-netdev-perf.h:258
intr_timer = <optimized out>
#4 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f03ab40f010, rxq=0x25b5768,
port_no=5) at lib/dpif-netdev.c:4701
s = 0x7f03abcbf210
batch = {count = 0, trunc = false, packets = {0x22545be880,
0x22545bf440, 0x22545c0000, 0x22545c0bc0, 0x0, 0x0, 0x770000006e, 0x0,
0x7f03ab40c14f,
0x7f03e3631fe8 <qsort_r+504>, 0x6970204f00000000, 0x7f038000ee90,
0x7f03e5453500 <monotonic_clock>, 0x0, 0x7f03ab40c1d0, 0x7f03e370cc6d
<__get_clockfreq+253>,
0x7f03e5446ee0 <seq_mutex>, 0x7f03e511aa79 <xclock_gettime+9>,
0x7f03e5453500 <monotonic_clock>, 0x0, 0x7f03ab40c200, 0x7f03e370cc6d
<__get_clockfreq+253>, 0x7f038000ba10,
0x7f03e511aa79 <xclock_gettime+9>, 0x48, 0x7f03e511ab5b
<time_timespec__+187>, 0x0, 0x48, 0x7f03e5446ee0 <seq_mutex>, 0x3f4, 0x48, 0x0}}
timer = {start = 31919442047804084, suspended = 0, interrupted = 0x0}
error = 11
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#5 0x00007f03e5063363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 1013
poll_list = 0x7f03800049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#6 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03ab40f010,
name = "pmd", '\000' <repeats 12 times>}
id = 16
subprogram_name = 0x7f03800008c0 "\f"
#7 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#8 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#9 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 5 (Thread 0x7f03cdef5700 (LWP 36667)):
#0 0x00007ffcf35d9b08 in clock_gettime ()
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#1 0x00007f03e370cc6d in __get_clockfreq () from /lib64/libc.so.6
No symbol table info available.
#2 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 4 (Thread 0x7f03ae66c700 (LWP 36671)):
#0 0x00007f03e5067b01 in pmd_perf_start_iteration (s=s@entry=0x7f03aef1d210)
at lib/dpif-netdev-perf.c:459
No locals.
#1 0x00007f03e50632fa in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5925
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 731
poll_list = 0x7f038c0049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#2 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03ae66d010,
name = "pmd", '\000' <repeats 12 times>}
id = 12
subprogram_name = 0x7f038c0008c0 "\004"
#3 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 3 (Thread 0x7f03ad5a2700 (LWP 36672)):
#0 rte_rdtsc () at /usr/include/dpdk/rte_cycles.h:49
No locals.
#1 rte_get_tsc_cycles () at /usr/include/dpdk/rte_cycles.h:60
No locals.
#2 cycles_counter_update (s=0x7f03ade53210) at lib/dpif-netdev-perf.h:201
No locals.
#3 cycle_timer_start (timer=0x7f03ad5a00b0, s=0x7f03ade53210) at
lib/dpif-netdev-perf.h:241
cur_timer = 0x0
#4 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f03ad5a3010, rxq=0x25b5638,
port_no=5) at lib/dpif-netdev.c:4663
s = 0x7f03ade53210
---Type <return> to continue, or q <return> to quit---
batch = {count = 0, trunc = false, packets = {0x22527e55c0,
0x22527e6180, 0x22527e6d40, 0x22527e7900, 0x0, 0x0, 0x770000006e, 0x0,
0x7f03ad5a014f, 0x7f0384011fc0,
0x20295d3100000002, 0x7f0384007c70, 0x7f03e5453500
<monotonic_clock>, 0x0, 0x7f03ad5a01d0, 0x7f03e370cc6d <__get_clockfreq+253>,
0x7f03e5446ee0 <seq_mutex>,
0x7f03e511aa79 <xclock_gettime+9>, 0x7f03e5453500
<monotonic_clock>, 0x0, 0x7f03ad5a0200, 0x7f03e370cc6d <__get_clockfreq+253>,
0x7f038400e350,
0x7f03e511aa79 <xclock_gettime+9>, 0x48, 0x7f03e511ab5b
<time_timespec__+187>, 0x0, 0x48, 0x7f03e5446ee0 <seq_mutex>, 0x128, 0x48, 0x0}}
timer = {start = 31919442047802112, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = 0x0
#5 0x00007f03e5063363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 297
poll_list = 0x7f03840049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#6 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03ad5a3010,
name = "pmd", '\000' <repeats 12 times>}
id = 13
subprogram_name = 0x7f03840008c0 "\320n"
#7 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#8 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#9 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 2 (Thread 0x7f03af736700 (LWP 36669)):
#0 cycle_timer_stop (timer=0x7f03af7340b0, s=0x7f03affe7210) at
lib/dpif-netdev-perf.h:261
intr_timer = 0x0
#1 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f03af737010, rxq=0x25b56d0,
port_no=5) at lib/dpif-netdev.c:4701
s = 0x7f03affe7210
batch = {count = 0, trunc = false, packets = {0x22521a2380,
0x22521a2f40, 0x22521a3b00, 0x22521a46c0, 0x4, 0x0, 0x5b00000034,
0x7f03af734170, 0x0, 0x0, 0x770000006e, 0x0,
0x7f03e5453500 <monotonic_clock>, 0x0, 0x7f03af7341d0,
0x7f03e370cc6d <__get_clockfreq+253>, 0x7f03e5446ee0 <seq_mutex>,
0x7f03e511aa79 <xclock_gettime+9>,
0x7f03e5453500 <monotonic_clock>, 0x0, 0x7f03af734200,
0x7f03e370cc6d <__get_clockfreq+253>, 0x7f039c008380, 0x7f03e511aa79
<xclock_gettime+9>, 0x48,
0x7f03e511ab5b <time_timespec__+187>, 0x0, 0x48, 0x7f03e5446ee0
<seq_mutex>, 0x227, 0x48, 0x0}}
timer = {start = 31919442047800420, suspended = 0, interrupted = 0x0}
---Type <return> to continue, or q <return> to quit---
error = 11
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#2 0x00007f03e5063363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 552
poll_list = 0x7f039c0049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#3 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03af737010,
name = "pmd", '\000' <repeats 12 times>}
id = 10
subprogram_name = 0x7f039c0008c0 "\004"
#4 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#6 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 1 (Thread 0x7f03cce2b700 (LWP 36668)):
#0 0x00007f03e362f207 in _longjmp_unwind () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f03e36308f8 in abort () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007f03e3671d27 in __libc_message () from /lib64/libc.so.6
No symbol table info available.
#3 0x00007f03e367a489 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#4 0x00007f03e509e99d in dp_packet_delete (b=0x7f03a40880b0) at
lib/dp-packet.h:180
No locals.
#5 dp_packet_delete_batch (should_steal=true, batch=0x7f03cce15ba0) at
lib/dp-packet.h:863
i = 0
packet = 0x7f03a40880b0
#6 odp_execute_actions (dp=dp@entry=0x7f03cce15b10,
batch=batch@entry=0x7f03cce15ba0, steal=steal@entry=true, actions=<optimized
out>, actions_len=<optimized out>,
---Type <return> to continue, or q <return> to quit---
dp_execute_action=dp_execute_action@entry=0x7f03e50643f0 <dp_execute_cb>)
at lib/odp-execute.c:947
packet = <optimized out>
a = <optimized out>
left = 0
#7 0x00007f03e50619d3 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f03cce160b0, should_steal=true,
packets=0x7f03cce15ba0,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f03cce2c010, flow = 0x7f03cce160b0}
#8 handle_packet_upcall (put_actions=0x7f03cce15b60, actions=0x7f03cce15b20,
key=0x7f03cce17d80, packet=<optimized out>, pmd=0x7f03cce2c010) at
lib/dpif-netdev.c:7015
add_actions = <optimized out>
match = {flow = {tunnel = {ip_dst = 1360596490, ipv6_dst = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}, ip_src = 1377373706, ipv6_src = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0, 0}}},
tun_id = 11191445074015682560, flags = 8, ip_tos = 0 '\000',
ip_ttl = 64 '@', tp_src = 16827, tp_dst = 46354, gbp_id = 0, gbp_flags = 0
'\000', erspan_ver = 0 '\000',
erspan_idx = 0, erspan_dir = 0 '\000', erspan_hwid = 0 '\000',
pad1 = "\000\000\000\000\000", metadata = {present = {map = 0, len = 0 '\000'},
tab = 0x0, opts = {
u8 = '\000' <repeats 255 times>, gnv = {{opt_class = 0, type
= 0 '\000', length = 0 '\000', r3 = 0 '\000', r2 = 0 '\000', r1 = 0 '\000'}
<repeats 63 times>}}}},
metadata = 0, regs = {0 <repeats 16 times>}, skb_priority = 0,
pkt_mark = 0, dp_hash = 0, in_port = {odp_port = 2, ofp_port = 2}, recirc_id =
532, ct_state = 16 '\020',
ct_nw_proto = 0 '\000', ct_zone = 0, ct_mark = 0, packet_type = 0,
ct_label = {u32 = {0, 0, 0, 0}, u64 = {lo = 0, hi = 0}}, conj_id = 0,
actset_output = 0, dl_dst = {{
ea = "\020\017\004\244\003\177", be16 = {3856, 41988, 32515}}},
dl_src = {{ea = "\000\000x\000\000\244", be16 = {0, 120, 41984}}}, dl_type =
65285, pad1 = "\000",
vlans = {{qtag = 0, {tpid = 0, tci = 0}}, {qtag = 0, {tpid = 0, tci
= 0}}}, mpls_lse = {0, 0, 0, 0}, nw_src = 0, nw_dst = 0, ct_nw_src = 0,
ct_nw_dst = 0, ipv6_src = {
__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 =
{0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ipv6_dst = {__in6_u = {
__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0,
0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ct_ipv6_src = {__in6_u = {
__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0,
0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ct_ipv6_dst = {__in6_u = {
__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0,
0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ipv6_label = 0, nw_frag = 0
'\000', nw_tos = 0 '\000',
nw_ttl = 0 '\000', nw_proto = 0 '\000', nd_target = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}, arp_sha = {{ea = "\000\000\000\000\000", be16 = {0, 0,
0}}}, arp_tha = {{ea = "\000\000\000\000\000", be16 = {0, 0, 0}}}, tcp_flags =
0, pad2 = 0, nsh = {
flags = 0 '\000', ttl = 0 '\000', mdtype = 0 '\000', np = 0
'\000', path_hdr = 0, context = {0, 0, 0, 0}}, tp_src = 0, tp_dst = 0,
ct_tp_src = 0, ct_tp_dst = 0,
igmp_group_ip4 = 0, pad3 = 0}, wc = {masks = {tunnel = {ip_dst =
4294967295, ipv6_dst = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0,
0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip_src =
4294967295, ipv6_src = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0, 0}}}, tun_id =
18446744073709551615, flags = 14, ip_tos = 255 '\377', ip_ttl = 0 '\000',
tp_src = 0, tp_dst = 0, gbp_id = 0,
gbp_flags = 0 '\000', erspan_ver = 0 '\000', erspan_idx = 0,
erspan_dir = 0 '\000', erspan_hwid = 0 '\000', pad1 = "\000\000\000\000\000",
metadata = {present = {
map = 0, len = 0 '\000'}, tab = 0x0, opts = {u8 = '\000'
<repeats 255 times>, gnv = {{opt_class = 0, type = 0 '\000', length = 0 '\000',
r3 = 0 '\000',
r2 = 0 '\000', r1 = 0 '\000'} <repeats 63 times>}}}},
metadata = 0, regs = {0 <repeats 16 times>}, skb_priority = 0, pkt_mark = 0,
dp_hash = 0, in_port = {
odp_port = 4294967295, ofp_port = 4294967295}, recirc_id =
4294967295, ct_state = 16 '\020', ct_nw_proto = 0 '\000', ct_zone = 0, ct_mark
= 0,
packet_type = 4294967295, ct_label = {u32 = {0, 0, 0, 0}, u64 =
{lo = 0, hi = 0}}, conj_id = 0, actset_output = 0, dl_dst = {{ea =
"\000\000\000\000\000", be16 = {0, 0,
0}}}, dl_src = {{ea = "\000\000\000\000\000", be16 = {0, 0,
0}}}, dl_type = 65535, pad1 = "\000", vlans = {{qtag = 4294901760, {tpid = 0,
tci = 65535}}, {qtag = 0,
{tpid = 0, tci = 0}}}, mpls_lse = {0, 0, 0, 0}, nw_src = 0,
nw_dst = 0, ct_nw_src = 0, ct_nw_dst = 0, ipv6_src = {__in6_u = {__u6_addr8 =
'\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0,
0, 0}}}, ipv6_dst = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0,
0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ct_ipv6_src = {__in6_u
= {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0,
0, 0}}}, ct_ipv6_dst = {__in6_u = {__u6_addr8 = '\000'
<repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
0, 0, 0}}}, ipv6_label = 0,
nw_frag = 0 '\000', nw_tos = 0 '\000', nw_ttl = 0 '\000',
nw_proto = 0 '\000', nd_target = {__in6_u = {__u6_addr8 = '\000' <repeats 15
times>, __u6_addr16 = {0, 0, 0, 0,
0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, arp_sha = {{ea =
"\000\000\000\000\000", be16 = {0, 0, 0}}}, arp_tha = {{ea =
"\000\000\000\000\000", be16 = {0, 0,
0}}}, tcp_flags = 0, pad2 = 0, nsh = {flags = 0 '\000', ttl
= 0 '\000', mdtype = 0 '\000', np = 0 '\000', path_hdr = 0, context = {0, 0, 0,
0}}, tp_src = 0,
tp_dst = 0, ct_tp_src = 0, ct_tp_dst = 0, igmp_group_ip4 = 0,
pad3 = 0}}, tun_md = {entry = {{loc = {len = 0, c = {next = 0x0, offset = 0,
len = 0}}, masked = false}, {
---Type <return> to continue, or q <return> to quit---
loc = {len = -1542662816, c = {next = 0x0, offset = 0, len =
0}}, masked = false}, {loc = {len = 0, c = {next = 0x0, offset = 0, len = 0}},
masked = false}, {loc = {
len = 222871551, c = {next = 0x18e00000000001ff, offset =
1025, len = 0}}, masked = 10}, {loc = {len = 0, c = {next = 0x52190e0a00000000,
offset = 0, len = 0}},
masked = false}, {loc = {len = 0, c = {next =
0xb51241bb40000008, offset = 0, len = 0}}, masked = false}, {loc = {len = 0, c
= {next = 0x1000000214, offset = 0,
len = 0}}, masked = 2}, {loc = {len = 1533070910, c = {next
= 0x301a8c00201a8c0, offset = 0, len = 289406979}}, masked = false}, {loc =
{len = 0, c = {next = 0x0,
offset = 0, len = 0}}, masked = 20}, {loc = {len = 0, c =
{next = 0x7f03d7fc2c98, offset = -857637872, len = 32515}}, masked = 40}, {loc
= {len = 42949672, c = {
next = 0x7f03e506d1af <fat_rwlock_get_slot__+15>, offset =
0, len = 0}}, masked = 219}, {loc = {len = -1542662816, c = {next =
0x7f03cce17c10, offset = -857630400,
len = 32515}}, masked = 8}, {loc = {len = -857635184, c =
{next = 0x7f03e51049e5 <random_uint32+21>, offset = -1542662816, len = 32515}},
masked = 10}, {loc = {
len = 0, c = {next = 0x7f03cce16900, offset = -857642688, len
= 32515}}, masked = false}, {loc = {len = -1542662816, c = {next =
0x7f03a40cd560,
offset = -1542662816, len = 32515}}, masked = 96}, {loc =
{len = -1542662816, c = {next = 0x7f03a40cd560, offset = -1542662816, len =
32515}}, masked = 96}, {
loc = {len = 0, c = {next = 0x0, offset = 0, len = 0}}, masked
= false}, {loc = {len = 0, c = {next = 0x7f03cce19c58, offset = -857637856, len
= 32515}},
masked = true}, {loc = {len = 0, c = {next = 0x1, offset = 0,
len = 0}}, masked = 9}, {loc = {len = -857635128, c = {next = 0x7f03d7fc2c98,
offset = -851853176,
len = 32515}}, masked = false}, {loc = {len = -852639592, c
= {next = 0x7f0300000001, offset = -848445240, len = 32515}}, masked = 144},
{loc = {len = -857642688,
c = {next = 0x7f03028f5c28, offset = 222871551, len = 144}},
masked = 255}, {loc = {len = 1025, c = {next = 0x51190e0a, offset = 0, len =
0}}, masked = false}, {
loc = {len = 0, c = {next = 0x0, offset = 0, len =
-1689255936}}, masked = 8}, {loc = {len = 0, c = {next = 0x0, offset = 0, len =
2}}, masked = 20}, {loc = {len = 0,
c = {next = 0x16fa000000000002, offset = 1533070910, len =
8}}, masked = 192}, {loc = {len = 0, c = {next = 0x2, offset = -857641840, len
= 32515}}, masked = 144}, {
loc = {len = 0, c = {next = 0x0, offset = 0, len = 0}}, masked
= 204}, {loc = {len = -858993460, c = {next = 0xcccccccccccccc02, offset = 0,
len = 0}},
masked = false}, {loc = {len = -1543428336, c = {next = 0x0,
offset = 33663168, len = 50440384}}, masked = 112}, {loc = {len = 857642513, c
= {next = 0x7f03cce169f0,
offset = 4096, len = 0}}, masked = false}, {loc = {len = 0,
c = {next = 0x0, offset = 0, len = 0}}, masked = 17}, {loc = {len = 0, c =
{next = 0x10, offset = 12,
len = 0}}, masked = 202}, {loc = {len = 12, c = {next =
0x7f03a4098220, offset = -1543503840, len = 32515}}, masked = 224}, {loc = {len
= 0, c = {
next = 0x7f03a409e8a0, offset = 75616, len = 0}}, masked =
2}, {loc = {len = 4, c = {next = 0x7f03e50a1343 <commit_mpls_action+67>, offset
= 4, len = 0}},
masked = 12}, {loc = {len = -857642192, c = {next =
0x7f03e50b0abe <commit+46>, offset = 0, len = 0}}, masked = 128}, {loc = {len =
12, c = {next = 0x7f03cce16f70,
offset = -857554928, len = 32515}}, masked = 165}, {loc =
{len = -857641392, c = {next = 0x7f03e509e9a5 <odp_execute_actions+549>, offset
= -857620560,
len = 32515}}, masked = false}, {loc = {len = -452574224, c
= {next = 0x7f03cce19c70, offset = 222871551, len = 144}}, masked = 255}, {loc
= {len = 222871551, c = {
next = 0x18e00000000001ff, offset = 1025, len = 0}}, masked
= 10}, {loc = {len = 0, c = {next = 0x52190e0a00000000, offset = 0, len = 0}},
masked = false}, {loc = {
len = 0, c = {next = 0xb51241bb40000008, offset = 0, len =
0}}, masked = false}, {loc = {len = 0, c = {next = 0x1000000214, offset = 0,
len = 0}}, masked = 2}, {
loc = {len = 1533070910, c = {next = 0x301a8c00201a8c0, offset
= 0, len = 289406979}}, masked = false}, {loc = {len = 4, c = {
next = 0x7f03e5097eca <nl_msg_put_uninit+26>, offset = 4,
len = 0}}, masked = 4}, {loc = {len = 8, c = {next = 0x7f03e5098157
<nl_msg_put_unspec_uninit+39>,
offset = 0, len = 0}}, masked = 4}, {loc = {len =
-857641956, c = {next = 0x26191f0, offset = 2, len = 0}}, masked = 215}, {loc =
{len = 40131776, c = {
next = 0x7f03cce1b070, offset = -857638256, len = 32515}},
masked = 106}, {loc = {len = 39948784, c = {next = 0x300000002, offset =
-857627200, len = 32515}},
masked = 138}, {loc = {len = 0, c = {next = 0x0, offset = 0,
len = 0}}, masked = false}, {loc = {len = 0, c = {next = 0x0, offset = 0, len =
0}}, masked = false}, {
loc = {len = 0, c = {next = 0x0, offset = 0, len = 0}}, masked
= false}, {loc = {len = 0, c = {next = 0x0, offset = 0, len = 0}}, masked =
false}, {loc = {len = 0,
c = {next = 0x0, offset = 0, len = 0}}, masked = false}, {loc
= {len = 0, c = {next = 0x0, offset = 0, len = 0}}, masked = 128}, {loc = {len
= -857641264, c = {
next = 0x0, offset = 3, len = 556803}}, masked = 224}, {loc
= {len = 0, c = {next = 0x0, offset = 1799231226, len = 23372}}, masked = 164},
{loc = {
len = 222871551, c = {next = 0x18e00000000001ff, offset =
222871551, len = 144}}, masked = 255}, {loc = {len = 1025, c = {next =
0x51190e0a, offset = 0, len = 0}},
masked = false}, {loc = {len = 0, c = {next = 0x0, offset = 0,
len = -1689255936}}, masked = 8}, {loc = {len = 0, c = {next = 0x0, offset = 0,
len = 2}}, masked = 20},
{loc = {len = 0, c = {next = 0x16fa000000000002, offset =
1533070910, len = 8}}, masked = 192}, {loc = {len = -1543363054, c = {next =
0x7f03e5104828 <random_init+24>,
offset = 0, len = 0}}, masked = false}}, alloc_offset = 0,
valid = false}}
ufid = {u32 = {2794018247, 298339329, 2318282801, 1348810040}, u64 =
{lo = 1281357663959602631, hi = 5793095012634734641}}
b = {count = 1, trunc = false, packets = {0x7f03a40880b0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x800000000, 0x0 <repeats 13 times>, 0x300000000, 0x0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x0, 0x0,
0x0, 0xffffffff, 0x0}}
error = <optimized out>
cycles = <optimized out>
---Type <return> to continue, or q <return> to quit---
#9 fast_path_processing (pmd=pmd@entry=0x7f03cce2c010,
packets_=packets_@entry=0x7f03cce1a650, keys=keys@entry=0x7f03cce17cf0,
batches=batches@entry=0x7f03cce16e40,
n_batches=n_batches@entry=0x7f03cce19c58, in_port=<optimized out>) at
lib/dpif-netdev.c:7112
netdev_flow = <optimized out>
error = 0
i = 0
actions_stub = {18446744069414584320, 0, 0, 18446744073709551615,
16711694, 0, 0, 0, 0, 0, 0, 0, 618698162175, 1792432651693457919, 1025,
1360596490, 0, 5915775021640318976,
0, 0, 11191445074015682560, 13047563342934179848, 0, 0, 8589934592,
68719477268, 0, 1655635813012078594, 35892809278, 216639799711344832,
1242993510039158784,
0 <repeats 21 times>, 73014444031, 18446744069414584320, 0, 0, 0, 0,
281470681743360, 4294901760, 0, 0, 0, 0}
slow_stub = {0, 0, 1771041424, 0, 0, 0, 0, 0, 12884901888, 0 <repeats
13 times>, 618698162175, 1792432651693457919, 1025, 1360596490, 0,
5915775021640318976, 0, 0,
11191445074015682560, 13047563342934179848, 0, 0, 8589934592,
68719477268, 0, 1655635813012078594, 35892809278, 216639799711344832,
1242993510039158784, 0 <repeats 23 times>}
actions = {base = 0x7f03cce15cb0, data = 0x7f03cce15cb8, size = 0,
allocated = 512, header = 0x0, msg = 0x0, list_node = {prev =
0xcccccccccccccccc,
next = 0xcccccccccccccccc}, source = OFPBUF_STUB}
put_actions = {base = 0x7f03cce15eb0, data = 0x7f03cce15eb0, size = 0,
allocated = 512, header = 0x0, msg = 0x0, list_node = {prev =
0xcccccccccccccccc,
next = 0xcccccccccccccccc}, source = OFPBUF_STUB}
PKT_ARRAY_SIZE = <optimized out>
packet = <optimized out>
rules = 0x7f03cce159c8
dp = <optimized out>
upcall_ok_cnt = 0
upcall_fail_cnt = 0
lookup_cnt = 0
add_lookup_cnt = 0
any_miss = <optimized out>
#10 0x00007f03e506276d in dp_netdev_input__ (pmd=pmd@entry=0x7f03cce2c010,
packets=packets@entry=0x7f03cce1a650, md_is_valid=md_is_valid@entry=true,
port_no=port_no@entry=0)
at lib/dpif-netdev.c:7189
keys = <optimized out>
missed_keys = <optimized out>
batches = 0x7f03cce16e40
n_batches = 1
in_port = <optimized out>
i = <optimized out>
#11 0x00007f03e5064604 in dp_netdev_recirculate (packets=0x7f03cce1a650,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7224
No locals.
#12 dp_execute_cb (aux_=aux_@entry=0x7f03cce21660,
packets_=packets_@entry=0x7f03cce1a650, a=a@entry=0x7f03a401eb24,
should_steal=<optimized out>) at lib/dpif-netdev.c:7540
recirc_pkts = {count = 0, trunc = false, packets = {0x0, 0x0, 0x0, 0x0,
0x0, 0x0, 0x2484b00, 0x7f03cce1a2e0, 0x7f03cce2c010, 0x7f03cffc2010,
0x7f03cce21950, 0x7f03cce1c180,
0x0, 0x26386f0, 0x260a490, 0x7f03e56beada <xlate_table_action+714>,
0x7f0300000000, 0x1, 0x1, 0x0, 0x25879b8, 0x0, 0xfee10b65, 0x9f00000000000000,
0x7f03cce1a1c0, 0x0,
0x7f03cce1cc30, 0x2496e48, 0x2496e50, 0x0, 0x7f03cce1c180,
0x7f03e56c1a81 <do_xlate_actions+3665>}}
packet = <optimized out>
pmd = 0x7f03cce2c010
dp = <optimized out>
type = <optimized out>
#13 0x00007f03e509e9f8 in odp_execute_actions (dp=dp@entry=0x7f03cce21660,
batch=batch@entry=0x7f03cce1a650, steal=steal@entry=true, actions=<optimized
out>,
---Type <return> to continue, or q <return> to quit---
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f03e50643f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = true
type = 7
last_action = true
packet = <optimized out>
a = 0x7f03a401eb24
left = 8
#14 0x00007f03e5062508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f03a408c400, should_steal=true,
packets=0x7f03cce1a650,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f03cce2c010, flow = 0x7f03a408c400}
#15 packet_batch_per_flow_execute (pmd=0x7f03cce2c010, batch=0x7f03cce1a640) at
lib/dpif-netdev.c:6773
actions = <optimized out>
flow = 0x7f03a408c400
#16 dp_netdev_input__ (pmd=pmd@entry=0x7f03cce2c010,
packets=packets@entry=0x7f03cce22040, md_is_valid=md_is_valid@entry=true,
port_no=port_no@entry=0) at lib/dpif-netdev.c:7208
keys = <optimized out>
missed_keys = <optimized out>
batches = 0x7f03cce1a640
n_batches = 1
in_port = <optimized out>
i = 0
#17 0x00007f03e5064604 in dp_netdev_recirculate (packets=0x7f03cce22040,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7224
No locals.
#18 dp_execute_cb (aux_=aux_@entry=0x7f03cce29050,
packets_=packets_@entry=0x7f03cce22040, a=a@entry=0x7f03a40089e8,
should_steal=<optimized out>) at lib/dpif-netdev.c:7540
recirc_pkts = {count = 0, trunc = false, packets = {0x0, 0x0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x40, 0xfbe74fd39caec16c, 0x6b5d1b8487711ff6,
0xb016487cc3ad117f, 0x94b5b76585255b78,
0x0, 0x0, 0x0, 0x509b, 0x0, 0x100000000, 0x0, 0x0, 0x0, 0x0,
0xfff700000000, 0x16fa000000000002, 0x85b60ce3e, 0x0, 0x0, 0x0,
0x301a8c00201a8c0, 0x0, 0x0, 0x0}}
packet = <optimized out>
pmd = 0x7f03cce2c010
dp = <optimized out>
type = <optimized out>
#19 0x00007f03e509e9f8 in odp_execute_actions (dp=dp@entry=0x7f03cce29050,
batch=batch@entry=0x7f03cce22040, steal=steal@entry=true, actions=<optimized
out>,
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f03e50643f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = true
type = 21
last_action = true
packet = <optimized out>
a = 0x7f03a40089e8
left = 8
#20 0x00007f03e5062508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f03a4008c10, should_steal=true,
packets=0x7f03cce22040,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f03cce2c010, flow = 0x7f03a4008c10}
#21 packet_batch_per_flow_execute (pmd=0x7f03cce2c010, batch=0x7f03cce22030) at
lib/dpif-netdev.c:6773
actions = <optimized out>
---Type <return> to continue, or q <return> to quit---
flow = 0x7f03a4008c10
#22 dp_netdev_input__ (pmd=pmd@entry=0x7f03cce2c010,
packets=packets@entry=0x7f03cce290d0, md_is_valid=md_is_valid@entry=false,
port_no=port_no@entry=5) at lib/dpif-netdev.c:7208
keys = <optimized out>
missed_keys = <optimized out>
batches = 0x7f03cce22030
n_batches = 1
in_port = <optimized out>
i = 0
#23 0x00007f03e5062f40 in dp_netdev_input (port_no=5, packets=0x7f03cce290d0,
pmd=0x7f03cce2c010) at lib/dpif-netdev.c:7217
No locals.
#24 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f03cce2c010, rxq=0x25b55a0,
port_no=5) at lib/dpif-netdev.c:4692
s = 0x7f03cd6dc210
batch = {count = 0, trunc = false, packets = {0x22537bec80,
0x22537be0c0, 0x2253765ec0, 0x2253765300, 0x2253764740, 0x2253763b80,
0x2253762fc0, 0x2253762400, 0x2253761840,
0x2253760c80, 0x22537600c0, 0x225378b600, 0x22537bbd80,
0x22537bc940, 0x22537bd500, 0x2253766a80, 0x22538367c0, 0x22538133c0,
0x225386f080, 0x22536ea8c0, 0x2253831580,
0x22536375c0, 0x22538104c0, 0x2253811080, 0x2253811c40,
0x2253812800, 0x225373d880, 0x225377cb00, 0x225377bf40, 0x2252d69900,
0x225385f9c0, 0x225382a000}}
timer = {start = 31919442042531544, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 32
rem_qlen = 0
qlen_p = <optimized out>
#25 0x00007f03e5063363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 660
poll_list = 0x7f03a40049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#26 0x00007f03e50ed5cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f03e50630f0 <pmd_thread_main>, arg = 0x7f03cce2c010,
name = "pmd", '\000' <repeats 12 times>}
id = 9
subprogram_name = 0x7f03a40008c0 ""
#27 0x00007f03e4419dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#28 0x00007f03e36f6ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#29 0x0000000000000000 in ?? ()
No symbol table info available.Thread 21 (Thread 0x7f7e37dc5000 (LWP 28090)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000000001384010 in ?? ()
No symbol table info available.
#2 0x000000000117b940 in ?? ()
No symbol table info available.
#3 0x00007ffc71476108 in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 20 (Thread 0x7f7e126f6700 (LWP 28140)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7df400e110 in ?? ()
No symbol table info available.
#2 0x00007f7df4000a60 in ?? ()
No symbol table info available.
#3 0x00000000012be980 in ?? ()
No symbol table info available.
#4 0x0000000000801001 in ?? ()
No symbol table info available.
#5 0x0000000000000006 in ?? ()
No symbol table info available.
#6 0x000000022b59c378 in ?? ()
No symbol table info available.
#7 0x00007f7e27e7d33c in poll_block () at lib/poll-loop.c:364
loop = 0x20
node = 0x0
pollfds = 0x7f7df4000020
elapsed = 0
retval = <optimized out>
i = <optimized out>
#8 0x00007f7e284363c7 in udpif_revalidator (arg=0x12be980) at
ofproto/ofproto-dpif-upcall.c:960
flow_limit = <optimized out>
duration = <optimized out>
revalidator = 0x12be980
udpif = 0x12b6820
leader = true
start_time = 9317237624
---Type <return> to continue, or q <return> to quit---
last_reval_seq = <optimized out>
n_flows = 6
#9 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e28436200 <udpif_revalidator>, arg = 0x12be980,
name = "revalidator\000\000\000\000"}
id = 6
subprogram_name = 0x7f7df40008c0 ""
#10 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#11 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#12 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 19 (Thread 0x7f7e21612700 (LWP 28136)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7e040008c0 in ?? ()
No symbol table info available.
#2 0x00007f7e04000970 in ?? ()
No symbol table info available.
#3 0x00007f7e1bfc2da0 in ?? ()
No symbol table info available.
#4 0x00007f7e1bfebdd0 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 18 (Thread 0x7f7e21e13700 (LWP 28135)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7e0c0008c0 in ?? ()
No symbol table info available.
#2 0x00007f7e0c0009f0 in ?? ()
No symbol table info available.
#3 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 17 (Thread 0x7f7ddfd9f700 (LWP 28156)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7ddfd9f700 in ?? ()
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#2 0x00007f7ddfd9f700 in ?? ()
No symbol table info available.
#3 0x5f2575d10c725f0e in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 16 (Thread 0x7f7e11ef5700 (LWP 28141)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7dec0008c0 in ?? ()
No symbol table info available.
#2 0x00007f7dec0009f0 in ?? ()
No symbol table info available.
#3 0x00000000012be998 in ?? ()
No symbol table info available.
#4 0x0000000000801000 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 15 (Thread 0x7f7e12ef7700 (LWP 28139)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7dfc0008c0 in ?? ()
No symbol table info available.
#2 0x00007f7dfc000970 in ?? ()
No symbol table info available.
#3 0x00000000012b6820 in ?? ()
No symbol table info available.
#4 0x00000000012b6860 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 14 (Thread 0x7f7e22e15700 (LWP 28092)):
#0 0x00007f7e2719ab4d in recvmsg () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f7e354abe66 in read_msg (s=0x7f7e22e12fd0, m=0x7f7e22e131b0) at
/usr/src/debug/dpdk-18.11/lib/librte_eal/common/eal_common_proc.c:267
msglen = <optimized out>
control = '\000' <repeats 47 times>
---Type <return> to continue, or q <return> to quit---
cmsg = <optimized out>
iov = {iov_base = 0x7f7e22e131b0, iov_len = 332}
msgh = {msg_name = 0x7f7e22e12fd0, msg_namelen = 110, msg_iov =
0x7f7e22e12f90, msg_iovlen = 1, msg_control = 0x7f7e22e12fa0, msg_controllen =
48, msg_flags = 0}
#2 mp_handle (arg=<optimized out>) at
/usr/src/debug/dpdk-18.11/lib/librte_eal/common/eal_common_proc.c:360
msg = {type = 0, msg = {name = '\000' <repeats 63 times>, len_param =
0, num_fds = 0,
param = '\000' <repeats 148 times>,
"\220\f\033\001\000\000\000\000\320Y\341\"~\177\000\000\246\205\031'~\177",
'\000' <repeats 82 times>..., fds = {0, 18549904, 0,
894090640, 32638, 0, 0, 0}}}
sa = {sun_family = 0, sun_path = '\000' <repeats 107 times>}
#3 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 13 (Thread 0x7f7de05a0700 (LWP 28155)):
#0 0x00007f7e26437e2d in sleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 12 (Thread 0x7f7e136f8700 (LWP 28138)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7df80008c0 in ?? ()
No symbol table info available.
#2 0x00007f7df8000970 in ?? ()
No symbol table info available.
#3 0x00000000012b6820 in ?? ()
No symbol table info available.
#4 0x00000000012b6860 in ?? ()
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 11 (Thread 0x7f7e20e11700 (LWP 28137)):
#0 0x00007f7e2646620d in fts_read () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7e000008c0 in ?? ()
No symbol table info available.
#2 0x00007f7e00000970 in ?? ()
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#3 0x00000000011d36b8 in ?? ()
No symbol table info available.
#4 0x00000000011d3640 in ?? ()
No symbol table info available.
#5 0x00000000011d3698 in ?? ()
No symbol table info available.
#6 0x00000000011d36a8 in ?? ()
No symbol table info available.
#7 0x00007f7e27e7d33c in poll_block () at lib/poll-loop.c:364
loop = 0x10
node = 0x0
pollfds = 0x7f7e00000020
elapsed = 2
retval = <optimized out>
i = <optimized out>
#8 0x00007f7e27df06b3 in ipf_clean_thread_main (f=0x11d3640) at lib/ipf.c:1288
now = 9317182973
ipf = 0x11d3640
#9 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27df0560 <ipf_clean_thread_main>, arg = 0x11d3640,
name = "ipf_clean\000\000\000\000\000\000"}
id = 5
subprogram_name = 0x7f7e000008c0 "\t"
#10 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#11 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#12 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 10 (Thread 0x7f7e23616700 (LWP 28091)):
#0 0x00007f7e26471483 in ?? () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 9 (Thread 0x7f7e22614700 (LWP 28133)):
#0 0x00007f7e26437e2d in sleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7e281c5370 in dpdk_mp_mutex () from
/usr/lib64/libopenvswitch-2.10.so.0.0.1
No symbol table info available.
#2 0x0000000000801000 in ?? ()
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#3 0x00007f7e27e9e5ff in xsleep (seconds=1348401600) at lib/util.c:2264
No locals.
#4 0x00007f7e27ecb776 in dpdk_watchdog (dummy=<optimized out>) at
lib/netdev-dpdk.c:1008
dev = 0x7f7e281c4298 <rl.23363+24>
#5 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ecb6d0 <dpdk_watchdog>, arg = 0x0, name =
"dpdk_watchdog\000\000"}
id = 1
subprogram_name = 0x7f7e1c0008c0 ""
#6 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#7 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#8 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 8 (Thread 0x7f7e10e2b700 (LWP 28147)):
#0 0x00007f7e27ddcff0 in rte_rdtsc () at /usr/include/dpdk/rte_cycles.h:46
No locals.
#1 rte_get_tsc_cycles () at /usr/include/dpdk/rte_cycles.h:60
No locals.
#2 cycles_counter_update (s=0x7f7e116dc210) at lib/dpif-netdev-perf.h:201
No locals.
#3 cycle_timer_stop (timer=0x7f7e10e290b0, s=0x7f7e116dc210) at
lib/dpif-netdev-perf.h:258
intr_timer = <optimized out>
#4 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7e10e2c010, rxq=0x11c7928,
port_no=4) at lib/dpif-netdev.c:4701
s = 0x7f7e116dc210
batch = {count = 0, trunc = false, packets = {0x7f7df0008510, 0x2,
0xffff8081ef1d6e91, 0x12, 0x4, 0x0, 0x5b00000034, 0x7f7e10e29170, 0x0, 0x0,
0x770000006e, 0x0,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7e10e291d0,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7e281c0ee0 <seq_mutex>,
0x7f7e27e94a79 <xclock_gettime+9>,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7e10e29200,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7df00074d0, 0x7f7e27e94a79
<xclock_gettime+9>, 0x30,
0x7f7e27e94b5b <time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0
<seq_mutex>, 0x2d8, 0x30, 0x0}}
timer = {start = 31318767447139442, suspended = 0, interrupted = 0x0}
error = 11
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#5 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
---Type <return> to continue, or q <return> to quit---
lc = 729
poll_list = 0x7f7df00049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#6 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7e10e2c010,
name = "pmd", '\000' <repeats 12 times>}
id = 9
subprogram_name = 0x7f7df00008c0 ""
#7 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#8 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#9 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 7 (Thread 0x7f7de2f35700 (LWP 28152)):
#0 0x00007f7e27de1b01 in pmd_perf_start_iteration (s=s@entry=0x7f7de37e6210)
at lib/dpif-netdev-perf.c:459
No locals.
#1 0x00007f7e27ddd2fa in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5925
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 793
poll_list = 0x7f7dd00049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#2 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7de2f36010,
name = "pmd", '\000' <repeats 12 times>}
id = 13
subprogram_name = 0x7f7dd00008c0 "P\204"
#3 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
Thread 6 (Thread 0x7f7de0da1700 (LWP 28154)):
#0 dp_packet_batch_init (batch=0x7f7de0d9f0d0, batch=0x7f7de0d9f0d0) at
lib/dp-packet.h:761
No locals.
#1 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7de0da2010, rxq=0x12f2fe8,
port_no=3) at lib/dpif-netdev.c:4666
s = 0x7f7de1652210
batch = {count = 0, trunc = false, packets = {0x22521fb040,
0x22522288c0, 0x2252282240, 0x22521cb480, 0x0, 0x0, 0x770000006e, 0x0,
0x7f7de0d9f14f, 0x7f7db80099a0,
0xcccccccc00000000, 0x7f7db80074d0, 0x7f7e281cd500
<monotonic_clock>, 0x0, 0x7f7de0d9f1d0, 0x7f7e26486c6d <__get_clockfreq+253>,
0x7f7e281c0ee0 <seq_mutex>,
0x7f7e27e94a79 <xclock_gettime+9>, 0x7f7e281cd500
<monotonic_clock>, 0x0, 0x7f7de0d9f200, 0x7f7e26486c6d <__get_clockfreq+253>,
0x7f7db8004b00,
0x7f7e27e94a79 <xclock_gettime+9>, 0x30, 0x7f7e27e94b5b
<time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0 <seq_mutex>, 0xf7, 0x30, 0x0}}
timer = {start = 31318767447147380, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = 0x0
#2 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 248
poll_list = 0x7f7db8004a10
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#3 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7de0da2010,
name = "pmd", '\000' <repeats 12 times>}
id = 16
subprogram_name = 0x7f7db80008c0 ""
#4 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#6 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 5 (Thread 0x7f7de3fff700 (LWP 28151)):
#0 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7e084d9010, rxq=0x12f3248,
port_no=3) at lib/dpif-netdev.c:4669
s = 0x7f7e08d89210
---Type <return> to continue, or q <return> to quit---
batch = {count = 0,
trunc = false, packets = {0x2250ffad00, 0x2250ffa140, 0x2250ff9580,
0x2250ff89c0, 0x0, 0x0, 0x770000006e, 0x0, 0x7f7de3ffd14f, 0x7f7dd8006c70, 0x2,
0x7f7dd8011720, 0x7f7e281cd500 <monotonic_clock>, 0x0,
0x7f7de3ffd1d0, 0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7e281c0ee0
<seq_mutex>, 0x7f7e27e94a79 <xclock_gettime+9>,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7de3ffd200,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7dd8004a80, 0x7f7e27e94a79
<xclock_gettime+9>, 0x30,
0x7f7e27e94b5b <time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0
<seq_mutex>, 0x52, 0x30, 0x0}}
timer = {start = 31318767447142682, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = 0x0
#1 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 83
poll_list = 0x7f7dd80049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#2 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7e084d9010,
name = "pmd", '\000' <repeats 12 times>}
id = 12
subprogram_name = 0x7f7dd80008c0 "\004"
#3 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 4 (Thread 0x7f7e0a66c700 (LWP 28149)):
#0 0x00007f7e2719a4ed in __lll_lock_wait () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f7e27195e01 in _L_lock_1093 () from /lib64/libpthread.so.0
No symbol table info available.
#2 0x00007f7e27195da2 in pthread_mutex_lock () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f7e27e66a38 in ovs_mutex_lock_at (l_=l_@entry=0x11d3658,
where=where@entry=0x7f7e27f0384f "lib/ipf.c:937") at lib/ovs-thread.c:76
l = 0x11d3658
error = <optimized out>
---Type <return> to continue, or q <return> to quit---
#4 0x00007f7e27df0b7e in ipf_extract_frags_from_batch (hash_basis=<optimized
out>, now=<optimized out>, zone=<optimized out>, dl_type=<optimized out>,
pb=0x7f7e0a668d70,
ipf=<optimized out>) at lib/ipf.c:937
pb_idx = 0
pkt = 0x2251d019c0
#5 ipf_preprocess_conntrack (ipf=<optimized out>, pb=pb@entry=0x7f7e0a668d70,
now=now@entry=9317237598, dl_type=dl_type@entry=8, zone=zone@entry=1,
hash_basis=<optimized out>)
at lib/ipf.c:1226
No locals.
#6 0x00007f7e27dc0682 in conntrack_execute (ct=ct@entry=0x7f7e1bfc2da0,
pkt_batch=pkt_batch@entry=0x7f7e0a668d70, dl_type=8, force=false, commit=false,
zone=1,
setmark=setmark@entry=0x0, setlabel=setlabel@entry=0x0, tp_src=14236,
tp_dst=4229, helper=helper@entry=0x0,
nat_action_info=nat_action_info@entry=0x7f7e0a668700, now=9317237598)
at lib/conntrack.c:1595
packet = <optimized out>
ctx = {key = {src = {addr = {{ipv4 = {hi = 33680, lo = 2662}, ipv6 =
{be16 = {33680, 2662, 32638, 0, 0, 2662, 32638, 0}, be32 = {{hi = 33680, lo =
2662}, {hi = 32638, lo = 0},
{hi = 0, lo = 2662}, {hi = 32638, lo = 0}}}, ipv4_aligned
= 174490512, ipv6_aligned = {__in6_u = {__u6_addr8 =
"\220\203f\n~\177\000\000\000\000f\n~\177\000",
__u6_addr16 = {33680, 2662, 32638, 0, 0, 2662, 32638, 0},
__u6_addr32 = {174490512, 32638, 174456832, 32638}}}}}, {port = 27075, {icmp_id
= 27075,
icmp_type = 0 '\000', icmp_code = 0 '\000'}}}, dst = {addr =
{{ipv4 = {hi = 43200, lo = 769}, ipv6 = {be16 = {43200, 769, 1, 0, 0, 0, 511,
0}, be32 = {{hi = 43200,
lo = 769}, {hi = 1, lo = 0}, {hi = 0, lo = 0}, {hi =
511, lo = 0}}}, ipv4_aligned = 50440384, ipv6_aligned = {__in6_u = {
__u6_addr8 =
"\300\250\001\003\001\000\000\000\000\000\000\000\377\001\000", __u6_addr16 =
{43200, 769, 1, 0, 0, 0, 511, 0}, __u6_addr32 = {50440384, 1, 0,
511}}}}}, {port = 0, {icmp_id = 0, icmp_type = 224
'\340', icmp_code = 24 '\030'}}}, dl_type = 1025, zone = 0, nw_proto = 0
'\000'}, conn = 0x7f7e0a66d010,
hash = 3825302912, reply = 125, icmp_related = 127}
#7 0x00007f7e27dde53d in dp_execute_cb (aux_=aux_@entry=0x7f7e0a6691f0,
packets_=packets_@entry=0x7f7e0a668d70, a=a@entry=0x7f7de4007064,
should_steal=<optimized out>)
at lib/dpif-netdev.c:7670
commit = <optimized out>
left = <optimized out>
b = 0x7f7de4007074
zone = <optimized out>
helper = <optimized out>
setlabel = <optimized out>
nat_action_info = {min_addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16 =
{0, 0, 0, 0, 0, 0, 0, 0}, be32 = {{hi = 0, lo = 0}, {hi = 0, lo = 0}, {hi = 0,
lo = 0}, {hi = 0,
lo = 0}}}, ipv4_aligned = 0, ipv6_aligned = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}}}, max_addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16
= {0, 0, 0, 0, 0, 0, 0, 0}, be32 = {{hi = 0, lo = 0}, {hi = 0, lo = 0}, {hi =
0, lo = 0}, {hi = 0,
lo = 0}}}, ipv4_aligned = 0, ipv6_aligned = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}}}, min_port = 0, max_port = 0, nat_action = 0}
nat_action_info_ref = <optimized out>
nat_config = <optimized out>
force = <optimized out>
setmark = <optimized out>
pmd = <optimized out>
dp = <optimized out>
type = <optimized out>
#8 0x00007f7e27e189f8 in odp_execute_actions (dp=dp@entry=0x7f7e0a6691f0,
batch=batch@entry=0x7f7e0a668d70, steal=steal@entry=true, actions=<optimized
out>,
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f7e27dde3f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = false
---Type <return> to continue, or q <return> to quit---
type = 12
last_action = false
packet = <optimized out>
a = 0x7f7de4007064
left = 24
#9 0x00007f7e27ddc508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f7de4018d60, should_steal=true,
packets=0x7f7e0a668d70,
pmd=0x7f7e0a66d010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f7e0a66d010, flow = 0x7f7de4018d60}
#10 packet_batch_per_flow_execute (pmd=0x7f7e0a66d010, batch=0x7f7e0a668d60) at
lib/dpif-netdev.c:6773
actions = <optimized out>
flow = 0x7f7de4018d60
#11 dp_netdev_input__ (pmd=pmd@entry=0x7f7e0a66d010,
packets=packets@entry=0x7f7e0a669bd0, md_is_valid=md_is_valid@entry=true,
port_no=port_no@entry=0) at lib/dpif-netdev.c:7208
keys = <optimized out>
missed_keys = <optimized out>
batches = 0x7f7e0a668d60
n_batches = 1
in_port = <optimized out>
i = 0
#12 0x00007f7e27dde604 in dp_netdev_recirculate (packets=0x7f7e0a669bd0,
pmd=0x7f7e0a66d010) at lib/dpif-netdev.c:7224
No locals.
#13 dp_execute_cb (aux_=aux_@entry=0x7f7e0a66a050,
packets_=packets_@entry=0x7f7e0a669bd0, a=a@entry=0x7f7de40008c8,
should_steal=<optimized out>) at lib/dpif-netdev.c:7540
recirc_pkts = {count = 0, trunc = false, packets = {0x0 <repeats 32
times>}}
packet = <optimized out>
pmd = 0x7f7e0a66d010
dp = <optimized out>
type = <optimized out>
#14 0x00007f7e27e189f8 in odp_execute_actions (dp=dp@entry=0x7f7e0a66a050,
batch=batch@entry=0x7f7e0a669bd0, steal=steal@entry=true, actions=<optimized
out>,
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f7e27dde3f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = true
type = 21
last_action = true
packet = <optimized out>
a = 0x7f7de40008c8
left = 8
#15 0x00007f7e27ddc508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f7de4019540, should_steal=true,
packets=0x7f7e0a669bd0,
pmd=0x7f7e0a66d010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f7e0a66d010, flow = 0x7f7de4019540}
#16 packet_batch_per_flow_execute (pmd=0x7f7e0a66d010, batch=0x7f7e0a669bc0) at
lib/dpif-netdev.c:6773
actions = <optimized out>
flow = 0x7f7de4019540
#17 dp_netdev_input__ (pmd=pmd@entry=0x7f7e0a66d010,
packets=packets@entry=0x7f7e0a66a0d0, md_is_valid=md_is_valid@entry=false,
port_no=port_no@entry=4) at lib/dpif-netdev.c:7208
keys = <optimized out>
---Type <return> to continue, or q <return> to quit---
missed_keys = <optimized out>
batches = 0x7f7e0a669bc0
n_batches = 1
in_port = <optimized out>
i = 0
#18 0x00007f7e27ddcf40 in dp_netdev_input (port_no=4, packets=0x7f7e0a66a0d0,
pmd=0x7f7e0a66d010) at lib/dpif-netdev.c:7217
No locals.
#19 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7e0a66d010, rxq=0x11c7a58,
port_no=4) at lib/dpif-netdev.c:4692
s = 0x7f7e0af1d210
batch = {count = 0, trunc = false, packets = {0x2251d019c0,
0x2251d02580, 0x2251d03140, 0x2251d03d00, 0x0, 0x0, 0x770000006e, 0x0,
0x7f7e0a66a14f,
0x7f7e263abfe8 <qsort_r+504>, 0x6, 0x7f7de4018380, 0x7f7e281cd500
<monotonic_clock>, 0x0, 0x7f7e0a66a1d0, 0x7f7e26486c6d <__get_clockfreq+253>,
0x7f7e281c0ee0 <seq_mutex>,
0x7f7e27e94a79 <xclock_gettime+9>, 0x7f7e281cd500
<monotonic_clock>, 0x0, 0x7f7e0a66a200, 0x7f7e26486c6d <__get_clockfreq+253>,
0x7f7de40070a0,
0x7f7e27e94a79 <xclock_gettime+9>, 0x30, 0x7f7e27e94b5b
<time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0 <seq_mutex>, 0x50, 0x30, 0x0}}
timer = {start = 31318766656116990, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 1
rem_qlen = 0
qlen_p = <optimized out>
#20 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 81
poll_list = 0x7f7de40049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#21 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7e0a66d010,
name = "pmd", '\000' <repeats 12 times>}
id = 11
subprogram_name = 0x7f7de40008c0 "\f"
#22 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#23 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#24 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 3 (Thread 0x7f7e095a2700 (LWP 28150)):
---Type <return> to continue, or q <return> to quit---
#0 0x00007f7e27ddcfc4 in dp_netdev_process_rxq_port
(pmd=pmd@entry=0x7f7e095a3010, rxq=<optimized out>, port_no=3) at
lib/dpif-netdev.c:4713
s = 0x7f7e09e53210
batch = {count = 0,
trunc = false, packets = {0x22516a63c0, 0x22516a6f80, 0x22516a7b40,
0x22516a8700, 0x4, 0x0, 0x5b00000034, 0x7f7e095a0170, 0x0, 0x0, 0x770000006e,
0x0,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7e095a01d0,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7e281c0ee0 <seq_mutex>,
0x7f7e27e94a79 <xclock_gettime+9>,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7e095a0200,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7dc8007c10, 0x7f7e27e94a79
<xclock_gettime+9>, 0x30,
0x7f7e27e94b5b <time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0
<seq_mutex>, 0x31c, 0x30, 0x0}}
timer = {start = 31318767447141264, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#1 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 797
poll_list = 0x7f7dc80049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#2 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7e095a3010,
name = "pmd", '\000' <repeats 12 times>}
id = 14
subprogram_name = 0x7f7dc80008c0 "\020n"
#3 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#5 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 2 (Thread 0x7f7de1e6b700 (LWP 28153)):
#0 rte_rdtsc () at /usr/include/dpdk/rte_cycles.h:36
No locals.
#1 rte_get_tsc_cycles () at /usr/include/dpdk/rte_cycles.h:60
No locals.
#2 cycles_counter_update (s=<optimized out>) at lib/dpif-netdev-perf.h:201
No locals.
#3 cycle_timer_start (timer=<optimized out>, s=<optimized out>) at
lib/dpif-netdev-perf.h:241
---Type <return> to continue, or q <return> to quit---
cur_timer = <optimized out>
#4 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7de1e6c010, rxq=0x12f7ed8,
port_no=5) at lib/dpif-netdev.c:4663
s = 0x7f7de271c210
batch = {count = 0, trunc = false, packets = {0x225d3fd300, 0x0,
0x5b00000034, 0x7f7de1e69150, 0x0, 0x0, 0x770000006e, 0x0, 0x7f7de1e6914f,
0x7f7e263abfe8 <qsort_r+504>, 0x0,
0x7f7dc0008c80, 0x7f7e281cd500 <monotonic_clock>, 0x0,
0x7f7de1e691d0, 0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7e281c0ee0
<seq_mutex>, 0x7f7e27e94a79 <xclock_gettime+9>,
0x7f7e281cd500 <monotonic_clock>, 0x0, 0x7f7de1e69200,
0x7f7e26486c6d <__get_clockfreq+253>, 0x7f7dc0004ab0, 0x7f7e27e94a79
<xclock_gettime+9>, 0x30,
0x7f7e27e94b5b <time_timespec__+187>, 0x0, 0x30, 0x7f7e281c0ee0
<seq_mutex>, 0x15, 0x30, 0x0}}
timer = {start = 31318767447145934, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 0
rem_qlen = 0
qlen_p = <optimized out>
#5 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 22
poll_list = 0x7f7dc00049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#6 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7de1e6c010,
name = "pmd", '\000' <repeats 12 times>}
id = 15
subprogram_name = 0x7f7dc00008c0 "x"
#7 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#8 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#9 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 1 (Thread 0x7f7e0b736700 (LWP 28148)):
#0 0x00007f7e264c86e6 in __memcpy_ssse3_back () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f7e27dceaf2 in dp_packet_put (b=b@entry=0x7f7de8020860,
p=p@entry=0x667265707465dc00, size=size@entry=1718773104) at lib/dp-packet.c:394
dst = <optimized out>
#2 0x00007f7e27dcec66 in dp_packet_clone_data_with_headroom
(data=0x667265707465dc00, size=1718773104, headroom=<optimized out>) at
lib/dp-packet.c:238
b = 0x7f7de8020860
---Type <return> to continue, or q <return> to quit---
#3 0x00007f7e27dcecb6 in dp_packet_clone_with_headroom (buffer=0x7f7de8197200,
headroom=headroom@entry=0) at lib/dp-packet.c:192
new_buffer = <optimized out>
#4 0x00007f7e27dd0917 in dp_packet_clone (buffer=<optimized out>) at
lib/dp-packet.c:159
No locals.
#5 0x00007f7e27df15d2 in ipf_reassemble_v4_frags (ipf_list=<optimized out>,
ipf_list=<optimized out>) at lib/ipf.c:408
frag_list = 0x7f7de81e64e0
pkt = <optimized out>
len = <optimized out>
rest_len = <optimized out>
new_ip_frag_off = <optimized out>
#6 ipf_list_state_transition (v6=false, lf=false, ff=false,
ipf_list=0x7f7de81fda60, ipf=0x11d3640) at lib/ipf.c:552
reass_pkt = <optimized out>
curr_state = <optimized out>
next_state = IPF_LIST_STATE_FIRST_LAST_SEEN
#7 ipf_process_frag (v6=false, lf=false, ff=false, end_data_byte=47359,
start_data_byte=45880, pkt=0x2253715d00, ipf_list=0x7f7de81fda60,
ipf=0x11d3640) at lib/ipf.c:815
frag = <optimized out>
last_inuse_idx = <optimized out>
#8 ipf_handle_frag (hash_basis=872939505, now=9317237597, zone=1,
dl_type=<optimized out>, pkt=0x2253715d00, ipf=0x11d3640) at lib/ipf.c:916
key = {src_addr = {ipv4 = 33663168, ipv6 = {__in6_u = {__u6_addr8 =
"\300\250\001\002", '\000' <repeats 11 times>, __u6_addr16 = {43200, 513, 0, 0,
0, 0, 0, 0}, __u6_addr32 = {
33663168, 0, 0, 0}}}}, dst_addr = {ipv4 = 50440384, ipv6 =
{__in6_u = {__u6_addr8 = "\300\250\001\003", '\000' <repeats 11 times>,
__u6_addr16 = {43200, 769, 0, 0,
0, 0, 0, 0}, __u6_addr32 = {50440384, 0, 0, 0}}}}, recirc_id
= 0, ip_id = 1025441792, dl_type = 8, zone = 1, nw_proto = 17 '\021'}
end_data_byte = 47359
ff = false
lf = false
v6 = <optimized out>
ipf_list = 0x7f7de81fda60
start_data_byte = 45880
max_frag_list_size = <optimized out>
nfrag_max = <optimized out>
#9 ipf_extract_frags_from_batch (hash_basis=<optimized out>, now=<optimized
out>, zone=<optimized out>, dl_type=<optimized out>, pb=0x7f7e0b730ab0,
ipf=<optimized out>)
at lib/ipf.c:938
pb_idx = 5
pkt = 0x2253715d00
#10 ipf_preprocess_conntrack (ipf=<optimized out>, pb=pb@entry=0x7f7e0b730ab0,
now=now@entry=9317237597, dl_type=dl_type@entry=8, zone=zone@entry=1,
hash_basis=<optimized out>)
at lib/ipf.c:1226
No locals.
#11 0x00007f7e27dc0682 in conntrack_execute (ct=ct@entry=0x7f7e1bfc2da0,
pkt_batch=pkt_batch@entry=0x7f7e0b730ab0, dl_type=8, force=false, commit=false,
zone=1,
setmark=setmark@entry=0x0, setlabel=setlabel@entry=0x0, tp_src=0, tp_dst=0,
helper=helper@entry=0x0, nat_action_info=nat_action_info@entry=0x7f7e0b730440,
now=9317237597)
at lib/conntrack.c:1595
packet = <optimized out>
ctx = {key = {src = {addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16 =
{0, 0, 3, 4416, 0, 0, 3594, 21017}, be32 = {{hi = 0, lo = 0}, {hi = 3, lo =
4416}, {hi = 0, lo = 0}, {
hi = 3594, lo = 21017}}}, ipv4_aligned = 0,
ipv6_aligned = {__in6_u = {__u6_addr8 =
"\000\000\000\000\003\000@\021\000\000\000\000\n\016\031R", __u6_addr16 = {
---Type <return> to continue, or q <return> to quit---
0, 0, 3, 4416, 0, 0, 3594, 21017}, __u6_addr32 = {0,
289406979, 0, 1377373706}}}}}, {port = 0, {icmp_id = 0, icmp_type = 0 '\000',
icmp_code = 0 '\000'}}},
dst = {addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16 = {0, 0, 0,
0, 0, 0, 0, 0}, be32 = {{hi = 0, lo = 0}, {hi = 0, lo = 0}, {hi = 0, lo = 0},
{hi = 0, lo = 0}}},
ipv4_aligned = 0, ipv6_aligned = {__in6_u = {__u6_addr8 =
'\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32
= {0, 0, 0, 0}}}}}, {
port = 0, {icmp_id = 0, icmp_type = 80 'P', icmp_code = 155
'\233'}}}, dl_type = 51545, zone = 10220, nw_proto = 126 '~'}, conn = 0x0, hash
= 0, reply = false,
icmp_related = false}
#12 0x00007f7e27dde53d in dp_execute_cb (aux_=aux_@entry=0x7f7e0b732090,
packets_=packets_@entry=0x7f7e0b730ab0, a=a@entry=0x7f7de8226394,
should_steal=<optimized out>)
at lib/dpif-netdev.c:7670
commit = <optimized out>
left = <optimized out>
b = 0x7f7de82263a4
zone = <optimized out>
helper = <optimized out>
setlabel = <optimized out>
nat_action_info = {min_addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16 =
{0, 0, 0, 0, 0, 0, 0, 0}, be32 = {{hi = 0, lo = 0}, {hi = 0, lo = 0}, {hi = 0,
lo = 0}, {hi = 0,
lo = 0}}}, ipv4_aligned = 0, ipv6_aligned = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}}}, max_addr = {{ipv4 = {hi = 0, lo = 0}, ipv6 = {be16
= {0, 0, 0, 0, 0, 0, 0, 0}, be32 = {{hi = 0, lo = 0}, {hi = 0, lo = 0}, {hi =
0, lo = 0}, {hi = 0,
lo = 0}}}, ipv4_aligned = 0, ipv6_aligned = {__in6_u =
{__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0,
0}, __u6_addr32 = {0, 0, 0,
0}}}}}, min_port = 0, max_port = 0, nat_action = 0}
nat_action_info_ref = <optimized out>
nat_config = <optimized out>
force = <optimized out>
setmark = <optimized out>
pmd = <optimized out>
dp = <optimized out>
type = <optimized out>
#13 0x00007f7e27e189f8 in odp_execute_actions (dp=dp@entry=0x7f7e0b732090,
batch=batch@entry=0x7f7e0b730ab0, steal=steal@entry=true, actions=<optimized
out>,
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f7e27dde3f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = false
type = 12
last_action = false
packet = <optimized out>
a = 0x7f7de8226394
left = 24
#14 0x00007f7e27ddc508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f7de8198920, should_steal=true,
packets=0x7f7e0b730ab0,
pmd=0x7f7e0b737010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f7e0b737010, flow = 0x7f7de8198920}
#15 packet_batch_per_flow_execute (pmd=0x7f7e0b737010, batch=0x7f7e0b730aa0) at
lib/dpif-netdev.c:6773
actions = <optimized out>
flow = 0x7f7de8198920
#16 dp_netdev_input__ (pmd=pmd@entry=0x7f7e0b737010,
packets=packets@entry=0x7f7e0b732a70, md_is_valid=md_is_valid@entry=true,
port_no=port_no@entry=0) at lib/dpif-netdev.c:7208
keys = <optimized out>
missed_keys = <optimized out>
---Type <return> to continue, or q <return> to quit---
batches = 0x7f7e0b730aa0
n_batches = 1
in_port = <optimized out>
i = 0
#17 0x00007f7e27dde604 in dp_netdev_recirculate (packets=0x7f7e0b732a70,
pmd=0x7f7e0b737010) at lib/dpif-netdev.c:7224
No locals.
#18 dp_execute_cb (aux_=aux_@entry=0x7f7e0b734050,
packets_=packets_@entry=0x7f7e0b732a70, a=a@entry=0x7f7de81fdaf8,
should_steal=<optimized out>) at lib/dpif-netdev.c:7540
recirc_pkts = {count = 0, trunc = false, packets = {0x22b59c35d,
0x7f7de8020301, 0x100000001, 0x17e00000000, 0x7f7e13fc0001, 0x0, 0x0, 0x0,
0x842c36000, 0x7f7e0b732710,
0x7f7e0b737010, 0x7f7e13fc2010, 0x7f7e0b7331f0, 0x0, 0x0, 0x0, 0x0,
0x1, 0xf0f0f0f0f0f0f0f, 0x3333333333333333, 0x7f7de81ce1e0, 0x5555555555555555,
0x101010101010101,
0x7f7e27dd23a3 <dpcls_lookup+83>, 0x0, 0x7f7de81ce210, 0x1,
0x7f7e0b732738, 0x7f7de81ce1e0, 0x2, 0x7f7e0b732748, 0x7f7e27dd23a3
<dpcls_lookup+83>}}
packet = <optimized out>
pmd = 0x7f7e0b737010
dp = <optimized out>
type = <optimized out>
#19 0x00007f7e27e189f8 in odp_execute_actions (dp=dp@entry=0x7f7e0b734050,
batch=batch@entry=0x7f7e0b732a70, steal=steal@entry=true, actions=<optimized
out>,
actions_len=<optimized out>,
dp_execute_action=dp_execute_action@entry=0x7f7e27dde3f0 <dp_execute_cb>) at
lib/odp-execute.c:750
should_steal = true
type = 21
last_action = true
packet = <optimized out>
a = 0x7f7de81fdaf8
left = 8
#20 0x00007f7e27ddc508 in dp_netdev_execute_actions (actions_len=<optimized
out>, actions=<optimized out>, flow=0x7f7de8202770, should_steal=true,
packets=0x7f7e0b732a70,
pmd=0x7f7e0b737010) at lib/dpif-netdev.c:7715
aux = {pmd = 0x7f7e0b737010, flow = 0x7f7de8202770}
#21 packet_batch_per_flow_execute (pmd=0x7f7e0b737010, batch=0x7f7e0b732a60) at
lib/dpif-netdev.c:6773
actions = <optimized out>
flow = 0x7f7de8202770
#22 dp_netdev_input__ (pmd=pmd@entry=0x7f7e0b737010,
packets=packets@entry=0x7f7e0b7340d0, md_is_valid=md_is_valid@entry=false,
port_no=port_no@entry=5) at lib/dpif-netdev.c:7208
keys = <optimized out>
missed_keys = <optimized out>
batches = 0x7f7e0b732a60
n_batches = 1
in_port = <optimized out>
i = 0
#23 0x00007f7e27ddcf40 in dp_netdev_input (port_no=5, packets=0x7f7e0b7340d0,
pmd=0x7f7e0b737010) at lib/dpif-netdev.c:7217
No locals.
#24 dp_netdev_process_rxq_port (pmd=pmd@entry=0x7f7e0b737010, rxq=0x12f8008,
port_no=5) at lib/dpif-netdev.c:4692
s = 0x7f7e0bfe7210
batch = {count = 0,
trunc = false, packets = {0x22537197c0, 0x2253718c00, 0x2253718040,
0x2253717480, 0x22537168c0, 0x2253715d00, 0x2253715140, 0x2253714580,
0x2253702b80,
0x2253703740, 0x2253704ec0, 0x2253705a80, 0x2253706640,
0x2253707200, 0x2253707dc0, 0x2253708980, 0x2253709540, 0x225370a100,
0x225370acc0, 0x225370b880, 0x225370c440,
0x225370d000, 0x225370dbc0, 0x225370f340, 0x225370ff00,
0x22537197c0, 0x2253718c00, 0x2253718040, 0x22536f2900, 0x2f4, 0x30, 0x0}}
---Type <return> to continue, or q <return> to quit---
timer = {start = 31318766655625336, suspended = 0, interrupted = 0x0}
error = <optimized out>
batch_cnt = 6
rem_qlen = 0
qlen_p = <optimized out>
#25 0x00007f7e27ddd363 in pmd_thread_main (f_=<optimized out>) at
lib/dpif-netdev.c:5940
rx_packets = 0
tx_packets = 0
pmd = <optimized out>
s = <optimized out>
lc = 759
poll_list = 0x7f7de80049c0
exiting = <optimized out>
poll_cnt = <optimized out>
i = <optimized out>
process_packets = <optimized out>
#26 0x00007f7e27e675cf in ovsthread_wrapper (aux_=<optimized out>) at
lib/ovs-thread.c:354
auxp = <optimized out>
aux = {start = 0x7f7e27ddd0f0 <pmd_thread_main>, arg = 0x7f7e0b737010,
name = "pmd", '\000' <repeats 12 times>}
id = 10
subprogram_name = 0x7f7de80008c0 ""
#27 0x00007f7e27193dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#28 0x00007f7e26470ead in __libc_ifunc_impl_list () from /lib64/libc.so.6
No symbol table info available.
#29 0x0000000000000000 in ?? ()
No symbol table info available._______________________________________________
dev mailing list
d...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-dev
