Hello Alex,
It happened again and I got some gdp traces, please see the output in the attachment. During the gdb session the openvswitch started working again, so I’m not sure if I got the right point. Please have a look and let me know if you need additional information. Thanks in advance! Cheers Chris From: Alex Wang [mailto:[email protected]] Sent: Thursday, June 04, 2015 14:00 To: Chris Cc: [email protected]; [email protected]; Soputhi Sea Subject: Re: [ovs-discuss] Openvswitch network disconnect Thx for the info, I'll try reproduce it on my local setup using active-backup bond. And use it as managment interface, Will update if I run into the same issue~ Thanks, Alex Wang, On Wed, Jun 3, 2015 at 11:52 PM, Chris <[email protected] <mailto:[email protected]> > wrote: Hello Alex, I will do the gdb debug when it happens again. Here the output, in this case there are 4 VMs running on the host. The physical interfaces eth2 & eth3 are in active-passive mode bonded to bond0. mgmt0 is used for the management of the host system. Anything else is created by OpenStack. The failure happens independent from the number of VMs running on the host: ovs-vsctl show fbbaf640-ed82-4735-99d2-fbe09f4041f1 Bridge "br-bond0" Port "mgmt0" Interface "mgmt0" type: internal Port "br-bond0" Interface "br-bond0" type: internal Port "phy-br-bond0" Interface "phy-br-bond0" Port "bond0" Interface "eth2" Interface "eth3" Bridge br-int fail_mode: secure Port br-int Interface br-int type: internal Port "qvo4166dc0a-69" tag: 1 Interface "qvo4166dc0a-69" Port "qvo6d8b70de-9c" tag: 1 Interface "qvo6d8b70de-9c" Port "qvoe75237cc-7f" tag: 1 Interface "qvoe75237cc-7f" Port "qvoe3b9e1fc-a5" tag: 1 Interface "qvoe3b9e1fc-a5" Port "int-br-bond0" Interface "int-br-bond0" ovs_version: "2.3.0" ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 <http://127.0.0.1/8> scope host lo 2: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000 link/ether 9c:b6:54:b3:67:34 brd ff:ff:ff:ff:ff:ff 3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000 link/ether 9c:b6:54:b3:67:35 brd ff:ff:ff:ff:ff:ff 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 link/ether 64:51:06:f0:85:98 brd ff:ff:ff:ff:ff:ff 5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 link/ether 64:51:06:f0:85:9c brd ff:ff:ff:ff:ff:ff 6: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN link/ether de:76:ca:6d:57:48 brd ff:ff:ff:ff:ff:ff 7: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN link/ether ee:f8:2f:ef:94:42 brd ff:ff:ff:ff:ff:ff 8: br-bond0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN link/ether 64:51:06:f0:85:98 brd ff:ff:ff:ff:ff:ff 15: mgmt0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:e1:51:33:5d:dc brd ff:ff:ff:ff:ff:ff inet 10.201.195.75/24 <http://10.201.195.75/24> brd 10.201.195.255 scope global mgmt0 16: qbr4166dc0a-69: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether be:9a:00:23:b1:f3 brd ff:ff:ff:ff:ff:ff 17: qvo4166dc0a-69: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether ae:27:12:55:09:0c brd ff:ff:ff:ff:ff:ff 18: qvb4166dc0a-69: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether be:9a:00:23:b1:f3 brd ff:ff:ff:ff:ff:ff 19: tap4166dc0a-69: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 500 link/ether fe:16:3e:d6:34:82 brd ff:ff:ff:ff:ff:ff 20: qbre75237cc-7f: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether c2:f2:1a:30:a2:84 brd ff:ff:ff:ff:ff:ff 21: qvoe75237cc-7f: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 1e:7f:f4:57:aa:82 brd ff:ff:ff:ff:ff:ff 22: qvbe75237cc-7f: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether c2:f2:1a:30:a2:84 brd ff:ff:ff:ff:ff:ff 23: tape75237cc-7f: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 500 link/ether fe:16:3e:02:a4:d7 brd ff:ff:ff:ff:ff:ff 24: qbre3b9e1fc-a5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether ce:c7:ec:59:fd:1a brd ff:ff:ff:ff:ff:ff 25: qvoe3b9e1fc-a5: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether c6:5f:19:25:7c:be brd ff:ff:ff:ff:ff:ff 26: qvbe3b9e1fc-a5: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether ce:c7:ec:59:fd:1a brd ff:ff:ff:ff:ff:ff 27: tape3b9e1fc-a5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 500 link/ether fe:16:3e:bb:a7:19 brd ff:ff:ff:ff:ff:ff 28: qbr6d8b70de-9c: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether c2:45:27:31:f8:d1 brd ff:ff:ff:ff:ff:ff 29: qvo6d8b70de-9c: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 46:23:9e:4b:2a:fd brd ff:ff:ff:ff:ff:ff 30: qvb6d8b70de-9c: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether c2:45:27:31:f8:d1 brd ff:ff:ff:ff:ff:ff 31: tap6d8b70de-9c: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 500 link/ether fe:16:3e:40:9e:44 brd ff:ff:ff:ff:ff:ff 32: bond0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN link/ether f6:83:30:bc:4c:7c brd ff:ff:ff:ff:ff:ff 35: phy-br-bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 76:51:9d:bd:24:83 brd ff:ff:ff:ff:ff:ff 36: int-br-bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 5e:fa:05:2a:1a:ef brd ff:ff:ff:ff:ff:ff Cheers, Chris From: Alex Wang [mailto:[email protected] <mailto:[email protected]> ] Sent: Thursday, June 04, 2015 13:29 To: Chris Cc: [email protected] <mailto:[email protected]> ; [email protected] <mailto:[email protected]> ; Soputhi Sea Subject: Re: [ovs-discuss] Openvswitch network disconnect On Wed, Jun 3, 2015 at 11:16 PM, Chris <[email protected] <mailto:[email protected]> > wrote: Hello, We are using Openvswitch in our Openstack setup. ovs-vswitchd --version ovs-vswitchd (Open vSwitch) 2.3.0 Compiled Oct 28 2014 17:48:05 OpenFlow versions 0x1:0x1 We experience openvswitch failures from time to time. It seems to happen random, no network traffic spikes for example. The VM ports and the openvswitch port for the host management just stop working. But the openvswitch services (ovsdb-server/ ovs-vswitchd) are still running For debug purpose the following commands has been executed: - "ovs-vsctl show" the interfaces are still listed The ones below didn't show any result and just hang after the execution: - ovs-appctl bond/show bond0 - ovs-appctl vlog/list - ovs-ofctl dump-flows br-bond0 This seems to indicate that the ovs-vswitchd process is dead locked... I could not find comment in branch-2.3 that relates to dead lock. It would be helpful if you can gdb into the running ovs-vswitchd process and provide the backtraces when there is a failure. Or could I know what your setup looks like (ovs-vsctl show output)? Thanks, Alex Wang, A "service openvswitch restart" fix it, the connection from the VMs and the host are back immediately. Any help appreciated! Cheers, Chris _______________________________________________ discuss mailing list [email protected] <mailto:[email protected]> http://openvswitch.org/mailman/listinfo/discuss
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-75.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/sbin/ovs-vswitchd...(no debugging symbols found)...done. Attaching to program: /usr/sbin/ovs-vswitchd, process 2167 Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl.so.10 Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libcrypto.so.10 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [New LWP 2230] [New LWP 2229] [New LWP 2228] [New LWP 2227] [New LWP 2226] [New LWP 2225] [New LWP 2224] [New LWP 2223] [New LWP 2222] [New LWP 2221] [New LWP 2220] [New LWP 2219] [New LWP 2218] [New LWP 2217] [New LWP 2216] [New LWP 2215] [New LWP 2214] [New LWP 2213] [New LWP 2212] [New LWP 2211] [New LWP 2176] [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libgssapi_krb5.so.2 Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libk5crypto.so.3 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 0x00007f76d1d0ac50 in pthread_rwlock_wrlock () from /lib64/libpthread.so.0 Missing separate debuginfos, use: debuginfo-install openvswitch-2.3.0-1.x86_64 (gdb) backtrace full #0 0x00007f76d1d0ac50 in pthread_rwlock_wrlock () from /lib64/libpthread.so.0 No symbol table info available. #1 0x0000000000495320 in ?? () No symbol table info available. #2 0x0000000000421579 in ?? () No symbol table info available. #3 0x0000000000414f72 in ?? () No symbol table info available. #4 0x0000000000405aad in ?? () No symbol table info available. #5 0x000000000040c987 in ?? () No symbol table info available. #6 0x000000000040e045 in ?? () No symbol table info available. #7 0x00007f76d1f3bd5d in __libc_start_main () from /lib64/libc.so.6 No symbol table info available. #8 0x0000000000405009 in ?? () No symbol table info available. #9 0x00007fff08c23248 in ?? () No symbol table info available. #10 0x000000000000001c in ?? () No symbol table info available. #11 0x000000000000000b in ?? () No symbol table info available. #12 0x0000000000eec490 in ?? () No symbol table info available. #13 0x0000000000eec4e0 in ?? () No symbol table info available. #14 0x0000000000eec500 in ?? () No symbol table info available. #15 0x0000000000eec520 in ?? () No symbol table info available. #16 0x0000000000eec540 in ?? () No symbol table info available. #17 0x0000000000eec560 in ?? () No symbol table info available. #18 0x0000000000eec580 in ?? () No symbol table info available. #19 0x0000000000eec5c0 in ?? () No symbol table info available. #20 0x0000000000eec600 in ?? () No symbol table info available. #21 0x0000000000eec620 in ?? () No symbol table info available. #22 0x0000000000eec4b0 in ?? () No symbol table info available. #23 0x0000000000000000 in ?? () No symbol table info available. (gdb) info regisr[Kters rax 0xfffffffffffffe00 -512 rbx 0x4e8b4c 5147468 rcx 0xffffffffffffffff -1 rdx 0x8b 139 rsi 0x80 128 rdi 0x759ccc 7707852 rbp 0x759cc0 0x759cc0 rsp 0x7fff08c22d68 0x7fff08c22d68 r8 0x0 0 r9 0x0 0 r10 0x0 0 r11 0x206 518 r12 0xefba50 15710800 r13 0xf01b70 15735664 r14 0x4eda64 5167716 r15 0x9 9 rip 0x7f76d1d0ac50 0x7f76d1d0ac50 <pthread_rwlock_wrlock+64> eflags 0x206 [ PF IF ] cs 0x33 51 ss 0x2b 43 ds 0x0 0 es 0x0 0 fs 0x0 0 gs 0x0 0 (gdb) x/16i $pc => 0x7f76d1d0ac50 <pthread_rwlock_wrlock+64>: sub $0xc,%rdi 0x7f76d1d0ac54 <pthread_rwlock_wrlock+68>: mov $0x1,%esi 0x7f76d1d0ac59 <pthread_rwlock_wrlock+73>: xor %eax,%eax 0x7f76d1d0ac5b <pthread_rwlock_wrlock+75>: lock cmpxchg %esi,(%rdi) 0x7f76d1d0ac5f <pthread_rwlock_wrlock+79>: jne 0x7f76d1d0acb5 <pthread_rwlock_wrlock+165> 0x7f76d1d0ac61 <pthread_rwlock_wrlock+81>: decl 0x14(%rdi) 0x7f76d1d0ac64 <pthread_rwlock_wrlock+84>: jmp 0x7f76d1d0ac20 <pthread_rwlock_wrlock+16> 0x7f76d1d0ac66 <pthread_rwlock_wrlock+86>: xor %edx,%edx 0x7f76d1d0ac68 <pthread_rwlock_wrlock+88>: mov %fs:0x2d0,%eax 0x7f76d1d0ac70 <pthread_rwlock_wrlock+96>: mov %eax,0x18(%rdi) 0x7f76d1d0ac73 <pthread_rwlock_wrlock+99>: lock decl (%rdi) 0x7f76d1d0ac76 <pthread_rwlock_wrlock+102>: jne 0x7f76d1d0ac97 <pthread_rwlock_wrlock+135> 0x7f76d1d0ac78 <pthread_rwlock_wrlock+104>: mov %rdx,%rax 0x7f76d1d0ac7b <pthread_rwlock_wrlock+107>: retq 0x7f76d1d0ac7c <pthread_rwlock_wrlock+108>: mov 0x1c(%rdi),%esi 0x7f76d1d0ac7f <pthread_rwlock_wrlock+111>: callq 0x7f76d1d0e240 <__lll_lock_wait> (gdb) thread apply all backtrace Thread 22 (Thread 0x7f76ce941700 (LWP 2176)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004943fc in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f767f5fe700 (LWP 2211)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f767ffff700 (LWP 2212)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f76acdfa700 (LWP 2213)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f76d0744700 (LWP 2214)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f76cfd43700 (LWP 2215)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f76cf342700 (LWP 2216)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f76cdf40700 (LWP 2217)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f76cd53f700 (LWP 2218)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f76ccb3e700 (LWP 2219)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f76c7fff700 (LWP 2220)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f76c75fe700 (LWP 2221)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f76c6bfd700 (LWP 2222)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f76c61fc700 (LWP 2223)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f76c57fb700 (LWP 2224)): #0 0x00007f76d1d0a9b6 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0 #1 0x0000000000495390 in ?? () #2 0x000000000043419a in ?? () #3 0x000000000042d44a in ?? () #4 0x0000000000494661 in ?? () #5 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f76c4dfa700 (LWP 2225)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004946b1 in ?? () #4 0x000000000042ecc2 in ?? () #5 0x0000000000494661 in ?? () #6 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f76affff700 (LWP 2226)): #0 0x00007f76d201505e in __lll_lock_wait_private () from /lib64/libc.so.6 #1 0x00007f76d1f9a16b in _L_lock_9503 () from /lib64/libc.so.6 #2 0x00007f76d1f976a6 in malloc () from /lib64/libc.so.6 #3 0x00000000004b07a5 in ?? () #4 0x00000000004b18b1 in ?? () #5 0x0000000000431235 in ?? () #6 0x0000000000432195 in ?? () #7 0x0000000000433be0 in ?? () #8 0x00000000004340fe in ?? () #9 0x000000000042c6fa in ?? () #10 0x000000000042e9be in ?? () #11 0x000000000042ecba in ?? () #12 0x0000000000494661 in ?? () #13 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #14 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f76af5fe700 (LWP 2227)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004946b1 in ?? () #4 0x000000000042ecc2 in ?? () #5 0x0000000000494661 in ?? () #6 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f76aebfd700 (LWP 2228)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004946b1 in ?? () #4 0x000000000042ecc2 in ?? () #5 0x0000000000494661 in ?? () #6 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f76ae1fc700 (LWP 2229)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004946b1 in ?? () #4 0x000000000042ecc2 in ?? () #5 0x0000000000494661 in ?? () #6 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f76ad7fb700 (LWP 2230)): #0 0x00007f76d1ffc0d3 in poll () from /lib64/libc.so.6 #1 0x00000000004ae1f3 in ?? () #2 0x00000000004a11d1 in ?? () #3 0x00000000004946b1 in ?? () #4 0x000000000042ecc2 in ?? () #5 0x0000000000494661 in ?? () #6 0x00007f76d1d079d1 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f76d20058fd in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f76d2f999c0 (LWP 2167)): #0 0x00007f76d1d0ac50 in pthread_rwlock_wrlock () from /lib64/libpthread.so.0 #1 0x0000000000495320 in ?? () #2 0x0000000000421579 in ?? () #3 0x0000000000414f72 in ?? () #4 0x0000000000405aad in ?? () #5 0x000000000040c987 in ?? () #6 0x000000000040e045 in ?? () #7 0x00007f76d1f3bd5d in __libc_start_main () from /lib64/libc.so.6 #8 0x0000000000405009 in ?? () #9 0x00007fff08c23248 in ?? () #10 0x000000000000001c in ?? () #11 0x000000000000000b in ?? () #12 0x0000000000eec490 in ?? () #13 0x0000000000eec4e0 in ?? () #14 0x0000000000eec500 in ?? () #15 0x0000000000eec520 in ?? () #16 0x0000000000eec540 in ?? () #17 0x0000000000eec560 in ?? () #18 0x0000000000eec580 in ?? () #19 0x0000000000eec5c0 in ?? () #20 0x0000000000eec600 in ?? () #21 0x0000000000eec620 in ?? () #22 0x0000000000eec4b0 in ?? () #23 0x0000000000000000 in ?? () (gdb) quit A debugging session is active. Inferior 1 [process 2167] will be detached. Quit anyway? (y or n) Detaching from program: /usr/sbin/ovs-vswitchd, process 2167
_______________________________________________ discuss mailing list [email protected] http://openvswitch.org/mailman/listinfo/discuss
