Hi All, I found out that one of the worker threads is stuck at a place, thus causing this issue:
*#0 0x00002b95c2bcda2d in accept () from /lib64/libpthread.so.0* *#1 0x00002b9703e026c8 in vfio_mp_sync_thread (arg=<optimized out>)* *#2 0x00002b95c2bc6dd5 in start_thread () from /lib64/libpthread.so.0* *#3 0x00002b95c30ddb3d in clone () from /lib64/libc.so.6* I see on my setup that these two drivers are loaded : vfio and vfio_iommu_type1 Can anyone tell if this could be causing some issue? Would the issue go away if I remove these? Regards, Siddarth On Tue, Oct 23, 2018 at 4:22 PM siddarth rai <sid...@gmail.com> wrote: > Hi all, > I am facing occasional VPP crash from > vlib_worker_thread_barrier_sync_int(). There was hardly any load on VPP > when this happened > I am using VPP version v18.01.1-100~g3a6948c. Upgrading to a newer > version is not an option for me currently. > > Here is the backtrace: > > *#0 0x00002b95c3015207 in raise () from /lib64/libc.so.6* > *#1 0x00002b95c30168f8 in abort () from /lib64/libc.so.6* > *#2 0x0000000000405ef3 in os_panic ()* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vpp/vnet/main.c:268* > *#3 0x00002b95c111560a in vlib_worker_thread_barrier_sync_int > (vm=0x2b95c1345260 <vlib_global_main>)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlib/threads.c:1480* > *#4 0x00002b95c0e90d3a in vl_msg_api_handler_with_vm_node > (am=0x2b95c10c14a0 <api_main>, the_msg=0x3026f5ac, vm=0x2b95c1345260 > <vlib_global_main>,* > * node=<optimized out>)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlibapi/api_shared.c:506* > *#5 0x00002b95c0ea02ec in memclnt_process (vm=0x2b95c1345260 > <vlib_global_main>, node=0x2b95c6070000, f=<optimized out>)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlibmemory/memory_vlib.c:983* > *#6 0x00002b95c10f1656 in vlib_process_bootstrap (_a=<optimized out>)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlib/main.c:1231* > *#7 0x00002b95c245c838 in clib_calljmp ()* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vppinfra/longjmp.S:110* > *#8 0x00002b95c5edfe30 in ?? ()* > *#9 0x00002b95c10f2999 in vlib_process_startup (f=0x0, p=0x2b95c6070000, > vm=0x2b95c1345260 <vlib_global_main>)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlib/main.c:1253* > *#10 dispatch_process (vm=0x2b95c1345260 <vlib_global_main>, > p=0x2b95c6070000, last_time_stamp=39202939357732, f=0x0)* > * at > /bfs-build/build-area.47/builds/LinuxNBngp_mainline_RH7/2018-10-15-1924/third-party/vpp/vpp_1801/build-data/../src/vlib/main.c:1296* > *#11 0x0000000c00000000 in ?? ()* > *#12 0x000000050000000c in ?? ()* > *#13 0x0000000000000000 in ?? ()* > > Any help will be greatly appreciated. > > Regards, > Siddarth >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#10943): https://lists.fd.io/g/vpp-dev/message/10943 Mute This Topic: https://lists.fd.io/mt/27567149/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
