On 2017-11-28 12:01, Lars Volker <l...@cloudera.com> wrote: > Can you post the output of dump_breakpad_symbols.py and stderr of > minidump_stackwalk? > > Cheers, Lars > > On Mon, Nov 27, 2017 at 10:24 PM, sanysand...@gmail.com < > sanysand...@gmail.com> wrote: > > > > > > > On 2017-11-28 10:03, Sailesh Mukil <sail...@cloudera.com> wrote: > > > Hi Sandish, > > > > > > Have you tried the steps outlined here? > > > https://cwiki.apache.org/confluence/display/IMPALA/ > > Debugging+Impala+Minidumps > > > > > > If it still doesn't work, as Brock mentioned, please paste portions of > > > errors or any other helpful output that you see. > > > > > > - Sailesh > > > > > > > > > > > > On Mon, Nov 27, 2017 at 8:23 PM, Brock Noland <br...@phdata.io> wrote: > > > > > > > Hi Sandish, > > > > > > > > I don't know how to help you, but I think it'd be useful if you shared > > a > > > > portion of the results file for folks to look at. Note that attachments > > > > don't work well so I'd just paste a portion of it inline. > > > > > > > > On Mon, Nov 27, 2017 at 9:15 PM, sanysand...@gmail.com < > > > > sanysand...@gmail.com> wrote: > > > > > > > > > Hi Team, > > > > > > > > > > I'm trying to get minidump_stackwalk results with dump breakpad > > symbols, > > > > > but symbols are not showing in results file, below are the steps > > which I > > > > > followed. Can someone verify or give me steps to get symbols in > > > > > minidump_stackwalk results ?? > > > > > > > > > > > > > > > Steps: > > > > > dump_breakpad_symbols.py -b be/build/ --dump_syms > > > > > $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e613457e > > > > 55f1aecb60-p3/bin/dump_syms > > > > > -d /tmp/syms > > > > > > > > > > $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e61345 > > > > > 7e55f1aecb60-p3/bin/minidump_stackwalk <minidump-filename>.dmp > > /tmp/syms > > > > > > /tmp/resolved.txt > > > > > > > > > > > > > > > > Brock, here is the content of /tmp/resolved.txt file > > ----------------------------------------------------- > > Operating system: Linux > > 0.0.0 Linux 3.10.0-514.21.1.el7.x86_64 #1 SMP Sat Apr 22 > > 02:41:35 EDT 2017 x86_64 > > CPU: amd64 > > family 6 model 63 stepping 2 > > 36 CPUs > > > > GPU: UNKNOWN > > > > Crash reason: SIGSEGV > > Crash address: 0x10 > > Process uptime: not available > > > > Thread 72 (crashed) > > 0 0x7fdb5e2fdbd0 > > rax = 0x000000001e17e560 rdx = 0x0000000017382a10 > > rcx = 0x0000000000000000 rbx = 0x0000000000000000 > > rsi = 0x00000000044520c0 rdi = 0x0000000000000000 > > rbp = 0x00007fd914150880 rsp = 0x00007fdaef212a78 > > r8 = 0x00007fdb5df7b938 r9 = 0x0000000000000020 > > r10 = 0x0000000000000019 r11 = 0x0000000000000000 > > r12 = 0x00007fdaef212c04 r13 = 0x0000000000000001 > > r14 = 0x00007fd913584800 r15 = 0x0000000000000049 > > rip = 0x00007fdb5e2fdbd0 > > Found by: given as instruction pointer in context > > > > Thread 0 > > 0 0x7fdb5e2ff6d5 > > rax = 0xfffffffffffffe00 rdx = 0x0000000000000001 > > rcx = 0xffffffffffffffff rbx = 0x0000000000000000 > > rsi = 0x0000000000000080 rdi = 0x000000000c505a84 > > rbp = 0x000000000c505a58 rsp = 0x00007fff3d583880 > > r8 = 0x000000000c505a00 r9 = 0x0000000000000000 > > r10 = 0x0000000000000000 r11 = 0x0000000000000246 > > r12 = 0x000000000c505a80 r13 = 0x0000000000000000 > > r14 = 0x00007fff3d583950 r15 = 0x0000000000000000 > > rip = 0x00007fdb5e2ff6d5 > > Found by: given as instruction pointer in context > > > > Thread 1 > > 0 0xbaa07c > > rax = 0x0000000000000000 rdx = 0x0000000000000000 > > rcx = 0x0000000002734990 rbx = 0x00007fd9d5b190c0 > > rsi = 0x0000000000000000 rdi = 0x0000000071494d40 > > rbp = 0x00000000000001f6 rsp = 0x00007fdb5c4c1bd0 > > r8 = 0x7ffffffffffffffe r9 = 0x7fffffffffffffff > > r10 = 0x0000000000000008 r11 = 0x0000000000000008 > > r12 = 0x0000000000000000 r13 = 0x000000000c7dd6b0 > > r14 = 0x00000000000001f6 r15 = 0x0000000000000001 > > rip = 0x0000000000baa07c > > Found by: given as instruction pointer in context > > > > Thread 2 > > 0 0x7fdb5e302bdd > > rax = 0xfffffffffffffdfc rdx = 0x0000000000336ff8 > > rcx = 0xffffffffffffffff rbx = 0x0000000000000062 > > rsi = 0x0000000000000000 rdi = 0x00007fdb5aee1b90 > > rbp = 0x00007fdb5aee3a60 rsp = 0x00007fdb5aee1b80 > > r8 = 0x0000000000336ff8 r9 = 0x00007fdb5aee15f0 > > r10 = 0x0000000000000000 r11 = 0x0000000000000293 > > r12 = 0x0000000004b92990 r13 = 0x0000000000000000 > > r14 = 0x00007fdb5aee1c50 r15 = 0x00007fdb5ed326a0 > > rip = 0x00007fdb5e302bdd > > Found by: given as instruction pointer in context > > 1 0xbdd2d9 > > rbp = 0x00007fdb5aee3cc0 rsp = 0x00007fdb5aee3a70 > > rip = 0x0000000000bdd2d9 > > Found by: previous frame's frame pointer > > 2 0xbddcb4 > > rbp = 0x00007fdb5aee3ce0 rsp = 0x00007fdb5aee3cd0 > > rip = 0x0000000000bddcb4 > > Found by: previous frame's frame pointer > > > > Thread 3 > > 0 0x7fdb5dff166d > > rax = 0xfffffffffffffdfc rdx = 0x0000000000000000 > > rcx = 0xffffffffffffffff rbx = 0x00007fdb5a6e2850 > > rsi = 0x00007fdb5a6e2840 rdi = 0x00007fdb5a6e2840 > > rbp = 0x00000000ffffffff rsp = 0x00007fdb5a6e2830 > > r8 = 0x00007fdb5a6e2950 r9 = 0x00007fdb5a6e2790 > > r10 = 0x0000000000000008 r11 = 0x0000000000000293 > > r12 = 0x00007fdb5a6e28d0 r13 = 0x0000000002862290 > > r14 = 0x00007fdb5a6e2a28 r15 = 0x00007fdb5a6e2a20 > > rip = 0x00007fdb5dff166d > > Found by: given as instruction pointer in context > > > > Thread 4 > > 0 0x7fdb5e302bdd > > rax = 0xfffffffffffffdfc rdx = 0x0000000000000000 > > rcx = 0xffffffffffffffff rbx = 0x0000000065b7e564 > > rsi = 0x0000000000000000 rdi = 0x00007fdb59ee19e0 > > rbp = 0x00007fdb59ee1a20 rsp = 0x00007fdb59ee19d0 > > r8 = 0x00000000001a0a36 r9 = 0x0000000000000002 > > r10 = 0x0000000000000008 r11 = 0x0000000000000293 > > r12 = 0x0000000065b7e564 r13 = 0x00000000027161c0 > > r14 = 0x00000000027161d0 r15 = 0x00007fdb59ee1a10 > > rip = 0x00007fdb5e302bdd > > Found by: given as instruction pointer in context > > > > Thread 5 > > 0 0x7fdb5e2ff6d5 > > rax = 0xfffffffffffffe00 rdx = 0x0000000000000e59 > > rcx = 0xffffffffffffffff rbx = 0x0000000004b59950 > > rsi = 0x0000000000000080 rdi = 0x0000000004b59954 > > rbp = 0x00007fdb61454b20 rsp = 0x00007fdb61454ad0 > > r8 = 0x0000000004b59900 r9 = 0x000000000000072c > > r10 = 0x0000000000000000 r11 = 0x0000000000000246 > > r12 = 0x0000000004b59900 r13 = 0x0000000004b59928 > > r14 = 0x00007fdb607e5dc0 r15 = 0x0000000000000000 > > rip = 0x00007fdb5e2ff6d5 > > Found by: given as instruction pointer in context > > 1 0x7fdb60111e27 > > rbp = 0x00007fdb61454b60 rsp = 0x00007fdb61454b30 > > rip = 0x00007fdb60111e27 > > Found by: previous frame's frame pointer > > 2 0x7fdb60112746 > > rbp = 0x00007fdb61454bb0 rsp = 0x00007fdb61454b70 > > rip = 0x00007fdb60112746 > > Found by: previous frame's frame pointer > > 3 0x7fdb5fe0dd53 > > rbp = 0x00007fdb61454bf0 rsp = 0x00007fdb61454bc0 > > rip = 0x00007fdb5fe0dd53 > > Found by: previous frame's frame pointer > > 4 0x7fdb5fe0ebe8 > > rbp = 0x00007fdb61454d00 rsp = 0x00007fdb61454c00 > > rip = 0x00007fdb5fe0ebe8 > > Found by: previous frame's frame pointer > > 5 0x7fdb60157b88 > > rbp = 0x00007fdb61454d50 rsp = 0x00007fdb61454d10 > > rip = 0x00007fdb60157b88 > > Found by: previous frame's frame pointer > > > > Thread 6 > > >
Hi Lars Volker, Output of dump_breakpad_symbols.py: [ec2-user@jenkins ~]$ ls -lrth /tmp/syms/ total 0 drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libgutil.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCatalog.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCodeGen.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 instruction-counter-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 llvm-codegen-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libGlobalFlags.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCommon.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 atomic-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libExec.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 parquet-version-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 zigzag-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 read-write-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 incr-stats-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 parquet-plain-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 delimited-text-parser-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 hash-table-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 row-batch-list-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 hdfs-avro-scanner-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libExprs.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 aggregate-functions-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 expr-codegen-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 expr-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libsecurity.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libtoken_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 librpc_introspection_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 librpc_header_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkrpc.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libversion_info_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libhistogram_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libutil_compression_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkudu_util.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libmaintenance_manager_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkudu_util_compression.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libpb_util_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libRuntime.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 string-compare-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 timestamp-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-value-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-buffer-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 decimal-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 free-pool-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-search-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 disk-io-mgr-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 raw-value-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 thread-resource-mgr-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 disk-io-mgr-stress-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 hdfs-fs-cache-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 row-batch-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 multi-precision-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 mem-pool-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 mem-tracker-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffered-tuple-stream-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 tmp-file-mgr-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 collection-value-builder-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 row-batch-serialize-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 data-stream-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libBufferPool.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 reservation-tracker-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 suballocator-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 free-list-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffer-allocator-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffer-pool-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 backend-config-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 scheduler-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libStatestore.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 statestore-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libService.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 impalad drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 hs2-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 query-options-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 session-expiry-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libfesupport.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUtil.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUdfs.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUdas.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 librpc_test_proto.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libRpc.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 thrift-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 authentication-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 rpc-mgr-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 thrift-server-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libUdf.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libImpalaUdf.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uda-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 udf-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libudasample.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libudfsample.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uda-sample-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 udf-sample-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libUtil.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 thread-pool-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 webserver-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 symbols-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 runtime-profile-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 rle-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 proc-info-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 promise-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 parse-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 coding-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 benchmark-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-unconfigured-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 time-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bit-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 decompress-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libloggingsupport.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bit-packing-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bloom-filter-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 internal-queue-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 debug-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 error-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 parquet-reader drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 filesystem-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 fixed-size-hash-table-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 pretty-printer-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 string-parser-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 blocking-queue-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 hdfs-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bitmap-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-config-parser-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 logging-support-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uid-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 lru-cache-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 dict-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 openssl-util-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 metrics-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libThriftSaslTransport.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-search-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bitmap-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atof-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 tuple-layout-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bswap-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 thread-create-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bit-packing-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atoi-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-compare-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 lock-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bloom-filter-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atod-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 rle-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 row-batch-serialize-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 parse-timestamp-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 multiint-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 int-hash-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 free-lists-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 overflow-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 in-predicate-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 scheduler-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 network-perf-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 status-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 hash-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 expr-benchmark drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 libExperiments.so drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 hash-partition-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-search-sse-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 compression-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 tuple-splitter-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 data-provider-test drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 libImpalaThrift.so Stderr of minidump_stackwalk: [ec2-user@jenkins breakpad-1b704857f1e78a864e6942e613457e55f1aecb60-p3]$ $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e613457e55f1aecb60-p3/bin/minidump_stackwalk /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp /tmp/syms > /tmp/resolved.txt 2017-11-28 00:42:10: minidump.cc:4811: INFO: Minidump opened minidump /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp 2017-11-28 00:42:10: minidump.cc:4931: INFO: Minidump not byte-swapping minidump 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 15 not present 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 1197932545 not present 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 1197932546 not present 2017-11-28 00:42:10: minidump.cc:2721: ERROR: MinidumpModuleList could not store module 57/58, linux-gate.so, 0x7fff3d5f8000+0x0, after adjusting 2017-11-28 00:42:10: minidump.cc:5437: ERROR: GetStream could not read stream type 4 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 14 not present 2017-11-28 00:42:10: minidump_processor.cc:152: INFO: Found 962 memory regions. 2017-11-28 00:42:10: minidump_processor.cc:162: INFO: Minidump /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp has CPU info, OS info, no Breakpad info, exception, no module list, thread list, no dump thread, requesting thread, and no process create time 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:0/961 id 0xba18 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump.cc:1308: INFO: MinidumpMemoryRegion request out of range: 0xc505a60+8/0x7fff3d583000+0x8000 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:1/961 id 0xba57 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:2/961 id 0xba58 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:3/961 id 0xba5b 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:4/961 id 0xba5c 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:5/961 id 0xba5d 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:6/961 id 0xba5e 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:7/961 id 0xba5f 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:8/961 id 0xba60 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:9/961 id 0xba61 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:10/961 id 0xba62 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:11/961 id 0xba63 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:12/961 id 0xba64 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:13/961 id 0xba65 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:14/961 id 0xba66 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:15/961 id 0xba67 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:16/961 id 0xba68 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like AMD64 context