Thanks, Sandish, All the way at the bottom of the resolved minidump you should find a list of modules that breakpad tried to access when resolving the symbols. If you don't have the symbols for the right binary, you'll find a line like this:
0x00400000 - 0x02759fff impalad ??? (main) (WARNING: No symbols, impalad, 80F4346224A2670E0C8632FE78B405510) If your symbols match, the (WARNING...) part will not be there. That hash in the warning identifies the binary, and your syms/impalad folder needs to have symbols for that hash: $ find syms/impalad syms/impalad syms/impalad/1975CC59C4F6B26C3BDDF2B51A9694500 syms/impalad/1975CC59C4F6B26C3BDDF2B51A9694500/impalad.sym syms/impalad/80F4346224A2670E0C8632FE78B405510 syms/impalad/80F4346224A2670E0C8632FE78B405510/impalad.sym Can you double check that you have matching symbols for your minidump? If that doesn't get you anywhere, can you please describe step-by-step what you did? Cheers, Lars On Nov 27, 2017 22:44, "sanysand...@gmail.com" <sanysand...@gmail.com> wrote: > > > On 2017-11-28 12:01, Lars Volker <l...@cloudera.com> wrote: > > Can you post the output of dump_breakpad_symbols.py and stderr of > > minidump_stackwalk? > > > > Cheers, Lars > > > > On Mon, Nov 27, 2017 at 10:24 PM, sanysand...@gmail.com < > > sanysand...@gmail.com> wrote: > > > > > > > > > > > On 2017-11-28 10:03, Sailesh Mukil <sail...@cloudera.com> wrote: > > > > Hi Sandish, > > > > > > > > Have you tried the steps outlined here? > > > > https://cwiki.apache.org/confluence/display/IMPALA/ > > > Debugging+Impala+Minidumps > > > > > > > > If it still doesn't work, as Brock mentioned, please paste portions > of > > > > errors or any other helpful output that you see. > > > > > > > > - Sailesh > > > > > > > > > > > > > > > > On Mon, Nov 27, 2017 at 8:23 PM, Brock Noland <br...@phdata.io> > wrote: > > > > > > > > > Hi Sandish, > > > > > > > > > > I don't know how to help you, but I think it'd be useful if you > shared > > > a > > > > > portion of the results file for folks to look at. Note that > attachments > > > > > don't work well so I'd just paste a portion of it inline. > > > > > > > > > > On Mon, Nov 27, 2017 at 9:15 PM, sanysand...@gmail.com < > > > > > sanysand...@gmail.com> wrote: > > > > > > > > > > > Hi Team, > > > > > > > > > > > > I'm trying to get minidump_stackwalk results with dump breakpad > > > symbols, > > > > > > but symbols are not showing in results file, below are the steps > > > which I > > > > > > followed. Can someone verify or give me steps to get symbols in > > > > > > minidump_stackwalk results ?? > > > > > > > > > > > > > > > > > > Steps: > > > > > > dump_breakpad_symbols.py -b be/build/ --dump_syms > > > > > > $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e613457e > > > > > 55f1aecb60-p3/bin/dump_syms > > > > > > -d /tmp/syms > > > > > > > > > > > > $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e61345 > > > > > > 7e55f1aecb60-p3/bin/minidump_stackwalk <minidump-filename>.dmp > > > /tmp/syms > > > > > > > /tmp/resolved.txt > > > > > > > > > > > > > > > > > > > > > Brock, here is the content of /tmp/resolved.txt file > > > ----------------------------------------------------- > > > Operating system: Linux > > > 0.0.0 Linux 3.10.0-514.21.1.el7.x86_64 #1 SMP Sat > Apr 22 > > > 02:41:35 EDT 2017 x86_64 > > > CPU: amd64 > > > family 6 model 63 stepping 2 > > > 36 CPUs > > > > > > GPU: UNKNOWN > > > > > > Crash reason: SIGSEGV > > > Crash address: 0x10 > > > Process uptime: not available > > > > > > Thread 72 (crashed) > > > 0 0x7fdb5e2fdbd0 > > > rax = 0x000000001e17e560 rdx = 0x0000000017382a10 > > > rcx = 0x0000000000000000 rbx = 0x0000000000000000 > > > rsi = 0x00000000044520c0 rdi = 0x0000000000000000 > > > rbp = 0x00007fd914150880 rsp = 0x00007fdaef212a78 > > > r8 = 0x00007fdb5df7b938 r9 = 0x0000000000000020 > > > r10 = 0x0000000000000019 r11 = 0x0000000000000000 > > > r12 = 0x00007fdaef212c04 r13 = 0x0000000000000001 > > > r14 = 0x00007fd913584800 r15 = 0x0000000000000049 > > > rip = 0x00007fdb5e2fdbd0 > > > Found by: given as instruction pointer in context > > > > > > Thread 0 > > > 0 0x7fdb5e2ff6d5 > > > rax = 0xfffffffffffffe00 rdx = 0x0000000000000001 > > > rcx = 0xffffffffffffffff rbx = 0x0000000000000000 > > > rsi = 0x0000000000000080 rdi = 0x000000000c505a84 > > > rbp = 0x000000000c505a58 rsp = 0x00007fff3d583880 > > > r8 = 0x000000000c505a00 r9 = 0x0000000000000000 > > > r10 = 0x0000000000000000 r11 = 0x0000000000000246 > > > r12 = 0x000000000c505a80 r13 = 0x0000000000000000 > > > r14 = 0x00007fff3d583950 r15 = 0x0000000000000000 > > > rip = 0x00007fdb5e2ff6d5 > > > Found by: given as instruction pointer in context > > > > > > Thread 1 > > > 0 0xbaa07c > > > rax = 0x0000000000000000 rdx = 0x0000000000000000 > > > rcx = 0x0000000002734990 rbx = 0x00007fd9d5b190c0 > > > rsi = 0x0000000000000000 rdi = 0x0000000071494d40 > > > rbp = 0x00000000000001f6 rsp = 0x00007fdb5c4c1bd0 > > > r8 = 0x7ffffffffffffffe r9 = 0x7fffffffffffffff > > > r10 = 0x0000000000000008 r11 = 0x0000000000000008 > > > r12 = 0x0000000000000000 r13 = 0x000000000c7dd6b0 > > > r14 = 0x00000000000001f6 r15 = 0x0000000000000001 > > > rip = 0x0000000000baa07c > > > Found by: given as instruction pointer in context > > > > > > Thread 2 > > > 0 0x7fdb5e302bdd > > > rax = 0xfffffffffffffdfc rdx = 0x0000000000336ff8 > > > rcx = 0xffffffffffffffff rbx = 0x0000000000000062 > > > rsi = 0x0000000000000000 rdi = 0x00007fdb5aee1b90 > > > rbp = 0x00007fdb5aee3a60 rsp = 0x00007fdb5aee1b80 > > > r8 = 0x0000000000336ff8 r9 = 0x00007fdb5aee15f0 > > > r10 = 0x0000000000000000 r11 = 0x0000000000000293 > > > r12 = 0x0000000004b92990 r13 = 0x0000000000000000 > > > r14 = 0x00007fdb5aee1c50 r15 = 0x00007fdb5ed326a0 > > > rip = 0x00007fdb5e302bdd > > > Found by: given as instruction pointer in context > > > 1 0xbdd2d9 > > > rbp = 0x00007fdb5aee3cc0 rsp = 0x00007fdb5aee3a70 > > > rip = 0x0000000000bdd2d9 > > > Found by: previous frame's frame pointer > > > 2 0xbddcb4 > > > rbp = 0x00007fdb5aee3ce0 rsp = 0x00007fdb5aee3cd0 > > > rip = 0x0000000000bddcb4 > > > Found by: previous frame's frame pointer > > > > > > Thread 3 > > > 0 0x7fdb5dff166d > > > rax = 0xfffffffffffffdfc rdx = 0x0000000000000000 > > > rcx = 0xffffffffffffffff rbx = 0x00007fdb5a6e2850 > > > rsi = 0x00007fdb5a6e2840 rdi = 0x00007fdb5a6e2840 > > > rbp = 0x00000000ffffffff rsp = 0x00007fdb5a6e2830 > > > r8 = 0x00007fdb5a6e2950 r9 = 0x00007fdb5a6e2790 > > > r10 = 0x0000000000000008 r11 = 0x0000000000000293 > > > r12 = 0x00007fdb5a6e28d0 r13 = 0x0000000002862290 > > > r14 = 0x00007fdb5a6e2a28 r15 = 0x00007fdb5a6e2a20 > > > rip = 0x00007fdb5dff166d > > > Found by: given as instruction pointer in context > > > > > > Thread 4 > > > 0 0x7fdb5e302bdd > > > rax = 0xfffffffffffffdfc rdx = 0x0000000000000000 > > > rcx = 0xffffffffffffffff rbx = 0x0000000065b7e564 > > > rsi = 0x0000000000000000 rdi = 0x00007fdb59ee19e0 > > > rbp = 0x00007fdb59ee1a20 rsp = 0x00007fdb59ee19d0 > > > r8 = 0x00000000001a0a36 r9 = 0x0000000000000002 > > > r10 = 0x0000000000000008 r11 = 0x0000000000000293 > > > r12 = 0x0000000065b7e564 r13 = 0x00000000027161c0 > > > r14 = 0x00000000027161d0 r15 = 0x00007fdb59ee1a10 > > > rip = 0x00007fdb5e302bdd > > > Found by: given as instruction pointer in context > > > > > > Thread 5 > > > 0 0x7fdb5e2ff6d5 > > > rax = 0xfffffffffffffe00 rdx = 0x0000000000000e59 > > > rcx = 0xffffffffffffffff rbx = 0x0000000004b59950 > > > rsi = 0x0000000000000080 rdi = 0x0000000004b59954 > > > rbp = 0x00007fdb61454b20 rsp = 0x00007fdb61454ad0 > > > r8 = 0x0000000004b59900 r9 = 0x000000000000072c > > > r10 = 0x0000000000000000 r11 = 0x0000000000000246 > > > r12 = 0x0000000004b59900 r13 = 0x0000000004b59928 > > > r14 = 0x00007fdb607e5dc0 r15 = 0x0000000000000000 > > > rip = 0x00007fdb5e2ff6d5 > > > Found by: given as instruction pointer in context > > > 1 0x7fdb60111e27 > > > rbp = 0x00007fdb61454b60 rsp = 0x00007fdb61454b30 > > > rip = 0x00007fdb60111e27 > > > Found by: previous frame's frame pointer > > > 2 0x7fdb60112746 > > > rbp = 0x00007fdb61454bb0 rsp = 0x00007fdb61454b70 > > > rip = 0x00007fdb60112746 > > > Found by: previous frame's frame pointer > > > 3 0x7fdb5fe0dd53 > > > rbp = 0x00007fdb61454bf0 rsp = 0x00007fdb61454bc0 > > > rip = 0x00007fdb5fe0dd53 > > > Found by: previous frame's frame pointer > > > 4 0x7fdb5fe0ebe8 > > > rbp = 0x00007fdb61454d00 rsp = 0x00007fdb61454c00 > > > rip = 0x00007fdb5fe0ebe8 > > > Found by: previous frame's frame pointer > > > 5 0x7fdb60157b88 > > > rbp = 0x00007fdb61454d50 rsp = 0x00007fdb61454d10 > > > rip = 0x00007fdb60157b88 > > > Found by: previous frame's frame pointer > > > > > > Thread 6 > > > > > > > Hi Lars Volker, > > Output of dump_breakpad_symbols.py: > > [ec2-user@jenkins ~]$ ls -lrth /tmp/syms/ > total 0 > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libgutil.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCatalog.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCodeGen.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 instruction-counter-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 llvm-codegen-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libGlobalFlags.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libCommon.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 atomic-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libExec.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 parquet-version-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 zigzag-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 read-write-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 incr-stats-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 parquet-plain-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 delimited-text-parser-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 hash-table-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 row-batch-list-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 hdfs-avro-scanner-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libExprs.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 aggregate-functions-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 expr-codegen-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 expr-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libsecurity.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libtoken_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 > librpc_introspection_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 librpc_header_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkrpc.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libversion_info_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libhistogram_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libutil_compression_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkudu_util.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 > libmaintenance_manager_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libkudu_util_compression.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libpb_util_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 libRuntime.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:52 string-compare-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 timestamp-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-value-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-buffer-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 decimal-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 free-pool-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 string-search-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 disk-io-mgr-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 raw-value-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 thread-resource-mgr-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 disk-io-mgr-stress-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 hdfs-fs-cache-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 row-batch-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 multi-precision-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 mem-pool-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 mem-tracker-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffered-tuple-stream-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 tmp-file-mgr-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 > collection-value-builder-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 row-batch-serialize-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 data-stream-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libBufferPool.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 reservation-tracker-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 suballocator-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 free-list-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffer-allocator-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 buffer-pool-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 backend-config-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 scheduler-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libStatestore.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 statestore-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libService.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 impalad > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 hs2-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 query-options-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 session-expiry-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libfesupport.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUtil.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUdfs.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libTestUdas.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 librpc_test_proto.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 libRpc.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 thrift-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 authentication-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:53 rpc-mgr-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 thrift-server-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libUdf.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libImpalaUdf.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uda-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 udf-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libudasample.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libudfsample.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uda-sample-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 udf-sample-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libUtil.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 thread-pool-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 webserver-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 symbols-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 runtime-profile-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 rle-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 proc-info-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 promise-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 parse-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 coding-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 benchmark-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-unconfigured-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 time-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bit-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 decompress-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libloggingsupport.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bit-packing-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bloom-filter-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 internal-queue-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 debug-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 error-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 parquet-reader > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 filesystem-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 fixed-size-hash-table-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 pretty-printer-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 string-parser-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 blocking-queue-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 hdfs-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 bitmap-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 redactor-config-parser-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 logging-support-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 uid-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 lru-cache-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 dict-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 openssl-util-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 metrics-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:54 libThriftSaslTransport.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-search-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bitmap-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atof-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 tuple-layout-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bswap-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 thread-create-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bit-packing-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atoi-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-compare-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 lock-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 bloom-filter-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 atod-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 rle-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 > row-batch-serialize-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 parse-timestamp-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 multiint-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 int-hash-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 free-lists-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 overflow-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 in-predicate-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 scheduler-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 network-perf-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 status-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 hash-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 expr-benchmark > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 libExperiments.so > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 hash-partition-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 string-search-sse-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 compression-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 tuple-splitter-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 data-provider-test > drwxrwxr-x 3 ec2-user ec2-user 46 Nov 27 20:55 libImpalaThrift.so > > Stderr of minidump_stackwalk: > > [ec2-user@jenkins breakpad-1b704857f1e78a864e6942e613457e55f1aecb60-p3]$ > $IMPALA_HOME/toolchain/breakpad-1b704857f1e78a864e6942e61345 > 7e55f1aecb60-p3/bin/minidump_stackwalk > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp > /tmp/syms > /tmp/resolved.txt > 2017-11-28 00:42:10: minidump.cc:4811: INFO: Minidump opened minidump > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp > 2017-11-28 00:42:10: minidump.cc:4931: INFO: Minidump not byte-swapping > minidump > 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 15 not present > 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 1197932545 > not present > 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 1197932546 > not present > 2017-11-28 00:42:10: minidump.cc:2721: ERROR: MinidumpModuleList could not > store module 57/58, linux-gate.so, 0x7fff3d5f8000+0x0, after adjusting > 2017-11-28 00:42:10: minidump.cc:5437: ERROR: GetStream could not read > stream type 4 > 2017-11-28 00:42:10: minidump.cc:5414: INFO: GetStream: type 14 not present > 2017-11-28 00:42:10: minidump_processor.cc:152: INFO: Found 962 memory > regions. > 2017-11-28 00:42:10: minidump_processor.cc:162: INFO: Minidump > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp has CPU info, OS > info, no Breakpad info, exception, no module list, thread list, no dump > thread, requesting thread, and no process create time > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:0/961 id 0xba18 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump.cc:1308: INFO: MinidumpMemoryRegion request > out of range: 0xc505a60+8/0x7fff3d583000+0x8000 > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:1/961 id 0xba57 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:2/961 id 0xba58 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:3/961 id 0xba5b > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:4/961 id 0xba5c > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:5/961 id 0xba5d > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:6/961 id 0xba5e > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:7/961 id 0xba5f > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:8/961 id 0xba60 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:9/961 id 0xba61 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:10/961 id 0xba62 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:11/961 id 0xba63 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:12/961 id 0xba64 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:13/961 id 0xba65 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:14/961 id 0xba66 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:15/961 id 0xba67 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > 2017-11-28 00:42:10: minidump_processor.cc:201: INFO: Looking at thread > /home/ec2-user/64811560-8bae-a67f-22f961c1-45bf52a3.dmp:16/961 id 0xba68 > 2017-11-28 00:42:10: minidump.cc:452: INFO: MinidumpContext: looks like > AMD64 context > >