Hans Zeller created TRAFODION-1910: -------------------------------------- Summary: mxosrvr crashes on Hive query after reconnect Key: TRAFODION-1910 URL: https://issues.apache.org/jira/browse/TRAFODION-1910 Project: Apache Trafodion Issue Type: Bug Components: sql-exe Affects Versions: 1.3-incubating Reporter: Hans Zeller Assignee: Hans Zeller
This is a problem Wei-Shiun found when running tests with many connections that use Hive queries. He sees intermittent core dumps with this stack trace: #0 0x00007f47cb0dd625 in raise () from /lib64/libc.so.6 0000001 0x00007f47cb0ded8d in abort () from /lib64/libc.so.6 0000002 0x00007f47cc613a55 in os::abort(bool) () from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so 0000003 0x00007f47cc793f87 in VMError::report_and_die() () from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so 0000004 0x00007f47cc61896f in JVM_handle_linux_signal () from /usr/java/jdk1.7.0_67-cloudera/jre/lib/amd64/server/libjvm.so 0000005 <signal handler called> 0000006 0x00007f47c92bd5ee in HiveMetaData::recordError (this=0x7f47a5e50088, errCode=122, errMethodName=0x7f47c935aaa3 "HiveClient_JNI::getTableStr()") at ../executor/hiveHook.cpp:228 0000007 0x00007f47c92bf613 in HiveMetaData::getTableDesc (this=0x7f47a5e50088, schemaName=0x7f47b858e798 "mytest5", tblName=0x7f47b858e7c8 "mytable") at ../executor/hiveHook.cpp:806 0000008 0x00007f47c4056307 in NATableDB::get (this=0x7f47b652d3c0, corrName=..., bindWA=0x7f47b85912d0, inTableDescStruct=<value optimized out>) at ../optimizer/NATable.cpp:8377 0000009 0x00007f47c3db0743 in BindWA::getNATable (this=0x7f47b85912d0, corrName=..., catmanCollectTableUsages=1, inTableDescStruct=0x0) at ../optimizer/BindRelExpr.cpp:1514 0000010 0x00007f47c3db3290 in Describe::bindNode (this=0x7f47a2aae440, bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:13565 0000011 0x00007f47c3d989f7 in RelExpr::bindChildren (this=0x7f47a2aaf5f8, bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:2258 0000012 0x00007f47c3dccbce in RelRoot::bindNode (this=0x7f47a2aaf5f8, bindWA=0x7f47b85912d0) at ../optimizer/BindRelExpr.cpp:5204 0000013 0x00007f47c577e84e in CmpMain::compile (this=0x7f47b8593c40, input_str=0x7f47a5e0b690 "showddl mytable", charset=15, queryExpr=@0x7f47b8593b78, gen_code=0x7f47a5e0c1a8, gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00, phase=CmpMain::END, fragmentDir=0x7f47b8593d98, op=3004, useQueryCache=1, cacheable=0x7f47b8593b88, begTime=0x7f47b8593b60, shouldLog=0) at ../sqlcomp/CmpMain.cpp:2071 0000014 0x00007f47c578168c in CmpMain::sqlcomp (this=0x7f47b8593c40, input_str=0x7f47a5e0b690 "showddl mytable", charset=15, queryExpr=@0x7f47b8593b78, gen_code=0x7f47a5e0c1a8, gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00, phase=CmpMain::END, fragmentDir=0x7f47b8593d98, op=3004, useQueryCache=1, cacheable=0x7f47b8593b88, begTime=0x7f47b8593b60, shouldLog=0) at ../sqlcomp/CmpMain.cpp:1684 0000015 0x00007f47c5782998 in CmpMain::sqlcomp (this=0x7f47b8593c40, input=..., gen_code=0x7f47a5e0c1a8, gen_code_len=0x7f47a5e0c1a0, heap=0x7f47b70bbc00, phase=CmpMain::END, fragmentDir=0x7f47b8593d98, op=3004) at ../sqlcomp/CmpMain.cpp:819 0000016 0x00007f47c33a8898 in CmpStatement::process (this=0x7f47a5e52f10, sqltext=<value optimized out>) at ../arkcmp/CmpStatement.cpp:499 0000017 0x00007f47c339b48c in CmpContext::compileDirect (this=0x7f47b6525090, data=0x7f47b7112db8 "\200", data_len=144, outHeap=0x7f47b7b2e128, charset=15, op=CmpMessageObj::SQLTEXT_COMPILE, gen_code=@0x7f47b8594320, gen_code_len=@0x7f47b8594328, parserFlags=4194304, parentQid=0x0, parentQidLen=0, diagsArea=0x7f47b7112e50) at ../arkcmp/CmpContext.cpp:841 0000018 0x00007f47caa0dd38 in CliStatement::prepare2 (this=0x7f47b70d4028, source=0x7f47b711ab18 "showddl mytable", diagsArea=..., passed_gen_code=<value optimized out>, passed_gen_code_len=3081953576, charset=15, unpackTdbs=1, cliFlags=129) at ../cli/Statement.cpp:1775 0000019 0x00007f47ca9bac94 in SQLCLI_Prepare2 (cliGlobals=0x27bcbb0, statement_id=0x370a9c8, sql_source=0x7f47b8594610, gencode_ptr=0x0, gencode_len=0, ret_gencode_len=0x0, query_cost_info=0x370abf8, query_comp_stats_info=0x370ac48, uniqueStmtId=<value optimized out>, uniqueStmtIdLen=0x370ab2c, flags=1) at ../cli/Cli.cpp:5927 0000020 0x00007f47caa1b1ae in SQL_EXEC_Prepare2 (statement_id=0x370a9c8, sql_source=0x7f47b8594610, gencode_ptr=0x0, gencode_len=0, ret_gencode_len=0x0, query_cost_info=0x370abf8, comp_stats_info=0x370ac48, uniqueStmtId=0x370ab30 "", uniqueStmtIdLen=0x370ab2c, flags=1) at ../cli/CliExtern.cpp:5034 0000021 0x00007f47cd4e31d9 in SRVR::WSQL_EXEC_Prepare2 (statement_id=0x370a9c8, sql_source=<value optimized out>, gencode_ptr=<value optimized out>, gencode_len=<value optimized out>, ret_gencode_len=<value optimized out>, query_cost_info=<value optimized out>, comp_stats_info=0x370ac48, uniqueQueryId=0x370ab30 "", uniqueQueryIdLen=0x370ab2c, flags=1) at SQLWrapper.cpp:803 0000022 0x00007f47cd4d7b45 in SRVR::PREPARE2 (pSrvrStmt=0x370a3b0, isFromExecDirect=248) at sqlinterface.cpp:5057 0000023 0x00007f47cd508370 in odbc_SQLSvc_Prepare2_sme_ (inputRowCnt=0, sqlStmtType=1, stmtLabel=<value optimized out>, sqlString=0x2ba7254 "showddl mytable", holdableCursor=0, returnCode=0x7f47b8594b08, sqlWarningOrErrorLength=0x7f47b8594b04, sqlWarningOrError=@0x7f47b8594ae0, sqlQueryType=0x7f47b8594afc, stmtHandle=0x7f47b8594ac0, estimatedCost=0x7f47b8594af8, inputDescLength=0x7f47b8594af0, inputDesc=@0x7f47b8594ad0, outputDescLength=0x7f47b8594aec, outputDesc=@0x7f47b8594ac8, isFromExecDirect=true) at srvrothers.cpp:939 0000024 0x00000000004c6ca2 in odbc_SQLSrvr_ExecDirect_ame_ (objtag_=0x55e6ec0, call_id_=0x55e6f18, dialogueId=259570813, stmtLabel=0x2ba7270 "SQL_CUR_7", cursorName=0x0, stmtExplainLabel=<value optimized out>, stmtType=0, sqlStmtType=1, sqlString=0x2ba7254 "showddl mytable", sqlAsyncEnable=0, queryTimeout=0, inputRowCnt=0, txnID=0, holdableCursor=0) at SrvrConnect.cpp:7894 0000025 0x0000000000495886 in SQLEXECUTE_IOMessage (objtag_=0x55e6ec0, call_id_=0x55e6f18, operation_id=3012) at Interface/odbcs_srvr.cpp:1731 0000026 0x0000000000495934 in DISPATCH_TCPIPRequest (objtag_=0x55e6ec0, call_id_=0x55e6f18, operation_id=<value optimized out>) at Interface/odbcs_srvr.cpp:1796 0000027 0x0000000000434532 in BUILD_TCPIP_REQUEST (pnode=0x55e6ec0) at ../Common/TCPIPSystemSrvr.cpp:606 0000028 0x0000000000434ecd in PROCESS_TCPIP_REQUEST (pnode=0x55e6ec0) at ../Common/TCPIPSystemSrvr.cpp:584 0000029 0x00000000004631a6 in CNSKListenerSrvr::tcpip_listener (arg=0x2663560) at Interface/linux/Listener_srvr_ps.cpp:403 0000030 0x00007f47cae91314 in sb_thread_sthr_disp (pp_arg=0x27a94a0) at threadl.cpp:256 0000031 0x00007f47cac5da51 in start_thread () from /lib64/libpthread.so.0 0000032 0x00007f47cb19393d in clone () from /lib64/libc.so.6 The problem does not happen with sqlci. -- This message was sent by Atlassian JIRA (v6.3.4#6332)