This is the link: https://drive.google.com/file/d/0B0fEocxWi0tWU1hBajQtWWs2dlU/view?usp=sharing
Pierre Smits ORRTIZ.COM <http://www.orrtiz.com> OFBiz based solutions & services OFBiz Extensions Marketplace http://oem.ofbizci.net/oci-2/ On Fri, Apr 1, 2016 at 4:31 PM, Pierre Smits <[email protected]> wrote: > Hi Selva, > > I thought I sent the link to the google drive doc to your email address. I > will have a look at it. > > Best regards, > > Pierre Smits > > ORRTIZ.COM <http://www.orrtiz.com> > OFBiz based solutions & services > > OFBiz Extensions Marketplace > http://oem.ofbizci.net/oci-2/ > > On Fri, Apr 1, 2016 at 4:28 PM, Selva Govindarajan < > [email protected]> wrote: > >> Hi Pierre, >> >> Do you mean the link to the core file? I didn't receive it. I looked at >> the >> JIRA and hs_err_pid50530.log. But I need the core file or reproducible >> test >> case to move further on this issue. >> >> Selva >> >> -----Original Message----- >> From: Pierre Smits [mailto:[email protected]] >> Sent: Thursday, March 31, 2016 12:38 AM >> To: [email protected] >> Subject: Re: problem_with_server_read >> >> Hi Selva, >> >> I have sent you the link to the location of the core log. Did you receive >> it? >> >> Best regards, >> >> Pierre Smits >> >> ORRTIZ.COM <http://www.orrtiz.com> >> OFBiz based solutions & services >> >> OFBiz Extensions Marketplace >> http://oem.ofbizci.net/oci-2/ >> >> On Wed, Mar 30, 2016 at 5:46 PM, Selva Govindarajan < >> [email protected]> wrote: >> >> > Yes. I believe so. >> > >> > Selva >> > >> > -----Original Message----- >> > From: Pierre Smits [mailto:[email protected]] >> > Sent: Wednesday, March 30, 2016 8:46 AM >> > To: [email protected] >> > Subject: Re: problem_with_server_read >> > >> > This warrants a JIRA issue? >> > >> > Best regards, >> > >> > Pierre Smits >> > >> > ORRTIZ.COM <http://www.orrtiz.com> >> > OFBiz based solutions & services >> > >> > OFBiz Extensions Marketplace >> > http://oem.ofbizci.net/oci-2/ >> > >> > On Wed, Mar 30, 2016 at 5:33 PM, Selva Govindarajan < >> > [email protected]> wrote: >> > >> > > Hi Pierre, >> > > >> > > The hs_err log file gives some info. Please send it in. But, we >> > > need the core file to analyze the failure. Can you please upload >> > > this core file in Google drive and allow me to download this file by >> > > sending an email with download link? >> > > >> > > Does anyone know a better way to get this file across? >> > > >> > > Selva >> > > >> > > -----Original Message----- >> > > From: Pierre Smits [mailto:[email protected]] >> > > Sent: Wednesday, March 30, 2016 12:23 AM >> > > To: [email protected] >> > > Subject: Re: problem_with_server_read >> > > >> > > Hi Selva, >> > > >> > > The file at /proc/sys/kernel/core_pattern shows: >> > > >> > > |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e >> > > >> > > >> > > This morning, after a clean restart of both Trafodion and Apache >> > > OFBiz. the same happened again (hanging OFBiz). This seems to be >> > > related to a specific >> > > query: >> > > >> > > SELECT JOB_ID, JOB_NAME, RUN_TIME, POOL_ID, STATUS_ID, >> > > PARENT_JOB_ID, PREVIOUS_JOB_ID, SERVICE_NAME, LOADER_NAME, >> > > MAX_RETRY, CURRENT_RETRY_COUNT, AUTH_USER_LOGIN_ID, RUN_AS_USER, >> > > RUNTIME_DATA_ID, RECURRENCE_INFO_ID, TEMP_EXPR_ID, >> > > CURRENT_RECURRENCE_COUNT, MAX_RECURRENCE_COUNT, RUN_BY_INSTANCE_ID, >> > > START_DATE_TIME, FINISH_DATE_TIME, CANCEL_DATE_TIME, JOB_RESULT, >> > > LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, >> > > CREATED_TX_STAMP FROM OFBIZ.JOB_SANDBOX WHERE (((RUN_TIME <= ? AND >> > > START_DATE_TIME IS NULL AND CANCEL_DATE_TIME IS NULL AND >> > > RUN_BY_INSTANCE_ID IS NULL) AND (POOL_ID IS NULL OR POOL_ID = ?))) >> > > ORDER BY RUN_TIME ASC (The message >> > > id: problem_with_server_read) >> > > >> > > In sqlci I executed a somewhat similar query: >> > > >> > > select * from ofbiz.job_sandbox >> > > >> > > >> > > This resulted in: >> > > >> > > # >> > > # A fatal error has been detected by the Java Runtime Environment: >> > > # >> > > # SIGSEGV (0xb) at pc=0x00007f71e7a1f907, pid=50530, >> > > tid=140127074763584 # # JRE version: Java(TM) SE Runtime Environment >> > > (8.0_40-b25) (build >> > > 1.8.0_40-b25) >> > > # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.40-b25 mixed mode >> > > linux-amd64 compressed oops) >> > > # Problematic frame: >> > > # C [libexecutor.so+0x214907] >> > > ExHbaseAccessTcb::createSQRowFromHbaseFormat(long*)+0x3c7 >> > > # >> > > # Core dump written. Default location: /home/trafodion/core or >> > > core.50530 # # An error report file with more information is saved as: >> > > # /home/trafodion/hs_err_pid50530.log >> > > # >> > > # If you would like to submit a bug report, please visit: >> > > # http://bugreport.java.com/bugreport/crash.jsp >> > > >> > > >> > > The file core.50530 is huge. But the >> > > /home/trafodion/hs_err_pid50530.log is better sized to send via >> > > email (if you want me too). >> > > >> > > Best regards, >> > > >> > > >> > > >> > > Pierre Smits >> > > >> > > ORRTIZ.COM <http://www.orrtiz.com> >> > > OFBiz based solutions & services >> > > >> > > OFBiz Extensions Marketplace >> > > http://oem.ofbizci.net/oci-2/ >> > > >> > > On Tue, Mar 29, 2016 at 8:41 PM, Selva Govindarajan < >> > > [email protected]> wrote: >> > > >> > > > Hi Pierre, >> > > > >> > > > Are you seeing any core dump of the mxosrvr? The core is dumped >> > > > at the location based on /proc/sys/kernel/core_pattern. >> > > > >> > > > Selva >> > > > >> > > > -----Original Message----- >> > > > From: Pierre Smits [mailto:[email protected]] >> > > > Sent: Tuesday, March 29, 2016 11:35 AM >> > > > To: [email protected] >> > > > Subject: Re: problem_with_server_read >> > > > >> > > > This happened also (approx at the same time): >> > > > >> > > > *** glibc detected *** mxosrvr: corrupted double-linked list: >> > > > 0x0000000002f1f000 *** >> > > > >> > > > ======= Backtrace: ========= >> > > > >> > > > /lib64/libc.so.6[0x3e9f275e66] >> > > > >> > > > /lib64/libc.so.6[0x3e9f279d0f] >> > > > >> > > > /lib64/libc.so.6(__libc_malloc+0x71)[0x3e9f27a6b1] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x907445)[0 >> > > > x7 >> > > > fe >> > > > 07382b445] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x2dbeb4)[0 >> > > > x7 >> > > > fe >> > > > 0731ffeb4] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x2dcd46)[0 >> > > > x7 >> > > > fe >> > > > 073200d46] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x2dcf76)[0 >> > > > x7 >> > > > fe >> > > > 073200f76] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x8dda98)[0 >> > > > x7 >> > > > fe >> > > > 073801a98] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x497b9f)[0 >> > > > x7 >> > > > fe >> > > > 0733bbb9f] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x49c44a)[0 >> > > > x7 >> > > > fe >> > > > 0733c044a] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x49df4a)[0 >> > > > x7 >> > > > fe >> > > > 0733c1f4a] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x3ebeb8)[0 >> > > > x7 >> > > > fe >> > > > 07330feb8] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x4a843a)[0 >> > > > x7 >> > > > fe >> > > > 0733cc43a] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x4a93e6)[0 >> > > > x7 >> > > > fe >> > > > 0733cd3e6] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0xa5c96f)[0 >> > > > x7 >> > > > fe >> > > > 07398096f] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0xa5ca9c)[0 >> > > > x7 >> > > > fe >> > > > 073980a9c] >> > > > >> > > > >> > > > /usr/jdk64/jdk1.8.0_40/jre/lib/amd64/server/libjvm.so(+0x910ee8)[0 >> > > > x7 >> > > > fe >> > > > 073834ee8] >> > > > >> > > > /lib64/libpthread.so.0[0x3e9f6079d1] >> > > > >> > > > /lib64/libc.so.6(clone+0x6d)[0x3e9f2e88fd] >> > > > >> > > > ======= Memory map: ======== >> > > > >> > > > 00400000-0051a000 r-xp 00000000 fd:02 4587565 >> > > > /home/trafodion/apache-trafodion-1.3.0-incubating-bin/export/bin64 >> > > > /m >> > > > xo >> > > > srvr >> > > > >> > > > 00719000-0071d000 rw-p 00119000 fd:02 4587565 >> > > > /home/trafodion/apache-trafodion-1.3.0-incubating-bin/export/bin64 >> > > > /m >> > > > xo >> > > > srvr >> > > > >> > > > 0071d000-00741000 rw-p 00000000 00:00 0 >> > > > >> > > > 00fc0000-03e32000 rw-p 00000000 00:00 0 [heap] >> > > > >> > > > 10000000-14000000 rw-s 00000000 00:04 720913 /SYSV10008cfd >> > > > (deleted) >> > > > >> > > > e0000000-e4080000 rw-p 00000000 00:00 0 >> > > > >> > > > e4080000-f5580000 ---p 00000000 00:00 0 >> > > > >> > > > f5580000-100000000 rw-p 00000000 00:00 0 >> > > > >> > > > 100000000-1002a0000 rw-p 00000000 00:00 0 >> > > > >> > > > 1002a0000-140000000 ---p 00000000 00:00 0 >> > > > >> > > > 3be7600000-3be7652000 r-xp 00000000 fd:00 2757384 >> > > > /usr/lib64/libcurl.so.4.1.1 >> > > > >> > > > 3be7652000-3be7851000 ---p 00052000 fd:00 2757384 >> > > > /usr/lib64/libcurl.so.4.1.1 >> > > > >> > > > 3be7851000-3be7854000 rw-p 00051000 fd:00 2757384 >> > > > /usr/lib64/libcurl.so.4.1.1 >> > > > >> > > > 3be8600000-3be860e000 r-xp 00000000 fd:00 2359348 >> > > > /lib64/liblber-2.4.so.2.10.2 >> > > > >> > > > 3be860e000-3be880d000 ---p 0000e000 fd:00 2359348 >> > > > /lib64/liblber-2.4.so.2.10.2 >> > > > >> > > > 3be880d000-3be880e000 r--p 0000d000 fd:00 2359348 >> > > > /lib64/liblber-2.4.so.2.10.2 >> > > > >> > > > 3be880e000-3be880f000 rw-p 0000e000 fd:00 2359348 >> > > > /lib64/liblber-2.4.so.2.10.2 >> > > > >> > > > 3be9600000-3be9602000 r-xp 00000000 fd:00 2359333 >> > > > /lib64/libfreebl3.so >> > > > >> > > > 3be9602000-3be9801000 ---p 00002000 fd:00 2359333 >> > > > /lib64/libfreebl3.so >> > > > >> > > > 3be9801000-3be9802000 r--p 00001000 fd:00 2359333 >> > > > /lib64/libfreebl3.so >> > > > >> > > > 3be9802000-3be9803000 rw-p 00002000 fd:00 2359333 >> > > > /lib64/libfreebl3.so >> > > > >> > > > 3be9a00000-3be9a07000 r-xp 00000000 fd:00 2359334 >> > > > /lib64/libcrypt-2.12.so >> > > > >> > > > 3be9a07000-3be9c07000 ---p 00007000 fd:00 2359334 >> > > > /lib64/libcrypt-2.12.so >> > > > >> > > > 3be9c07000-3be9c08000 r--p 00007000 fd:00 2359334 >> > > > /lib64/libcrypt-2.12.so >> > > > >> > > > 3be9c08000-3be9c09000 rw-p 00008000 fd:00 2359334 >> > > > /lib64/libcrypt-2.12.so >> > > > >> > > > 3be9c09000-3be9c37000 rw-p 00000000 00:00 0 >> > > > >> > > > 3beda00000-3beda39000 r-xp 00000000 fd:00 2359335 >> > > > /lib64/libnspr4.so >> > > > >> > > > 3beda39000-3bedc39000 ---p 00039000 fd:00 2359335 >> > > > /lib64/libnspr4.so >> > > > >> > > > 3bedc39000-3bedc3a000 r--p 00039000 fd:00 2359335 >> > > > /lib64/libnspr4.so >> > > > >> > > > 3bedc3a000-3bedc3c000 rw-p 0003a000 fd:00 2359335 >> > > > /lib64/libnspr4.so >> > > > >> > > > 3bedc3c000-3bedc3e000 rw-p 00000000 00:00 0 >> > > > >> > > > 3bede00000-3bede25000 r-xp 00000000 fd:00 2758097 >> > > > /usr/lib64/libnssutil3.so >> > > > >> > > > 3bede25000-3bee025000 ---p 00025000 fd:00 2758097 >> > > > /usr/lib64/libnssutil3.so >> > > > >> > > > 3bee025000-3bee02b000 r--p 00025000 fd:00 2758097 >> > > > /usr/lib64/libnssutil3.so >> > > > >> > > > 3bee02b000-3bee02c000 rw-p 0002b000 fd:00 2758097 >> > > > /usr/lib64/libnssutil3.so >> > > > >> > > > 3bee200000-3bee204000 r-xp 00000000 fd:00 2359337 >> > > > /lib64/libplc4.so >> > > > >> > > > 3bee204000-3bee403000 ---p 00004000 fd:00 2359337 >> > > > /lib64/libplc4.so >> > > > >> > > > 3bee403000-3bee404000 r--p 00003000 fd:00 2359337 >> > > > /lib64/libplc4.so >> > > > >> > > > 3bee404000-3bee405000 rw-p 00004000 fd:00 2359337 >> > > > /lib64/libplc4.so >> > > > >> > > > 3bee600000-3bee603000 r-xp 00000000 fd:00 2359341 >> > > > /lib64/libplds4.so >> > > > >> > > > 3bee603000-3bee802000 ---p 00003000 fd:00 2359341 >> > > > /lib64/libplds4.so >> > > > >> > > > 3bee802000-3bee803000 r--p 00002000 fd:00 2359341 >> > > > /lib64/libplds4.so >> > > > >> > > > 3bee803000-3bee804000 rw-p 00003000 fd:00 2359341 >> > > > /lib64/libplds4.so >> > > > >> > > > 3beea00000-3beeb37000 r-xp 00000000 fd:00 2769235 >> > > > /usr/lib64/libnss3.so >> > > > >> > > > 3beeb37000-3beed36000 ---p 00137000 fd:00 2769235 >> > > > /usr/lib64/libnss3.so >> > > > >> > > > 3beed36000-3beed3b000 r--p 00136000 fd:00 2769235 >> > > > /usr/lib64/libnss3.so >> > > > >> > > > 3beed3b000-3beed3d000 rw-p 0013b000 fd:00 2769235 >> > > > /usr/lib64/libnss3.so >> > > > >> > > > 3beed3d000-3beed3f000 rw-p 00000000 00:00 0 >> > > > >> > > > 3beee00000-3beee28000 r-xp 00000000 fd:00 2769244 >> > > > /usr/lib64/libsmime3.so >> > > > >> > > > 3beee28000-3bef027000 ---p 00028000 fd:00 2769244 >> > > > /usr/lib64/libsmime3.so >> > > > >> > > > 3bef027000-3bef02b000 r--p 00027000 fd:00 2769244 >> > > > /usr/lib64/libsmime3.so >> > > > >> > > > 3bef02b000-3bef02c000 rw-p 0002b000 fd:00 2769244 >> > > > /usr/lib64/libsmime3.so >> > > > >> > > > 3bef200000-3bef23b000 r-xp 00000000 fd:00 2769242 >> > > > /usr/lib64/libssl3.so >> > > > >> > > > 3bef23b000-3bef43b000 ---p 0003b000 fd:00 2769242 >> > > > /usr/lib64/libssl3.so >> > > > >> > > > 3bef43b000-3bef43e000 r--p 0003b000 fd:00 2769242 >> > > > /usr/lib64/libssl3.so >> > > > >> > > > 3bef43e000-3bef43f000 rw-p 0003e000 fd:00 2769242 >> > > > /usr/lib64/libssl3.so >> > > > >> > > > 3bef43f000-3bef440000 rw-p 00000000 00:00 0 >> > > > >> > > > 3bef600000-3bef619000 r-xp 00000000 fd:00 2779034 >> > > > /usr/lib64/libsasl2.so.2.0.23 >> > > > >> > > > 3bef619000-3bef818000 ---p 00019000 fd:00 2779034 >> > > > /usr/lib64/libsasl2.so.2.0.23 >> > > > >> > > > 3bef818000-3bef819000 r--p 00018000 fd:00 2779034 >> > > > /usr/lib64/libsasl2.so.2.0.23 >> > > > >> > > > 3bef819000-3bef81a000 rw-p 00019000 fd:00 2779034 >> > > > /usr/lib64/libsasl2.so.2.0.23 >> > > > >> > > > 3befa00000-3befa4d000 r-xp 00000000 fd:00 2359366 >> > > > /lib64/libldap-2.4.so.2.10.2 >> > > > >> > > > 3befa4d000-3befc4c000 ---p 0004d000 fd:00 2359366 >> > > > /lib64/libldap-2.4.so.2.10.2 >> > > > >> > > > 3befc4c000-3befc4e000 r--p 0004c000 fd:00 2359366 >> > > > /lib64/libldap-2.4.so.2.10.2 >> > > > >> > > > 3befc4e000-3befc50000 rw-p 0004e000 fd:00 2359366 >> > > > /lib64/libldap-2.4.so.2.10.2 >> > > > >> > > > 3e9ea00000-3e9ea20000 r-xp 00000000 fd:00 2359404 >> > > > /lib64/ld-2.12.so >> > > > >> > > > 3e9ec1f000-3e9ec20000 r--p 0001f000 fd:00 2359404 >> > > > /lib64/ld-2.12.so >> > > > >> > > > >> > > > Best regards, >> > > > >> > > > Pierre Smits >> > > > >> > > > ORRTIZ.COM <http://www.orrtiz.com> OFBiz based solutions & >> > > > services >> > > > >> > > > OFBiz Extensions Marketplace >> > > > http://oem.ofbizci.net/oci-2/ >> > > > >> > > > On Tue, Mar 29, 2016 at 8:29 PM, Pierre Smits >> > > > <[email protected]> >> > > > wrote: >> > > > >> > > > > Hi all, >> > > > > >> > > > > After a restart of both the Trafodion 1.3 Sandbox and Apache >> > > > > ofbiz I get the subject of this posting returned in the OFBiz >> > > > > log. The excerpt >> > > > > shows: >> > > > > >> > > > > >> > > > > [java] Caused by: org.trafodion.jdbc.t4.HPT4Exception: The >> > > > > message >> > > > > id: problem_with_server_read >> > > > > >> > > > > [java] at >> > > > > org.trafodion.jdbc.t4.HPT4Messages.createSQLException(HPT4Messag >> > > > > es >> > > > > .j >> > > > > av >> > > > > a:304) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > org.trafodion.jdbc.t4.InputOutput.doIO(InputOutput.java:373) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > org.trafodion.jdbc.t4.T4Connection.getReadBuffer(T4Connection.ja >> > > > > va >> > > > > :1 >> > > > > 54 >> > > > > ) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > >> org.trafodion.jdbc.t4.T4Connection.EndTransaction(T4Connection.java: >> > > > > 39 >> > > > > 8) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > org.trafodion.jdbc.t4.InterfaceConnection.endTransaction(Interfa >> > > > > ce >> > > > > Co >> > > > > nn >> > > > > ection.java:1222) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > org.trafodion.jdbc.t4.InterfaceConnection.rollback(InterfaceConn >> > > > > ec >> > > > > ti >> > > > > on >> > > > > .java:440) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > [java] at >> > > > > >> > org.trafodion.jdbc.t4.TrafT4Connection.rollback(TrafT4Connection.java: >> > > > > 1025) >> > > > > ~[jdbcT4.jar:?] >> > > > > >> > > > > >> > > > > This continued multiple times until the OFBiz instantiation halts. >> > > > > >> > > > > Can anybody shed a light what this means and why this is >> happening? >> > > > > >> > > > > Best regards, >> > > > > >> > > > > Pierre Smits >> > > > > >> > > > > ORRTIZ.COM <http://www.orrtiz.com> OFBiz based solutions & >> > > > > services >> > > > > >> > > > > OFBiz Extensions Marketplace >> > > > > http://oem.ofbizci.net/oci-2/ >> > > > > >> > > > >> > > >> > >> > >
