[
https://issues.apache.org/jira/browse/JENA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13114814#comment-13114814
]
Simon Helsen commented on JENA-91:
----------------------------------
ok, so just running TestTransSystemJena91 like you asked (after updating
everything, including ARQ), produced the following output
TestTransSystemJena91
Mon Sep 26 13:15:09 EDT 2011
java.version = 1.6.0
java.vendor = IBM Corporation
java.runtime.name = Java(TM) SE Runtime Environment
java.runtime.version = jvmwa6460sr9-20110624_85526
java.vm.version = 2.4
java.vm.vendor = IBM Corporation
java.vm.name = IBM J9 VM
java.vm.specification.name = Java Virtual Machine Specification
java.vm.info = JRE 1.6.0 IBM J9 2.4 Windows 7 amd64-64
jvmwa6460sr9-20110624_85526 (JIT enabled, AOT enabled)
J9VM - 20110624_085526
JIT - r9_20101028_17488ifx17
GC - 20101027_AA
java.class.version = 50.0
java.specification.version = 1.6
java.specification.vendor = Sun Microsystems Inc.
os.name = Windows 7
os.version = 6.1 build 7601 Service Pack 1
java.class.path =
D:\jfsDev\TxTDB\classes;C:\Users\shelsen\.m2\repository\com\hp\hpl\jena\arq\2.8.9-SNAPSHOT\arq-2.8.9-SNAPSHOT.jar;C:\Users\shelsen\.m2\repository\com\hp\hpl\jena\arq\2.8.9-SNAPSHOT\arq-2.8.9-SNAPSHOT-tests.jar;C:\Users\shelsen\.m2\repository\com\ibm\icu\icu4j\3.4.4\icu4j-3.4.4.jar;C:\Users\shelsen\.m2\repository\com\hp\hpl\jena\iri\0.8\iri-0.8.jar;C:\Users\shelsen\.m2\repository\com\hp\hpl\jena\jena\2.6.4\jena-2.6.4.jar;C:\Users\shelsen\.m2\repository\com\hp\hpl\jena\jena\2.6.4\jena-2.6.4-tests.jar;C:\Users\shelsen\.m2\repository\junit\junit\4.8.2\junit-4.8.2.jar;C:\Users\shelsen\.m2\repository\log4j\log4j\1.2.16\log4j-1.2.16.jar;C:\Users\shelsen\.m2\repository\org\apache\lucene\lucene-core\2.3.1\lucene-core-2.3.1.jar;C:\Users\shelsen\.m2\repository\org\slf4j\slf4j-api\1.6.1\slf4j-api-1.6.1.jar;C:\Users\shelsen\.m2\repository\org\slf4j\slf4j-log4j12\1.6.1\slf4j-log4j12-1.6.1.jar;C:\Users\shelsen\.m2\repository\stax\stax-api\1.0.1\stax-api-1.0.1.jar;C:\Users\shelsen\.m2\repository\org\codehaus\woodstox\wstx-asl\3.2.9\wstx-asl-3.2.9.jar;C:\Users\shelsen\.m2\repository\xerces\xercesImpl\2.7.1\xercesImpl-2.7.1.jar
java.home = C:\development\jdk\ibm60\jre
START (disk[direct], 1000 iterations)
000:
....................................................................................................
100:
................................................com.hp.hpl.jena.tdb.TDBException:
Different ids for
"-2493539583195906921"^^http://www.w3.org/2001/XMLSchema#long: allocated:
expected [00000000000001EA], got [00000000000001A7]
at
com.hp.hpl.jena.tdb.transaction.NodeTableTrans.append(NodeTableTrans.java:178)
at
com.hp.hpl.jena.tdb.transaction.NodeTableTrans.writeNodeJournal(NodeTableTrans.java:210)
at
com.hp.hpl.jena.tdb.transaction.NodeTableTrans.commitPrepare(NodeTableTrans.java:190)
at
com.hp.hpl.jena.tdb.transaction.Transaction.prepare(Transaction.java:93)
at
com.hp.hpl.jena.tdb.transaction.Transaction.commit(Transaction.java:77)
at com.hp.hpl.jena.tdb.DatasetGraphTxn.commit(DatasetGraphTxn.java:26)
at tx.TestTransSystemJena91$Writer.call(TestTransSystemJena91.java:291)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)
at java.util.concurrent.FutureTask.run(FutureTask.java:149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:897)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:919)
at java.lang.Thread.run(Thread.java:736)
> extremely large buffer is being created in ObjectFileStorage
> ------------------------------------------------------------
>
> Key: JENA-91
> URL: https://issues.apache.org/jira/browse/JENA-91
> Project: Jena
> Issue Type: Bug
> Components: TDB
> Reporter: Simon Helsen
> Assignee: Andy Seaborne
> Priority: Critical
> Attachments: JENA-91_NodeTableTrans_r1159121.patch,
> TestTransSystem.patch, TestTransSystem2.patch, TestTransSystem3.patch,
> TestTransSystem4.patch
>
>
> I tried to debug the OME and check why a bytebuffer is causing my native
> memory to explode in almost no time. It all seems to happen in this bit of
> code in com.hp.hpl.jena.tdb.base.objectfile.ObjectFileStorage (lines 243
> onwards)
> // No - it's in the underlying file storage.
> lengthBuffer.clear() ;
> int x = file.read(lengthBuffer, loc) ;
> if ( x != 4 )
> throw new
> FileException("ObjectFile.read("+loc+")["+filesize+"]["+file.size()+"]:
> Failed to read the length : got "+x+" bytes") ;
> int len = lengthBuffer.getInt(0) ;
> ByteBuffer bb = ByteBuffer.allocate(len) ;
> My debugger shows that x==4. It also shows the lengthBuffer has the following
> content: [111, 110, 61, 95]. This amounts to the value of len=1869495647,
> which is rather a lot :-) Obviously, the next statement (ByteBuffer.allocate)
> causes the OME.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira