[
https://issues.apache.org/jira/browse/JENA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086565#comment-13086565
]
Simon Helsen commented on JENA-91:
----------------------------------
Unfortunately, the latest snapshot (tx-tdb-0.9.0-20110817.065027-9) still
exposes the same problem. One of the key issues that may be causing this is
that in our tests, we employ several stores at the same time although they
operate on entirely separate data. We then regularly suspend/resume these
stores (i.e. do a StoreConnection.release and StoreConnection.make) on them. I
wonder if there is some global (VM) state which gets confused when multiple
stores are managed by multiple threads
Here is a more complete log:
15:38:55,948 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5350I Indexing: suspending ...
15:38:56,210 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5349I Indexing: suspended
15:38:56,218 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5348I Indexing: resuming ...
15:38:56,423 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5347I Indexing: resumed
15:38:56,505 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,509 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,512 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,515 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,518 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,521 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,534 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,538 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,541 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,545 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,549 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,553 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,589 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,593 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,597 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,600 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,604 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,607 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,903 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,907 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,910 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,914 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,917 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,920 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,970 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,974 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,978 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,981 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,984 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:56,995 [jazz.jfs.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,125 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5350I Indexing: suspending ...
15:38:57,145
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,149
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,153 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,157 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,154
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,161 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,168 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,172 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,176 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,165
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,191
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,199
[jazz.jfs.suspending.indexer.jfs_tests_default_consumer_name.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,208 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,211 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,215 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,221 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,257 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,269 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:57,356 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5349I Indexing: suspended
15:38:57,642 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5348I Indexing: resuming ...
15:38:57,810 [jazz.jfs.resuming.indexer.jfs_tests_default_consumer_name.triple]
WARN com.ibm.team.jfs - CRJZS5645W The
"triple live" index for jfs_tests_default_consumer_name seems to be corrupted.
A full reindex will occur
15:38:57,824 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5347I Indexing: resumed
15:38:58,388 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5350I Indexing: suspending ...
15:38:58,426 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,439 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,443 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,447 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,451 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,454 [jazz.jfs.suspending.indexer.internal.triple] ERROR
com.hp.hpl.jena.tdb.base.block.BlockMgrCache - write: Block in the read
cache
15:38:58,589 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5349I Indexing: suspended
15:38:58,809 [42074754@qtp-1183467146-7] INFO com.ibm.team.jfs
- CRJZS5348I Indexing: resuming ...
15:38:59,102 [jazz.jfs.resuming.indexer.jfs_tests_default_consumer_name.triple]
WARN com.ibm.team.jfs - CRJZS5645W The
"triple live" index for jfs_tests_default_consumer_name seems to be corrupted.
A full reindex will occur
15:38:59,131 [jazz.jfs.resuming.indexer.internal.triple] ERROR TDB
- ObjectFile.read(61)[442][442]: Impossibly
large object : 946555205 bytes
15:38:59,136 [jazz.jfs.resuming.indexer.internal.triple] WARN com.ibm.team.jfs
- CRJZS5646W The "triple live" index for
private applications seems to be corrupted. A full reindex will occur
> extremely large buffer is being created in ObjectFileStorage
> ------------------------------------------------------------
>
> Key: JENA-91
> URL: https://issues.apache.org/jira/browse/JENA-91
> Project: Jena
> Issue Type: Bug
> Components: TDB
> Environment: Windows (and I presume any little endian system)
> Reporter: Simon Helsen
> Assignee: Andy Seaborne
> Priority: Critical
>
> I tried to debug the OME and check why a bytebuffer is causing my native
> memory to explode in almost no time. It all seems to happen in this bit of
> code in com.hp.hpl.jena.tdb.base.objectfile.ObjectFileStorage (lines 243
> onwards)
> // No - it's in the underlying file storage.
> lengthBuffer.clear() ;
> int x = file.read(lengthBuffer, loc) ;
> if ( x != 4 )
> throw new
> FileException("ObjectFile.read("+loc+")["+filesize+"]["+file.size()+"]:
> Failed to read the length : got "+x+" bytes") ;
> int len = lengthBuffer.getInt(0) ;
> ByteBuffer bb = ByteBuffer.allocate(len) ;
> My debugger shows that x==4. It also shows the lengthBuffer has the following
> content: [111, 110, 61, 95]. This amounts to the value of len=1869495647,
> which is rather a lot :-) Obviously, the next statement (ByteBuffer.allocate)
> causes the OME.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
