[
https://issues.apache.org/jira/browse/JENA-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134193#comment-17134193
]
Wolfgang Fahl commented on JENA-1908:
-------------------------------------
I'd love to run another test but currently i feel like stuck between a rock, a
hard place and something that hurts.
Three tests so far were not successful for different reasons and i have not
hints yet what settings could influence the performance or what the reasons are
for the issues. There is only one success report by [~yolpsoftware] so far
which involves investing +500 EUR on a 4 Terrabyte SSD. I'd rather get this
running with a rotating disk in reasonable time.
All tests have been run with empty databases and the 4 Terrabyte rotating
target disk has not been used for any other purpose before and is otherwise
almost empty. I moved the disk from my Mac OS machine to another Hardware using
Ubuntu to no avail. I'd be inclined to move it back to the bigger Mac OS
machine which i think is also more reliable if this would make sense. But then
again we might not see the same error again but only the degrading of
performance as we did before. For a start I might change the setup to only work
with the truthy dataset.
> TDB2: tdb2.tdbloader crashes
> ----------------------------
>
> Key: JENA-1908
> URL: https://issues.apache.org/jira/browse/JENA-1908
> Project: Apache Jena
> Issue Type: Bug
> Components: TDB2
> Affects Versions: Jena 3.15.0
> Reporter: Wolfgang Fahl
> Priority: Major
> Attachments: tdb2--out.log
>
>
> [http://wiki.bitplan.com/index.php/Get_your_own_copy_of_WikiData#third_attempt_to_load_with_tdb2.tdbloader]
> describes a WikiData import attempt that ran some 14 days before it crashed.
>
> {code:java}
> java.lang.IllegalArgumentException: null at
> java.nio.Buffer.position(Buffer.java:244) ~[?:1.8.0_201] at
> org.apache.jena.dboe.base.record.RecordFactory.lambda$static$0(RecordFactory.java:111)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.record.RecordFactory.buildFrom(RecordFactory.java:127)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.buffer.RecordBuffer._get(RecordBuffer.java:102)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.base.buffer.RecordBuffer.get(RecordBuffer.java:52)
> ~[jena-dboe-base-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeRecords.getSplitKey(BPTreeRecords.java:195)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.split(BPTreeNode.java:562)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:509)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.internalInsert(BPTreeNode.java:522)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPTreeNode.insert(BPTreeNode.java:203)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPlusTree.insertAndReturnOld(BPlusTree.java:278)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.dboe.trans.bplustree.BPlusTree.insert(BPlusTree.java:271)
> ~[jena-dboe-trans-data-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.store.tupletable.TupleIndexRecord.performAdd(TupleIndexRecord.java:94)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.store.tupletable.TupleIndexBase.add(TupleIndexBase.java:66)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.lambda$loadTuples$1(Indexer.java:133)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.stageIndex(Indexer.java:115)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at
> org.apache.jena.tdb2.loader.main.Indexer.lambda$startBulk$0(Indexer.java:92)
> ~[jena-tdb2-3.15.0.jar:3.15.0] at java.lang.Thread.run(Thread.java:748)
> [?:1.8.0_201] 14:58:42 ERROR Indexer :: Interrupted
>
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
