[
https://issues.apache.org/jira/browse/JENA-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221979#comment-13221979
]
Andy Seaborne commented on JENA-217:
------------------------------------
Exception in thread "main" java.lang.InternalError: a fault occurred in a
recent unsafe memory access operation in compiled Java code
java.lang.InternalError is a JVM-internal error. This looks rather like a
problem with your system, either by bad configuration or by system bug. It
should not be possible to cause from java if things are working correctly. The
only system configuration factor I can think of is the maximum process size.
Maybe tdbloader2 will work - it works very differently.
I wish I could be more helpful - if the data is available then I can download
and try it on my machine but it's not trivially small and the error is
something likely to happen only at scale.
A hacked up version of tdbloader could start from the end of the data phase
(the problem is in index generation).
What is the system setup?
Size of RAM?
java version?
Stackoverflow says:
http://stackoverflow.com/questions/2949371/java-map-nio-nfs-issue-causing-a-vm-fault-a-fault-occurred-in-a-recent-uns
I am seeing this occur with memory mapped files on local ext4 and tmpfs file
systems with Java 7u1. – Peter Lawrey Dec 15 '11 at 14:01
... it happens at the point I run out of physical memory (viewed in top), even
though I have 10 GB of swap free. – Peter Lawrey Dec 15 '11 at 14:15
Also:
http://tech.groups.yahoo.com/group/jena-dev/message/47100
> tdbloader : Unsafe memory access operation
> ------------------------------------------
>
> Key: JENA-217
> URL: https://issues.apache.org/jira/browse/JENA-217
> Project: Apache Jena
> Issue Type: Bug
> Components: TDB
> Affects Versions: Fuseki 0.2.1
> Environment: Ubuntu 10.04
> Reporter: Sarven Capadisli
>
> First of all, I'm not sure if this is necessarily a bug or whether my system
> encountered some other issue. Here it is:
> I'm trying to import world-development-indicators.nt which is 68 GB into a
> TDB store.
> I've performed the following operation:
> java tdb.tdbloader --loc /usr/lib/fuseki/DB/DB.worldbank2
> world-development-indicators
> --graph=http://worldbank.270a.info/graph/world-bank-indicators
> /data/worldbank.270a.info/indicators/en/indicator/world-bank-indicators.nt
> ..
> 360,393,432 triples loaded in 15,956.80 seconds [Rate: 22,585.57 per second]
> ..
> ** Index GSPO->GPOS: 360,202,756 slots indexed in 18,194.61 seconds [Rate:
> 19,797.23 per second]
> ..
> ** Index GSPO->GOSP: 360,202,756 slots indexed in 4,410.64 seconds [Rate:
> 81,666.85 per second]
> ..
> ** Index GSPO->POSG: 360,202,756 slots indexed in 4,354.58 seconds [Rate:
> 82,718.05 per second]
> ..
> ** Index GSPO->OSPG: 360,202,756 slots indexed in 4,084.50 seconds [Rate:
> 88,187.73 per second]
> ..
> Index GSPO->SPOG: 113,900,000 slots (Batch: 213,675 slots/s / Avg: 113,695
> slots/s)
> Exception in thread "main" java.lang.InternalError: a fault occurred in a
> recent unsafe memory access operation in compiled Java code
> at com.hp.hpl.jena.tdb.lib.TupleLib.tuple(TupleLib.java:208)
> at
> com.hp.hpl.jena.tdb.index.TupleIndexRecord$1.convert(TupleIndexRecord.java:195)
> at
> com.hp.hpl.jena.tdb.index.TupleIndexRecord$1.convert(TupleIndexRecord.java:191)
> at org.openjena.atlas.iterator.Iter$4.next(Iter.java:293)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.copyIndex(LoaderNodeTupleTable.java:209)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.BuilderSecondaryIndexesSequential.createSecondaryIndexes(BuilderSecondaryIndexesSequential.java:43)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.createSecondaryIndexes(LoaderNodeTupleTable.java:192)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.loadSecondaryIndexes(LoaderNodeTupleTable.java:91)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.loadIndexStart(LoaderNodeTupleTable.java:144)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader$1.finish(BulkLoader.java:232)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader.loadTriples$(BulkLoader.java:141)
> at
> com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader.loadNamedGraph(BulkLoader.java:107)
> at com.hp.hpl.jena.tdb.TDBLoader.loadNamedGraph$(TDBLoader.java:271)
> at com.hp.hpl.jena.tdb.TDBLoader.loadGraph$(TDBLoader.java:246)
> at com.hp.hpl.jena.tdb.TDBLoader.loadGraph(TDBLoader.java:177)
> at com.hp.hpl.jena.tdb.TDBLoader.load(TDBLoader.java:112)
> at tdb.tdbloader.loadNamedGraph(tdbloader.java:157)
> at tdb.tdbloader.exec(tdbloader.java:142)
> at arq.cmdline.CmdMain.mainMethod(CmdMain.java:97)
> at arq.cmdline.CmdMain.mainRun(CmdMain.java:59)
> at arq.cmdline.CmdMain.mainRun(CmdMain.java:46)
> at tdb.tdbloader.main(tdbloader.java:53)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
