Yes this have been fixed, sorry for not notifying you about it! The fix will be included in the 1.5 GA release. Thank you very much for you patience and responses.
Best, Mattias 2011/10/25 Dennis Hendriksen <dennis.hendrik...@kalooga.com> > Hello Mattias, > > I'm curious to know if you were able to reproduce the problem. I realize > that it must be quiet a pain to do so because of the huge amounts of > data ;-) > > Greetings, > Dennis > > On Mon, 2011-10-17 at 10:26 +0200, Mattias Persson wrote: > > Sorry, false alarm... I got them after some retries. > > > > 2011/10/17 Mattias Persson <matt...@neotechnology.com> > > And if you could send the source it would be great (or if it's > > packaged in the jar file, which it might be but I cannot see > > it since I cannot open the jar file). > > > > > > > > 2011/10/17 Mattias Persson <matt...@neotechnology.com> > > Thanks, but unfortunately I cannot open any of these > > files. I get "unexpected EOF" and such. > > > > > > > > 2011/10/17 Dennis Hendriksen > > <dennis.hendrik...@kalooga.com> > > Hello Mattias, > > > > Download and extract the following (> 7.0GB) > > resource: > > > http://download.wikimedia.org/enwiki/20110803/enwiki-20110803-pages-articles.xml.bz2 > > > > Download the runnable jar and source files: > > http://download.kalooga.com/wikiparser.jar > > > http://download.kalooga.com/kalooga-wikiparser.tar.gz (eclipse) > > > > Run the application as follows: > > java -Xmx9g -jar wikiparser.jar > > <path>/enwiki-20110803-pages-articles.xml > > <path>/graphdb > > > > You might want to add some additional jvm > > flags to speed up execution: > > -XX:+DoEscapeAnalysis -XX:+AggressiveOpts -XX: > > +UseNUMA -XX: > > +UseCompressedStrings -XX: > > +OptimizeStringConcat -XX: > > +UseFastAccessorMethods -XX:+UseBiasedLocking > > > > Thank you for taking the time to look into the > > problem! > > > > Greetings, > > Dennis > > > > > > On Sat, 2011-10-15 at 17:08 +0200, Mattias > > Persson wrote: > > > Thanks Dennis for reporting it. > > > > > > I would like to run your code to be able to > > reproduce it locally, then I can > > > probably fix the bug. Would that be > > possible? > > > > > > Best, > > > Mattias > > > > > > 2011/10/14 Dennis Hendriksen > > <dennis.hendrik...@kalooga.com> > > > > > > > Hi all, > > > > > > > > Since upgrading neo4j 1.4.1 to 1.5.M02 I > > get a InvalidRecordException > > > > while importing data in a new store using > > BatchInserter (never seen this > > > > exception with 1.4.1). > > > > > > > > For identical program executions the > > exceptions occur at different > > > > moments. The problem only occurs after > > inserting millions of > > > > nodes/relations, but occurs in each run. > > The data is inserted in a > > > > single thread. Properties are not > > necessarily added to a node right > > > > after node creation. > > > > > > > > I've included configuration details below, > > including the exception > > > > output during three identical runs. > > > > > > > > Is this a known issue in 1.5.M02? Anyone > > encountered the same exception? > > > > Any suggestions how to tackle this > > problem? > > > > > > > > Greetings, > > > > Dennis > > > > > > > > *** java > > > > java version "1.6.0_27" > > > > Java(TM) SE Runtime Environment (build > > 1.6.0_27-b07) > > > > Java HotSpot(TM) 64-Bit Server VM (build > > 20.2-b06, mixed mode) > > > > > > > > java -Xmx9g (not using any additional > > flags) > > > > > > > > *** neo4j > > > > Physical mem: 9991MB, Heap size: 8192MB > > > > use_memory_mapped_buffers=false > > > > > > > neostore.propertystore.db.index.keys.mapped_memory=1M > > > > > > > neostore.propertystore.db.strings.mapped_memory=426M > > > > > > > neostore.propertystore.db.arrays.mapped_memory=483M > > > > neostore.propertystore.db.strings=2000M > > > > neostore.propertystore.db=1600M > > > > neo_store=/tmp/neostore > > > > > > neostore.relationshipstore.db.mapped_memory=3400M > > > > > > neostore.propertystore.db.index.mapped_memory=1M > > > > > > neostore.propertystore.db.mapped_memory=501M > > > > dump_configuration=true > > > > cache_type=weak > > > > neostore.nodestore.db.mapped_memory=150M > > > > > > > > *** run #1 > > > > parsed 6100000 pages (2157 pages/sec) > > > > parsed 6150000 pages (1014 pages/sec) > > > > Exception in thread "main" > > > > > > > org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use, > > > > blockId[2397918] > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388) > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333) > > > > > > > org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244) > > > > ... > > > > shutting down graph databases > > > > > > > > *** run #2 > > > > parsed 5550000 pages (927 pages/sec) > > > > parsed 5600000 pages (761 pages/sec) > > > > Exception in thread "main" > > > > > > > org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use, > > > > blockId[8198653] > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388) > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333) > > > > > > > org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244) > > > > ... > > > > shutting down graph databases > > > > > > > > *** run #3 > > > > parsed 6250000 pages (562 pages/sec) > > > > parsed 6300000 pages (575 pages/sec) > > > > Exception in thread "main" > > > > > > > org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Not in use, > > > > blockId[9378804] > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getRecord(AbstractDynamicStore.java:388) > > > > > > > org.neo4j.kernel.impl.nioneo.store.AbstractDynamicStore.getLightRecords(AbstractDynamicStore.java:333) > > > > > > > org.neo4j.kernel.impl.nioneo.store.PropertyStore.getRecord(PropertyStore.java:376) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.deletePropertyChain(BatchInserterImpl.java:476) > > > > > > > org.neo4j.kernel.impl.batchinsert.BatchInserterImpl.setNodeProperties(BatchInserterImpl.java:244) > > > > ... > > > > 11/10/14 12:50:50 INFO neo4j.Neo4jStore: > > shutting down graph databases > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > Neo4j mailing list > > > > User@lists.neo4j.org > > > > > > https://lists.neo4j.org/mailman/listinfo/user > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > Mattias Persson, [matt...@neotechnology.com] > > Hacker, Neo Technology > > www.neotechnology.com > > > > > > > > > > -- > > Mattias Persson, [matt...@neotechnology.com] > > Hacker, Neo Technology > > www.neotechnology.com > > > > > > > > > > -- > > Mattias Persson, [matt...@neotechnology.com] > > Hacker, Neo Technology > > www.neotechnology.com > > > -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com _______________________________________________ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
