I just want to fully agree with Wes, don't run this from eclipse. I get best performance from Neo4j batch inserter by compiling it and then running it from the jar, as opposed to lein run.
Definitely check your heap to the JVM and to the batchinserter initialization, as they are separate and it can take awhile to process and store all of that onto a hard drive. --Joseph On Wednesday, December 11, 2013 10:40:51 AM UTC-6, Wes Freeman wrote: > > The alternatives to BatchInserter are to just use the normal Java API and > batch things up into large transactions--~10k things at a time is probably > a good first try. You'll probably get 1/4 to 1/2 of the speed of the batch > inserter, but it won't crash unrecoverably, as the journal file will be > written. Usually, if you have your records somewhere you can retrieve them > again, the risk of the unsafe aspect of BatchInserter are mitigated, and > the speed is worth it. > > As a side note, you should probably not be running this sort of thing in > an IDE. Make sure you have configured enough RAM for the BatchInserter mmio > options--that is a key way to make performance a lot faster. > > Wes > > On Wed, Dec 11, 2013 at 12:07 AM, Himakshi Mangal > <himaksh...@gmail.com<javascript:> > > wrote: > >> Hi wes, >> >> I tried with neo4j-shell but it gave me this error: >> Error starting org.neo4j.kernel.EmbeddedGraphDatabase, >> /home/himakshi/work/setup/neo4j-community-2.0.0-RC1/bin/../data/dbpedia.db >> >> Yes, I am using org.neo4j.unsafe.BatchInserter. >> >> If this causes the problem, can there be any alternate solution because i >> cannot afford to loose my db after 3-lakhs records are already processed. >> >> >> >> >> On Tuesday, December 10, 2013 3:30:09 PM UTC+5:30, Himakshi Mangal wrote: >> >>> Hi, >>> >>> I was using clojure to upload the dbpedia datasets into neo4j. >>> >>> Unfortunately, my system hanged and i had to restart everything. Now, if >>> i start the execution of program again it shows this error: >>> >>> 'neostore' does not contain a store version, please ensure that the >>> original database was shut down in a clean state. >>> >>> >>> How can i solve this error so that i can start the uploading from the >>> point it stopped? >>> >>> Please help >>> >> -- >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to clo...@googlegroups.com<javascript:> >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> clojure+u...@googlegroups.com <javascript:> >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to clojure+u...@googlegroups.com <javascript:>. >> For more options, visit https://groups.google.com/groups/opt_out. >> > > -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
