Perhaps you can share your code? I think it is rather the too low pagecache config
Von meinem iPhone gesendet > Am 10.07.2016 um 12:32 schrieb Ganesh Selvaraj <ganeshkumar1...@gmail.com>: > > Update<> - I tried with batchinsertIndexProvider with both lucene and also > mapDB(the same code from here > http://www.programcreek.com/java-api-examples/index.php?api=org.neo4j.unsafe.batchinsert.BatchInserters > ). > Still the lookup takes so much time. For around 100+ million relationships > its taking around 6+ hours. > >> On Sunday, July 10, 2016 at 8:26:49 PM UTC+12, Ganesh Selvaraj wrote: >> Hi, >> >> I am using batchinserter in my work to import large amounts of data >> initially. >> I am aware that there is a neo4j import tool, but I am not using it, as we >> do some transformations programatically. >> >> When using batchinserter, after creating nodes, I use a map to store the >> domainId-Neoid references. And later while creating relationships I lookup >> the map for every relationship to find the corresponding Neoid. >> Now since I am dealing with lot of relationships, the map I use is >> slow(Tried java map, mapDb maps). >> Can some one help with some idea to speed up the lookup process ? I am also >> keen to know how neo4j import tool (how it handles lookups) works as it is >> super fast. >> Your help in this is much appreciated. >> >> Thanks >> Ganesh > > -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to neo4j+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to neo4j+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
