Update<> - I tried with batchinsertIndexProvider with both lucene and also mapDB(the same code from here http://www.programcreek.com/java-api-examples/index.php?api=org.neo4j.unsafe.batchinsert.BatchInserters ). Still the lookup takes so much time. For around 100+ million relationships its taking around 6+ hours.
On Sunday, July 10, 2016 at 8:26:49 PM UTC+12, Ganesh Selvaraj wrote: > > Hi, > > I am using batchinserter in my work to import large amounts of data > initially. > I am aware that there is a neo4j import tool, but I am not using it, as we > do some transformations programatically. > > When using batchinserter, after creating nodes, I use a map to store the > domainId-Neoid references. And later while creating relationships I lookup > the map for every relationship to find the corresponding Neoid. > Now since I am dealing with lot of relationships, the map I use is > slow(Tried java map, mapDb maps). > Can some one help with some idea to speed up the lookup process ? I am > also keen to know how neo4j import tool (how it handles lookups) works as > it is super fast. > Your help in this is much appreciated. > > Thanks > Ganesh > > > -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to neo4j+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
