Laurent, have you looked at the BatchInserter for doing big initial populations? It is MUCH faster than the normal Neo4j transactional approach, see http://wiki.neo4j.org/content/Indexing_with_BatchInserter
Would that help? Cheers, /peter neubauer COO and Sales, Neo Technology GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.tinkerpop.com - Processing for Internet-scale graphs. http://www.thoughtmade.com - Scandinavias coolest Bring-a-Thing party. On Mon, Mar 22, 2010 at 11:35 PM, Laurent Laborde <kerdez...@gmail.com> wrote: > On Fri, Mar 19, 2010 at 10:20 AM, Laurent Laborde <kerdez...@gmail.com> wrote: >> thank you peter. >> Following the various link, i found http://www.cytoscape.org/ >> Look very promising !! i'll try this weekend :) > > 3 days later, i'm still populating neo4j like a crazy, trying to > compute the collatz conjecture up to 100 millions. > i'm at 63.5 millions, but it's now much much slower than at the beginning. > > probably because of the insane numbers of index.getSingleNode on > lucene on a growing index. > i'm expecting something like a billion of node when it will reach 100 > millions. > > the index is 6GB and the base is 9GB. > The cpu usage is now ~10% instead of 25%, i have a grand total of 9+6 > GB of data in the neo4j drectory with only 8GB on ram on my windows 7 > i'm now (random) IO bound. > > My SATA velociraptor 10krpm is fighting at 1MB/s (not so bad; > considering it's highly mixed R/W and purely random IO) > > time to buy a 32GB SSD :) > > -- > Keru > > > -- > Laurent "ker2x" Laborde > Sysadmin & DBA at http://www.over-blog.com/ > _______________________________________________ > Neo mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > _______________________________________________ Neo mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
