Finally, I've stopped the process and run the neo4j server for that
database. after taking about 2 hours, it created "neostore.counts.db" file
and right now I can run it. However, it's somehow slow when I'm working
with that.
I think it's related to the node/relationship index. When I see inside of
the index directory it has just "segments_1" and "segments.gen". How can I
make some index over the labels of a created graph?
On Thursday, April 28, 2016 at 12:37:42 PM UTC-7, Mohammad Hossain Namaki
wrote:
>
> Dear all,
> Hi,
> I've wrote a java code to *import* "dblp" into the Neo4j. It's using the
> *batchInserter* to create the dataset. However, the code is stuck at
> *db.shutdown()* line after two days run with 20 GB memory. The current
> neo4j dataset (e.g. dblp.db) is 3.2 GB and the last modified date of files
> inside of it is for the 2 days ago (but the program didn't finish).
> However, when I download the dataset and try to run it with Neo4j
> Server/Java API, it cannot start.
>
> Could you please guide me on that?
> It seems that the number of entities to be added is 6,600,000 and number
> of relationships to be added is 11,550,000.
>
> I've attached the messages.log file and also the source code. I'm using
> *neo4j.2.3.0
> *jar file.
>
> The summary of the source code at creating section is like this:
>
>
> Map<String, String> config = new HashMap<String, String>();
>
> config.put("dbms.pagecache.memory", "50000M");
>
> config.put("dbms.pagecache.pagesize", "8g");
>
> config.put("node_auto_indexing", "true");
>
> db = BatchInserters.inserter("dblp2.db", config);
>
> indexProvider = new LuceneBatchInserterIndexProvider(db);
>
> index = indexProvider.nodeIndex("dblpIndex", MapUtil.
> stringMap("type", "exact"));
>
> index.setCacheCapacity(KEY_PROPERTY, 500000001);
> ........
>
> Label label = DynamicLabel.label(author);
>
> long nodeId = db.createNode(null, label);
>
>
> ......
>
> if ((totalEntity % 50000) == 0) {
>
> index.flush();
>
> }
>
>
> .......
>
> Long nodeId = db.createNode(props, labels.toArray(
> new Label[labels.size()]));
>
> .......
>
> db.createRelationship(entityKeyNodeMap.get(key),
> distinctAuthors.get(author), RelTypes.WRITTEN_BY, null);
>
> ......
>
> if ((totalEntity % 50000) == 0) {
>
> index.flush();
>
> System.out.println("relationship: " + totalEntity
> );
>
>
> }
>
>
> System.out.println("indexProvider shutting down");
>
> indexProvider.shutdown();
>
>
>
> System.out.println("db shutting down");
>
> db.shutdown();
>
> System.out.println("program is finished!");
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> }
>
>
>
>
>
>
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
