Actually looking at your old version again you use just one single tx
Repeated tx.success() don't have an effect
Sent from mobile device
Am 29.08.2014 um 10:57 schrieb "'Curtis Mosters' via Neo4j"
<neo4j@googlegroups.com>:
> Tested in AWS on Intel Xeon CPU E5-2670 v2 @ 2,5 GHz.
>
> With the addition I need for 1 mio lines ~100 sec
>
> With my old version of inserting every line it was 14 sec.
>
> So somehow batch commiting is much slower.
>
> Am Donnerstag, 28. August 2014 22:18:46 UTC+2 schrieb Michael Hunger:
>>
>>
>> Am 28.08.2014 um 19:17 schrieb 'Curtis Mosters' via Neo4j
>> <ne...@googlegroups.com>:
>>
>>> Hi I don't like the current speed of Neo4j with Java API.
>>>
>>> I have written an example that just inserts random data. In the case 160k:
>>>
>> Change it to batching commits every 30k to 50k nodes not every node.
>>
>>
>> Transaction tx = graphDb.beginTx();
>>
>>> for (int i = 0; i < 160000; i++) {
>>> myFirstNode = graphDb.createNode();
>>> myFirstNode.setProperty( "id", "1" );
>>> myFirstNode.setProperty( "name", "Duane Nickull, I
>>> Braineater" );
>> if (i % 30000 == 0) {
>>> tx.success();
>> tx.close();
>> tx = graphDb.beginTx();
>> }
>>> }
>>
>>> tx.success();
>> tx.close();
>>
>> With the java API you usually can import 50 to 100k nodes per second.
>>
>>
>>>
>>> this needs 22 seconds + ~2 minutes of tx.success() finishing or so. That's
>>> pretty bad if you ask me.
>>>
>>> So how can I improve the speed of the insert.
>>>
>>> Already thought about it, maybe with:
>>>
>>> disabling tx
>>> declare massive insert
>>> inserting every 10k
>>> So yeah basically help me to speed it up. Please don't say to use the
>>> batch-inserter. He is fine but noch practicable for me.
>>>
>>> Thank you.
>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google Groups
>>> "Neo4j" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an
>>> email to neo4j+un...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to neo4j+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
