Can you share your queries and the output of ":schema" ?
You'd do he tx batching in python.
You should also use params
You could also do it like this (send in a list of 10k dicts as parameter
rows)
MERGE (log:Syslog {id:{log_id})
UNWIND {rows} as row
CREATE (log)-[:CONTAINS]->(l:Line {logline:row.line_no, time:
row.timestamp}
MERGE (u:User {id:row.user})
CREATE (l)-[:USER]->(u)
etc.
CREATE
On Mon, Jun 20, 2016 at 11:53 PM, Praveen T <praveen...@gmail.com> wrote:
> Hi,
> I have a number of syslogs of the format <date> <pc> <Failed Password>
> <username> <ip address>.I am trying to insert them into a Neo4j 3.0.2
> community edition graph. PC and IP may be repeated so i first create a node
> with unique id for the particular syslog then match and try to get the
> other nodes if they exist or else i create nodes and assign relationships
> between the nodes based on the information in the log i parse. I am using
> the python based transactions to insert stuff into the graph. Can you point
> me to the doc where batch insertion APIs are explained. Thought
> transactions would do that with regards to the python driver.
>
>
> On Wednesday, June 15, 2016 at 6:54:45 PM UTC-6, Michael Hunger wrote:
>>
>> *You have to share more detail of what you're doing.*
>>
>> Make sure to have an index / constraint on the label + property you are
>> matching / merging.
>>
>> it also makes sense if you are import larger amounts to batch updates,
>> into eg. 1k to 10k blocks.
>>
>>
>>
>>
>> On Tue, Jun 14, 2016 at 8:23 PM, Praveen T <prave...@gmail.com> wrote:
>>
>>> Hi,
>>> I am working on the latest version of Neo4j. Been trying to model a
>>> graph by parsing 13 million lines of syslog information present in network
>>> switches. Some of the nodes in the graph have already been created and i am
>>> trying to insert some more information into the graph. I am using the
>>> official python driver to insert data into the server which is being hosted
>>> in a server with pretty good configs.Been running for atleast 1.5 days but
>>> just done with 4 lakh lines. Been using the transaction framework for
>>> working on the graph Can someone help me with why the insertion is taking a
>>> lot of time. Can someone give me tips on how to make it faster?
>>>
>>>
>>> Thanks
>>> Praveen
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Neo4j" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to neo4j+un...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to neo4j+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
