in the file I only have 2 columns, one for client id, which is always not
null and CityId, which may be sometimes null. Should I export the records
from SQL database leaving out the columns that contain null values?
marți, 17 iunie 2014, 15:39:14 UTC+3, Michael Hunger a scris:
>
> if they don't have a value for city id, do they then have empty columns
> there still? like "user-id,,
>
> You probably want to filter these rows?
>
> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS
>> c
>>
>> WHERE coalesce(c.CitiId,"") <> ""
> ...
>
> Am 17.06.2014 um 11:23 schrieb Paul Damian <paulda...@gmail.com
> <javascript:>>:
>
> Well, the csv file contains some rows that do not have a value for CityId,
> and the rows are unique regarding the clientID. There are 11M clients
> living in 14K Cities. Is there a limit of links/node?
> Now I've created a piece of code that reads from file and creates each
> relationship, but, as you can imagine, it works really slow in this
> scenario.
>
>
>> did you create an index on :Client(Id) and :City(Id)
>>
>> what happens if you do:
>>
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv"
>> AS c
>> MATCH (client: Client { Id: toInt(c.Id)})
>>
>> RETURN count(*)
>>
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv"
>> AS c
>> MATCH (city: City { Id: toInt(c.CityId)})
>>
>> RETURN count(*)
>>
>> each count should be equivalent to the # of rows in the file.
>>
>> Michael
>>
>> Am 16.06.2014 um 17:47 schrieb Paul Damian <paulda...@gmail.com>:
>>
>> Somehow I've managed to load all the nodes and now I'm trying to load the
>> links as well. I read the nodes from csv file and create the relation
>> between them. I run the following command:
>> USING PERIODIC COMMIT 100
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv"
>> AS c
>> MATCH (client: Client { Id: toInt(c.Id)}), (city: City { Id:
>> toInt(c.CityId)})
>> CREATE (client)-[r:LOCATED_IN]->(city)
>>
>> Running with a smaller commit size returns this error
>> Neo.DatabaseError.Statement.ExecutionFailure, while increasing the
>> commit size to 10000 throws Neo.DatabaseError.General.UnknownFailure.
>> Can you help me with this?
>>
>>
>> joi, 5 iunie 2014, 12:05:18 UTC+3, Michael Hunger a scris:
>>>
>>> Perhaps something with field or line terminators?
>>>
>>> I assume it blows up the field separation.
>>>
>>> Try to run:
>>>
>>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv" AS c
>>> RETURN { Id: toInt(c.Id), FirstName: c.FirstName, LastName: c.Lastname,
>>> Address: c.Address, ZipCode: toInt(c.ZipCode), Email: c.Email, Phone:
>>> c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL, Latitude:
>>> toFloat(c.Latitude), Longitude: toFloat(c.Longitude), AgencyId:
>>> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)} as data, c as line
>>> LIMIT 3
>>>
>>>
>>>
>>> On Thu, Jun 5, 2014 at 10:51 AM, Paul Damian <paulda...@gmail.com>
>>> wrote:
>>>
>>>> I've tried using the shell and I get the same results: nodes with no
>>>> properties.
>>>> I've created the csv file using MsSQL Server Export. Is it relevant?
>>>>
>>>> About you curiosity: I figured I would import first the nodes, then the
>>>> relationships from the connection tables. Am I doing it wrong?
>>>>
>>>> Thanks
>>>>
>>>> joi, 5 iunie 2014, 09:54:31 UTC+3, Michael Hunger a scris:
>>>>>
>>>>> I'd probably use a commit size in your case of 50k or 100k.
>>>>>
>>>>> Try to use the neo4j-shell and not the web-interface.
>>>>>
>>>>> Connect to neo4j using bin/neo4j-shell
>>>>>
>>>>> Then run your commands ending with a semicolon.
>>>>>
>>>>> Just curious: Your data is imported as one node per row? That's not
>>>>> really a graph structure.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Jun 4, 2014 at 6:56 PM, Paul Damian <paulda...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi there,
>>>>>>
>>>>>> I'm experimenting with Neo4j while benchmarking a bunch of NoSQL
>>>>>> databases for my graduation paper.
>>>>>> I'm using the web interface to populate the database. I've been able
>>>>>> to load the smaller tables from my SQL database and LOAD CSV works fine.
>>>>>> By small, I mean a few columns (4-5) and some rows (1 million).
>>>>>> However, when I try to upload a larger table (15 columns, 12 million
>>>>>> rows),
>>>>>> it creates the nodes but it doesn't set any properties.
>>>>>> I've tried to reduce the number of records (to 100) and also the
>>>>>> number of columns( just the Id property ), but no luck so far.
>>>>>>
>>>>>> The cypher command used is this one
>>>>>> USING PERIODIC COMMIT 100
>>>>>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv"
>>>>>> AS c
>>>>>> CREATE (:Client { Id: toInt(c.Id), FirstName: c.FirstName, LastName:
>>>>>> c.Lastname, Address: c.Address, ZipCode: toInt(c.ZipCode), Email:
>>>>>> c.Email,
>>>>>> Phone: c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL,
>>>>>> Latitude: toFloat(c.Latitude), Longitude: toFloat(c.Longitude),
>>>>>> AgencyId:
>>>>>> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)})
>>>>>>
>>>>>> Any help and indication is welcomed,
>>>>>> Paul
>>>>>>
>>>>>> --
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Neo4j" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to neo4j+un...@googlegroups.com.
>>>>>>
>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>
>>>>>
>>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Neo4j" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to neo4j+un...@googlegroups.com.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to neo4j+un...@googlegroups.com <javascript:>.
> For more options, visit https://groups.google.com/d/optout.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
