if they don't have a value for city id, do they then have empty columns there 
still? like "user-id,,

You probably want to filter these rows?

>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS c
WHERE coalesce(c.CitiId,"") <> ""
...

Am 17.06.2014 um 11:23 schrieb Paul Damian <pauldamia...@gmail.com>:

> Well, the csv file contains some rows that do not have a value for CityId, 
> and the rows are unique regarding the clientID. There are 11M clients living 
> in 14K Cities. Is there a limit of links/node?
> Now I've created a piece of code that reads from file and creates each 
> relationship, but, as you can imagine, it works really slow in this scenario.
>  
> did you create an index on :Client(Id) and :City(Id)
> 
> what happens if you do:
> 
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS c
>>  MATCH (client: Client { Id: toInt(c.Id)})
> RETURN count(*)
> 
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS c
>>  MATCH (city: City { Id: toInt(c.CityId)})
> RETURN count(*)
> 
> each count should be equivalent to the # of rows in the file.
> 
> Michael
> 
> Am 16.06.2014 um 17:47 schrieb Paul Damian <paulda...@gmail.com>:
> 
>> Somehow I've managed to load all the nodes and now I'm trying to load the 
>> links as well. I read the nodes from csv file and create the relation 
>> between them. I run the following command:
>> USING PERIODIC COMMIT 100 
>>  LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS c
>>  MATCH (client: Client { Id: toInt(c.Id)}), (city: City { Id: 
>> toInt(c.CityId)})
>>  CREATE (client)-[r:LOCATED_IN]->(city)
>> 
>> Running with a smaller commit size returns this error 
>> Neo.DatabaseError.Statement.ExecutionFailure, while increasing the commit 
>> size to 10000 throws Neo.DatabaseError.General.UnknownFailure. 
>> Can you help me with this?
>> 
>> 
>> joi, 5 iunie 2014, 12:05:18 UTC+3, Michael Hunger a scris:
>> Perhaps something with field or line terminators?
>> 
>> I assume it blows up the field separation.
>> 
>> Try to run:
>> 
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv" AS c
>> RETURN { Id: toInt(c.Id), FirstName: c.FirstName, LastName: c.Lastname, 
>> Address: c.Address, ZipCode: toInt(c.ZipCode), Email: c.Email, Phone: 
>> c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL, Latitude: 
>> toFloat(c.Latitude), Longitude: toFloat(c.Longitude), AgencyId: 
>> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)} as data, c as line
>> LIMIT 3
>> 
>> 
>> 
>> On Thu, Jun 5, 2014 at 10:51 AM, Paul Damian <paulda...@gmail.com> wrote:
>> I've tried using the shell and I get the same results: nodes with no 
>> properties.
>> I've created the csv file using MsSQL Server Export. Is it relevant?
>> 
>> About you curiosity: I figured I would import first the nodes, then the 
>> relationships from the connection tables. Am I doing it wrong?
>> 
>> Thanks
>> 
>> joi, 5 iunie 2014, 09:54:31 UTC+3, Michael Hunger a scris:
>> I'd probably use a commit size in your case of 50k or 100k.
>> 
>> Try to use the neo4j-shell and not the web-interface.
>> 
>> Connect to neo4j using bin/neo4j-shell
>> 
>> Then run your commands ending with a semicolon.
>> 
>> Just curious: Your data is imported as one node per row? That's not really a 
>> graph structure.
>> 
>> 
>> 
>> 
>> On Wed, Jun 4, 2014 at 6:56 PM, Paul Damian <paulda...@gmail.com> wrote:
>> Hi there,
>> 
>> I'm experimenting with Neo4j while benchmarking a bunch of NoSQL databases 
>> for my graduation paper. 
>> I'm using the web interface to populate the database. I've been able to load 
>> the smaller tables from my SQL database and LOAD CSV works fine.
>> By small, I mean a few columns (4-5) and some rows (1 million). However, 
>> when I try to upload a larger table (15 columns, 12 million rows), it 
>> creates the nodes but it doesn't set any properties.
>> I've tried to reduce the number of records (to 100) and also the number of 
>> columns( just the Id property ), but no luck so far.
>> 
>> The cypher command used is this one
>> USING PERIODIC COMMIT 100
>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv" AS c
>> CREATE (:Client { Id: toInt(c.Id), FirstName: c.FirstName, LastName: 
>> c.Lastname, Address: c.Address, ZipCode: toInt(c.ZipCode), Email: c.Email, 
>> Phone: c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL, 
>> Latitude: toFloat(c.Latitude), Longitude: toFloat(c.Longitude), AgencyId: 
>> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)})
>> 
>> Any help and indication is welcomed,
>> Paul
>> 
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to neo4j+un...@googlegroups.com.
>> 
>> For more options, visit https://groups.google.com/d/optout.
>> 
>> 
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>> 
>> 
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to neo4j+un...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Neo4j" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to neo4j+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to neo4j+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to