Well, the csv file contains some rows that do not have a value for CityId, and the rows are unique regarding the clientID. There are 11M clients living in 14K Cities. Is there a limit of links/node? Now I've created a piece of code that reads from file and creates each relationship, but, as you can imagine, it works really slow in this scenario.
> did you create an index on :Client(Id) and :City(Id) > > what happens if you do: > > LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS > c > MATCH (client: Client { Id: toInt(c.Id)}) > > RETURN count(*) > > LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" AS > c > MATCH (city: City { Id: toInt(c.CityId)}) > > RETURN count(*) > > each count should be equivalent to the # of rows in the file. > > Michael > > Am 16.06.2014 um 17:47 schrieb Paul Damian <paulda...@gmail.com > <javascript:>>: > > Somehow I've managed to load all the nodes and now I'm trying to load the > links as well. I read the nodes from csv file and create the relation > between them. I run the following command: > USING PERIODIC COMMIT 100 > LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/LOCATED_IN.csv" > AS c > MATCH (client: Client { Id: toInt(c.Id)}), (city: City { Id: > toInt(c.CityId)}) > CREATE (client)-[r:LOCATED_IN]->(city) > > Running with a smaller commit size returns this error > Neo.DatabaseError.Statement.ExecutionFailure, while increasing the commit > size to 10000 throws Neo.DatabaseError.General.UnknownFailure. > Can you help me with this? > > > joi, 5 iunie 2014, 12:05:18 UTC+3, Michael Hunger a scris: >> >> Perhaps something with field or line terminators? >> >> I assume it blows up the field separation. >> >> Try to run: >> >> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv" AS c >> RETURN { Id: toInt(c.Id), FirstName: c.FirstName, LastName: c.Lastname, >> Address: c.Address, ZipCode: toInt(c.ZipCode), Email: c.Email, Phone: >> c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL, Latitude: >> toFloat(c.Latitude), Longitude: toFloat(c.Longitude), AgencyId: >> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)} as data, c as line >> LIMIT 3 >> >> >> >> On Thu, Jun 5, 2014 at 10:51 AM, Paul Damian <paulda...@gmail.com> wrote: >> >>> I've tried using the shell and I get the same results: nodes with no >>> properties. >>> I've created the csv file using MsSQL Server Export. Is it relevant? >>> >>> About you curiosity: I figured I would import first the nodes, then the >>> relationships from the connection tables. Am I doing it wrong? >>> >>> Thanks >>> >>> joi, 5 iunie 2014, 09:54:31 UTC+3, Michael Hunger a scris: >>>> >>>> I'd probably use a commit size in your case of 50k or 100k. >>>> >>>> Try to use the neo4j-shell and not the web-interface. >>>> >>>> Connect to neo4j using bin/neo4j-shell >>>> >>>> Then run your commands ending with a semicolon. >>>> >>>> Just curious: Your data is imported as one node per row? That's not >>>> really a graph structure. >>>> >>>> >>>> >>>> >>>> On Wed, Jun 4, 2014 at 6:56 PM, Paul Damian <paulda...@gmail.com> >>>> wrote: >>>> >>>>> Hi there, >>>>> >>>>> I'm experimenting with Neo4j while benchmarking a bunch of NoSQL >>>>> databases for my graduation paper. >>>>> I'm using the web interface to populate the database. I've been able >>>>> to load the smaller tables from my SQL database and LOAD CSV works fine. >>>>> By small, I mean a few columns (4-5) and some rows (1 million). >>>>> However, when I try to upload a larger table (15 columns, 12 million >>>>> rows), >>>>> it creates the nodes but it doesn't set any properties. >>>>> I've tried to reduce the number of records (to 100) and also the >>>>> number of columns( just the Id property ), but no luck so far. >>>>> >>>>> The cypher command used is this one >>>>> USING PERIODIC COMMIT 100 >>>>> LOAD CSV WITH HEADERS FROM "file:/Users/pauld/Documents/Client.csv" >>>>> AS c >>>>> CREATE (:Client { Id: toInt(c.Id), FirstName: c.FirstName, LastName: >>>>> c.Lastname, Address: c.Address, ZipCode: toInt(c.ZipCode), Email: >>>>> c.Email, >>>>> Phone: c.Phone, Fax: c.Fax, BusinessName: c.BusinessName, URL: c.URL, >>>>> Latitude: toFloat(c.Latitude), Longitude: toFloat(c.Longitude), AgencyId: >>>>> toInt(c.AgencyId), RowStatus: toInt(c.RowStatus)}) >>>>> >>>>> Any help and indication is welcomed, >>>>> Paul >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Neo4j" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to neo4j+un...@googlegroups.com. >>>>> >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Neo4j" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to neo4j+un...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> > -- > You received this message because you are subscribed to the Google Groups > "Neo4j" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to neo4j+un...@googlegroups.com <javascript:>. > For more options, visit https://groups.google.com/d/optout. > > > -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to neo4j+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.