Sure y. And testing with LIMIT 1000000 works and needs 1 min or so. So this is just a Heap Stack thingi.
I'm from Germany like you ;) Am Sonntag, 21. September 2014 19:25:15 UTC+2 schrieb Michael Hunger: > > In what Timezone are you located? Perhaps someone can help you and have a > look at your setup? via Skype > > But you have an index or constraint on the thing you match? > > CREATE INDEX ON :Appln(ID); > > > > On Sun, Sep 21, 2014 at 4:08 PM, 'Curtis Mosters' via Neo4j < > [email protected] <javascript:>> wrote: > >> Jup, same issue with >> >> *-Xmx512M*So you have any other tips? Observing the IO values, it seems >> to idle =/ >> >> Am Samstag, 20. September 2014 12:58:33 UTC+2 schrieb Curtis Mosters: >> >>> Well I tried it with >>> >>> *-Xms4096m -Xmx15000m* >>> >>> but the import did not finish in now 16 hours. >>> >>> Now I try your >>> >>> *-Xmx512M* >>> >>> Am Freitag, 19. September 2014 16:08:42 UTC+2 schrieb Michael Hunger: >>>> >>>> If you specifiy it I'd keep it to a few MB (e.g. -Xmx512M) as the shell >>>> against a running server is just a terminal. >>>> It's different if when you run the shell against a on-disk directory >>>> then it fires up the database itself. >>>> >>>> Your memory config looks ok otherwise, I'd only swap mapped memory >>>> settings for nodes (to 50MB) and rels (to 500MB) >>>> >>>> I think there was one memory issue in 2.1.3 could you try it with 2.1.4 >>>> ? >>>> >>>> Michael >>>> >>>> >>>> On Fri, Sep 19, 2014 at 4:00 PM, 'Curtis Mosters' via Neo4j < >>>> [email protected]> wrote: >>>> >>>>> Here is the complete file, well I still don't know which settings are >>>>> the best in my case. >>>>> >>>>> Should I delete the Xmx thing? Is it better to not specify it? >>>>> >>>>> Am Donnerstag, 18. September 2014 23:14:09 UTC+2 schrieb Michael >>>>> Hunger: >>>>>> >>>>>> If you connect to the server it uses the servers RAM >>>>>> The shell then needs much less like 512m >>>>>> >>>>>> Can you check the server's graph.db/messages.log for the root cause >>>>>> error? >>>>>> >>>>>> Which version? >>>>>> >>>>>> Sent from mobile device >>>>>> >>>>>> Am 18.09.2014 um 14:28 schrieb "'Curtis Mosters' via Neo4j" < >>>>>> [email protected]>: >>>>>> >>>>>> Well I was thinking that the Xmx is the heap and it should be not >>>>>> above 4 GB, so far I have learned. >>>>>> >>>>>> I currently let the import run with "COMMIT 100" so every 100 lines, >>>>>> and it's still running. >>>>>> >>>>>> But looking on the IO it seems to idle... >>>>>> >>>>>> I don't know, but could you tell me exactly where to set which >>>>>> setting? >>>>>> >>>>>> As I said I have 30 GB RAM. To avoid more complications let's maybe >>>>>> set the Heap 4 GB and the maximum RAM to 20 GB. >>>>>> >>>>>> And again I use the Neo4jShell for the import. It's loading a file >>>>>> containing LOAD CSV. >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Am Donnerstag, 18. September 2014 13:42:34 UTC+2 schrieb Clark Richey: >>>>>>> >>>>>>> According to the screenshot you don't give it 30G of ram. You only >>>>>>> provide 3G. Is that your intent? >>>>>>> >>>>>>> Sent from my iPhone >>>>>>> >>>>>>> On Sep 18, 2014, at 02:51, 'Curtis Mosters' via Neo4j < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>> Well somehow the behaviour of the Shell is odd. >>>>>>> >>>>>>> I imported 76 Mio lines without any problems. But now I have started >>>>>>> a new import over night and now I watched the process and it said Java >>>>>>> Heap >>>>>>> Space Error. >>>>>>> >>>>>>> But that cannot be. I have set the Neo4jShell.bat like this: >>>>>>> >>>>>>> %JAVACMD% -Xmx3G *-Dstorage.diskCache.bufferSize=20000* %JAVA_OPTS% >>>>>>> %EXTRA_JVM_ARGUMENTS% -classpath %CLASSPATH_PREFIX%;%CLASSPATH% - >>>>>>> Dapp.name="neo4j-shell" -Dapp.repo="%REPO%" -Dbasedir="%BASEDIR%" >>>>>>> org.neo4j.shell.StartClient %CMD_LINE_ARGS% >>>>>>> >>>>>>> That is a great ratio of heap. But yeah why did I get this error? I >>>>>>> have 30 GB RAM. This happens so random that a productive import is >>>>>>> nearly >>>>>>> impossible. >>>>>>> >>>>>>> So my question is, what have I done wrong? Where do I need to set >>>>>>> the Java Settings correctly? Were my edited settings active? >>>>>>> >>>>>>> Here the first file or let's say script i'm loading in and where >>>>>>> this error happens: >>>>>>> >>>>>>> USING PERIODIC COMMIT 2000 >>>>>>> LOAD CSV WITH HEADERS FROM "file:///C:/data/tls202_part01.txt" AS >>>>>>> csvLine WITH csvLine LIMIT 1000 >>>>>>> MATCH (appln:Appln) >>>>>>> WHERE appln.ID = toInt(csvLine.appln_id) >>>>>>> CREATE (title:Title { title:csvLine.appln_title }) >>>>>>> CREATE (appln)-[:HAS_TITLE]->(title); >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Neo4j" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Neo4j" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Neo4j" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >> You received this message because you are subscribed to the Google Groups >> "Neo4j" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "Neo4j" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
