Re: [Neo] verbosequadstore loading

2010-04-20 Thread Mattias Persson
We have that bug registered at https://trac.neo4j.org/ticket/227 I'll try to look into it a.s.a.p 2010/4/19 Lyudmila L. Balakireva > Hi, > I still have trouble to build the triple store. I got the following error > and will be great to understand why : > > > Cache not enabled for 'uri' Setting

Re: [Neo] verbosequadstore loading

2010-04-19 Thread Lyudmila L. Balakireva
Hi, I still have trouble to build the triple store. I got the following error and will be great to understand why : Cache not enabled for 'uri' Setting it (LuceneIndexService#enableCache) to 10 file: links_gutenberg_en.nt file: links_uscensus_en.nt file: links_cyc_en.nt file: infobox_en.nt f

Re: [Neo] verbosequadstore loading

2010-04-15 Thread Lyudmila L. Balakireva
new hint : I commented out the ((LuceneIndexService) indexService).enableCache( "uri", 50 ); and it started to work. Is this cache setting mixed up with commit() ? > It does not solve the problem. I removed the if (count>=1) { block > and do commit after every rc.add but program

Re: [Neo] verbosequadstore loading

2010-04-15 Thread Lyudmila L. Balakireva
It does not solve the problem. I removed the if (count>=1) { block and do commit after every rc.add but programfails on last file. More over I did run the program with rc.add( file, "", RDFFormat.NTRIPLES,context); commiting only once, after all files are loaded and it is finished

Re: [Neo] verbosequadstore loading

2010-04-15 Thread Mattias Persson
You increment the "count" variable even if the line is empty... which means that it could possibly skip the 1 mark sometimes, change the condition to "if(count >=1)" instead. Also how much heap have you given the JVM? 2010/4/14 Lyudmila L. Balakireva > Hi, > I was loading on by file ba

Re: [Neo] verbosequadstore loading

2010-04-14 Thread Lyudmila L. Balakireva
Hi, I was loading on by file basis and was commiting after each file. Even though 22 mln file was finished in 5 hours and 66 mln did not finish in 3 days. I rewrite the program to read file and commit after some amount of records in hope better to control memory but program fails with " out

Re: [Neo] verbosequadstore loading

2010-04-09 Thread Mattias Persson
There are some problems at the moment regarding insertion speeds. o We haven't yet created an rdf store which can use a BatchInserter (which could also be tweaked to ignore checking if statements already exists before it adds each statement and all that). o The other one is that the sail layer on

[Neo] verbosequadstore loading

2010-04-08 Thread Lyudmila L. Balakireva
Hi, How to optimize loading to the VerboseQuadStore? I am doing test similar to the test example from neo rdf sail and it is very slow. The size of files 3G - 7G . Thanks, Luda ___ Neo mailing list User@lists.neo4j.org https://lists.neo4j.org/mailm