Re: Very slow tdbloader2 insertion

2017-04-17 Thread Laura Morales
> tdbloader2 builds b+trees from bottom to top, given sorted input. As > such blocks are streamed to disk which is disk-efficient. > > It is a series of java programs scripted together by a shell script. > > tdbloader is pure java. It builds the b+trees by inserting, which for > some idndxes is n

Re: tdbloader skip bad file

2017-04-17 Thread Laura Morales
> Check the data before loading. > > This is generally good practice. > > Call "riot --validate" before loading to check each file. Let's say I've downloaded these RDF files [1]. Some of those files are broken. How can I check-and-load all those files with a bash script? Should I loop all fil

Re: Delete/Insert single graph in dataset

2017-04-17 Thread Andy Seaborne
On 16/04/17 18:05, A. Soroka wrote: To load, yes. Just use the --graph=IRI (Act on a named graph) switch. You'll find all the useful switches by executing tdbloader --help. Neither of the loaders will delete anything, ever. I believe that tdbquery can execute SPARQL Update, which you could u

Re: Very slow tdbloader2 insertion

2017-04-17 Thread Andy Seaborne
tdbloader2 builds b+trees from bottom to top, given sorted input. As such blocks are streamed to disk which is disk-efficient. It is a series of java programs scripted together by a shell script. tdbloader is pure java. It builds the b+trees by inserting, which for some idndxes is not optima

Re: tdbloader skip bad file

2017-04-17 Thread Andy Seaborne
On 17/04/17 19:46, Laura Morales wrote: I'm trying to tdbload several .rdf files like this $ tdbloader --quiet --graph=... --loc=... ... problem is, if one file raises an exception (eg. bad IRI), the whole bunch is dropped, and no triples are loaded from any file. I've tried calling

tdbloader skip bad file

2017-04-17 Thread Laura Morales
I'm trying to tdbload several .rdf files like this $ tdbloader --quiet --graph=... --loc=... ... problem is, if one file raises an exception (eg. bad IRI), the whole bunch is dropped, and no triples are loaded from any file. I've tried calling tdbloader for each file, but it seems signi