Re: 10g data loading in Fuseki
Reihan, How are you uploading the file? Via the UI or via the API? The UI has a limitation whereby the incoming file needs to buffer the incoming whereas directly (e.g. the s-put script, or curl, wget). 10G would need a a lot of heap in the But the error will be java.lang.OutOfMemoryError and appear in the server log file. What is in the server log file? SessionTimesOut is not a message that Fuseki iotself emits. Is that the browser? As Osma says, loading using the bulkloader tocreate a database and placing it in a fuskei server is the normal way. Or split the file : even then the UI is not able to cope with a single large file. NTriples can be split on line boundaries. Turtle files need more care - the prefixes must be in each file. (a way to deal with that: load a NTriples, splitting as needed, ad also load a Turtle file with just the prefixes). Andy Adam, Osma : no problem in TDB2 :-) On 18/01/17 15:54, A. Soroka wrote: It's surely true that a 10GB file is not appropriate for direct upload. You could, if you absolutely must, split your NTriples file into many pieces and make many SPARQL Updates with them. But Osma's suggestion is much better, especially because if you are starting from an empty dataset you will get proper data statistics automatically by the means he suggests. --- A. Soroka The University of Virginia Library On Jan 18, 2017, at 10:50 AM, Osma Suominen wrote: Hi Reihan, You cannot upload files this big via Fuseki. Try tdbloader or tdbloader2 instead for batch loading your triples into TDB outside Fuseki. -Osma 18.01.2017, 17:07, Reihaneh Amini kirjoitti: Hi Dear sir or madam, I have a frustrating problem which is not going well with Fuseki. I have a .nt file size 10G and I want to upload it into fuseki server as TDB structure not in-memory. After running the server, if I upload it one-time I get SessionTimesOut error, how can I address this problem? Please help me what is your recommendation? Regards, Reihan -- Osma Suominen D.Sc. (Tech), Information Systems Specialist National Library of Finland P.O. Box 26 (Kaikukatu 4) 00014 HELSINGIN YLIOPISTO Tel. +358 50 3199529 osma.suomi...@helsinki.fi http://www.nationallibrary.fi
Re: 10g data loading in Fuseki
It's surely true that a 10GB file is not appropriate for direct upload. You could, if you absolutely must, split your NTriples file into many pieces and make many SPARQL Updates with them. But Osma's suggestion is much better, especially because if you are starting from an empty dataset you will get proper data statistics automatically by the means he suggests. --- A. Soroka The University of Virginia Library > On Jan 18, 2017, at 10:50 AM, Osma Suominen wrote: > > Hi Reihan, > > You cannot upload files this big via Fuseki. Try tdbloader or tdbloader2 > instead for batch loading your triples into TDB outside Fuseki. > > -Osma > > > 18.01.2017, 17:07, Reihaneh Amini kirjoitti: >> Hi Dear sir or madam, >> >> I have a frustrating problem which is not going well with Fuseki. >> I have a .nt file size 10G and I want to upload it into fuseki server as >> TDB structure not in-memory. >> >> After running the server, if I upload it one-time I get SessionTimesOut >> error, how can I address this problem? >> >> Please help me what is your recommendation? >> >> >> Regards, >> Reihan >> > > > -- > Osma Suominen > D.Sc. (Tech), Information Systems Specialist > National Library of Finland > P.O. Box 26 (Kaikukatu 4) > 00014 HELSINGIN YLIOPISTO > Tel. +358 50 3199529 > osma.suomi...@helsinki.fi > http://www.nationallibrary.fi
Re: 10g data loading in Fuseki
Hi Reihan, You cannot upload files this big via Fuseki. Try tdbloader or tdbloader2 instead for batch loading your triples into TDB outside Fuseki. -Osma 18.01.2017, 17:07, Reihaneh Amini kirjoitti: Hi Dear sir or madam, I have a frustrating problem which is not going well with Fuseki. I have a .nt file size 10G and I want to upload it into fuseki server as TDB structure not in-memory. After running the server, if I upload it one-time I get SessionTimesOut error, how can I address this problem? Please help me what is your recommendation? Regards, Reihan -- Osma Suominen D.Sc. (Tech), Information Systems Specialist National Library of Finland P.O. Box 26 (Kaikukatu 4) 00014 HELSINGIN YLIOPISTO Tel. +358 50 3199529 osma.suomi...@helsinki.fi http://www.nationallibrary.fi
Fwd: 10g data loading in Fuseki
Hi Dear sir or madam, I have a frustrating problem which is not going well with Fuseki. I have a .nt file size 10G and I want to upload it into fuseki server as TDB structure not in-memory. After running the server, if I upload it one-time I get SessionTimesOut error, how can I address this problem? Please help me what is your recommendation? Regards, Reihan -- Regards, -Reihan -- Regards, -Reihan
10g data loading in Fuseki
Hi Dear sir or madam, I have a frustrating problem which is not going well with Fuseki. I have a .nt file size 10G and I want to upload it into fuseki server as TDB structure not in-memory. After running the server, if I upload it one-time I get SessionTimesOut error, how can I address this problem? Please help me what is your recommendation? Regards, Reihan -- Regards, -Reihan
