Re: Estimation for Jena/Fuseki hardware requirements?

2016-03-29 Thread Ignacio Tripodi
Thanks, Andy. This is a collection of roughly 4.7M triples. How would the triple count affect the usage estimation, in relation to the total size? Best regards, -i On Sun, Mar 27, 2016 at 6:05 AM Andy Seaborne wrote: > On 21/03/16 01:28, Ignacio Tripodi wrote: > > Hey Andy, >

Re: riot, streaming & memory

2016-03-29 Thread Adrian Gschwend
On 29.03.16 19:13, Andy Seaborne wrote: Hi Andy, > So JSON-LD does not stream end-to-end. Ok I thought something like this. We have the same problem with the JavaScript JSON-LD library. > At 800Mb I would have expected a large enough heap to work for N-triples > output. Is the file available

Re: riot, streaming & memory

2016-03-29 Thread Andy Seaborne
On 29/03/16 13:53, Adrian Gschwend wrote: Hi group, I try to convert a 800MB JSON-LD file to something more readable (NT or Turtle) using riot. Unfortunately I run into memory issues: Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded I tried -Xmx up to 16GB but

Re: Loading RDF XML while Fuseki is running

2016-03-29 Thread Andy Seaborne
On 29/03/16 16:10, A. Soroka wrote: RDF/XML pretty much has to be loaded all together to be processed (because any given assertion in the XML depends on a lot of context which could be from elsewhere in the document), so when Fuseki receives the stream of XML, it's got to assemble a complete

Re: Loading RDF XML while Fuseki is running

2016-03-29 Thread A. Soroka
RDF/XML pretty much has to be loaded all together to be processed (because any given assertion in the XML depends on a lot of context which could be from elsewhere in the document), so when Fuseki receives the stream of XML, it's got to assemble a complete graph before it can act on the data.

Re: Loading RDF XML while Fuseki is running

2016-03-29 Thread Mikael Pesonen
Hi Osma! does thin mean that Fuseki loads the entire data into memory first? Dataset is bigger than installed memory on the server. Tried 3Gb which got it further but not to the finish line so trying bigger value tomorrow. Br, Mikael On 24.3.2016 17:19, Osma Suominen wrote: Hi Mikael!

riot, streaming & memory

2016-03-29 Thread Adrian Gschwend
Hi group, I try to convert a 800MB JSON-LD file to something more readable (NT or Turtle) using riot. Unfortunately I run into memory issues: Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded I tried -Xmx up to 16GB but no luck so far. According to the

RE: Fuseki with SDB - connection closed exception

2016-03-29 Thread John A. Fereira
Yes, that's it. I had to make some slight modifications to it to make it work with fuseki2. I probably should fork that repo and commit those changes to a new branch. -Original Message- From: Andy Seaborne [mailto:a...@apache.org] Sent: Tuesday, March 29, 2016 7:35 AM To:

RE: Fuseki with SDB - connection closed exception

2016-03-29 Thread John A. Fereira
I just realized that if you want to try working with the package I posted earlier that you’ll have to modify the configuration to use the Oracle driver and if you’re using Tomcat you’ll have to extract the war file into a directory, drop the oracle jdbc library in the WEB-INF/lib directory then

Re: Fuseki with SDB - connection closed exception

2016-03-29 Thread Andy Seaborne
On 29/03/16 11:59, John A. Fereira wrote: I work on a project which (still) Jena SDB and have bundled up versions of Fuseki with SDB and a ReconnectingSDB library that someone posted here a long time ago that handles database connections timing out. We’ve been using different versions of

Re: SPI DatasetGraph creating Triples/Quads on demand using DatasetGraphInMemory

2016-03-29 Thread Joint
Yep, that's mangled. I've refactored the code into a Jena package do you want me to create a patch for testing or it can be pulled from my github? Dick Original message From: Andy Seaborne Date: 29/03/2016 10:02 am (GMT+00:00) To:

RE: Fuseki with SDB - connection closed exception

2016-03-29 Thread John A. Fereira
I work on a project which (still) Jena SDB and have bundled up versions of Fuseki with SDB and a ReconnectingSDB library that someone posted here a long time ago that handles database connections timing out. We’ve been using different versions of this configuration for several years. I

Re: Fuseki with SDB - connection closed exception

2016-03-29 Thread Bangalore Akhilesh
Hi Andy, Sorry for the formatting issues. I have attached the configuration and exception log files for your reference. The database server did not restart and it is highly unlikely for the Fuseki server to be idle as we execute a suite of tests regularly on hourly basis. Something which I

Re: Fuseki with SDB - connection closed exception

2016-03-29 Thread Andy Seaborne
On 29/03/16 09:33, Bangalore Akhilesh wrote: Hi, We have deployed fuseki with SDB against Oracle database. We have used *jena-sdb-3.1.0-20160211.100203-49* with *apache-jena-fuseki-2.4.0-SNAPSHOT* . It worked fine for few days before we started to experience the SQL connection closed problems.

Re: SPI DatasetGraph creating Triples/Quads on demand using DatasetGraphInMemory

2016-03-29 Thread Andy Seaborne
On 16/03/16 20:05, Dick Murray wrote: Right, I think I cracked it! :-) Two classes defined below, one extends DatasetGraphInMemory, one provides a small test (basically a quad echo). Simple overview; addToNamedGraph writes the quad into a separate QuadTable if the transaction is READ

Re: Fuseki server: many data services or many fuseki installations?

2016-03-29 Thread Andy Seaborne
On 21/03/16 13:35, Alexandra Kokkinaki wrote: Hi Andy, thanks for your answers. On Fri, Mar 18, 2016 at 11:43 AM, Andy Seaborne wrote: Hi, it will depend on usage patterns. 2* 500 million isn't unreasonable but validating with your expected usage is essential. The critical

Fuseki with SDB - connection closed exception

2016-03-29 Thread Bangalore Akhilesh
Hi, We have deployed fuseki with SDB against Oracle database. We have used *jena-sdb-3.1.0-20160211.100203-49* with *apache-jena-fuseki-2.4.0-SNAPSHOT* . It worked fine for few days before we started to experience the SQL connection closed problems. Can you please let me know why this is