application/sparql-results+json,*/* Accept header returns XML

2019-05-30 Thread Mikael Pesonen
- E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Highlighting text results

2019-05-27 Thread Mikael Pesonen
any idea what is wrong here? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Trouble with querying with language in Jena text

2019-05-03 Thread Mikael Pesonen
it possible that the 20 sec query is returning a lot more data than the < 1 sec query? I usually find that the underlying jena query time is easily dominated by data transfer costs to a browser. Chris On May 2, 2019, at 9:29 AM, Mikael Pesonen wrote: Another issue in same setup. Following

Re: Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
is On May 2, 2019, at 5:56 AM, Mikael Pesonen wrote: I'm using Jena 3.11, full server as jar, and have following text index config: <#indexLucene> a text:TextIndexLucene ; text:directory ; text:entityMap <#entMap> ; text:storeValues true ; te

Re: Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
collected at all? What would be the correctway to make this query? Number of documents is about 3000, and number or triplets per document is 10. On 02/05/2019 13:56, Mikael Pesonen wrote: I'm using Jena 3.11, full server as jar, and have following text index config: <#indexLucene&

Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki authentication

2019-04-30 Thread Mikael Pesonen
. [] rdf:type fuseki:Server ;    fuseki:passwd "passwdFile";    fuseki:auth   "basic" ;    fuseki:allowedUsers "*";    .     Andy On 29/04/2019 16:26, Mikael Pesonen wrote: Entire config.ttl: @prefix :<http://localhost/jena_example/#>  . @prefix rdf:<htt

Re: Fuseki authentication

2019-04-30 Thread Mikael Pesonen
shiro.ini. The data-access-control.html applies to Fuseki Main. 3.10.0 works for me. [] rdf:type fuseki:Server ;    fuseki:passwd "passwdFile";    fuseki:auth   "basic" ;    fuseki:allowedUsers "*";    .     Andy On 29/04/2019 16:26, Mikael Pesonen wrote: Entire c

Re: Fuseki authentication

2019-04-29 Thread Mikael Pesonen
ot; ; fuseki:auth    "basic" ;      fuseki:allowedUsers    "*" ; Br On 29/04/2019 18:09, Andy Seaborne wrote: On 29/04/2019 15:42, Mikael Pesonen wrote: I'm using Fuseki 3.10.0 and following this guide: http://jena.staging.apache.org/documentation/fuseki2/data-

Re: Fuseki authentication

2019-04-29 Thread Mikael Pesonen
vice      fuseki:serviceUpdate    "update" ;   # SPARQL update service fuseki:serviceUpload    "upload" ;   # Non-SPARQL upload service fuseki:serviceReadWriteGraphStore "data" ; # SPARQL Graph store protocol (read and write) fuseki:dataset  

Fuseki authentication

2019-04-29 Thread Mikael Pesonen
ation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Using content with meta on text index

2019-02-28 Thread Mikael Pesonen
Osma and Chris. My limited understanding of Lucene implies that only one JVM at a time can lock an index, but the last time I looked at that question was years ago, so take that with a bucket of salt. ajs6f On Feb 21, 2019, at 9:02 AM, Mikael Pesonen wrote: Reason I'm asking this i

Re: Using content with meta on text index

2019-02-21 Thread Mikael Pesonen
re in Jena. For example we have query like content matches "language AND technology" & metadata matches dcterms:created > "2019-01-01" On 20/02/2019 10:46, Mikael Pesonen wrote: Not sure. Reading Jena text documentation, it states that external document contents can

Re: Using content with meta on text index

2019-02-20 Thread Mikael Pesonen
9, at 6:23 AM, Mikael Pesonen wrote: Hi, Our system stores documents with separate rest API and document id's are stored, along with document metadata, to Jena db. we would like to make text queries that target both the document contents and meta data. Is there a recommended/supported w

Using content with meta on text index

2019-02-14 Thread Mikael Pesonen
a and Lucene? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279

Re: Out of memory

2019-02-06 Thread Mikael Pesonen
y JVM profilers available. Rob On 05/02/2019, 11:07, "Mikael Pesonen" wrote: Tested with 16GB, and java mem usage goes up to 10G (virt 14G). Wondering what does the java -Xms do actually... There was no way to limit

Re: Out of memory

2019-02-05 Thread Mikael Pesonen
On Tue, Jan 29, 2019 at 9:43 AM Mikael Pesonen wrote: On 29/01/2019 16:28, Rob Vesse wrote: This may be partly a case of a simple looking query having unexpected execution semantics. Strictly speaking your query says select all triples in the specific graph then join them with these list of valu

Re: Out of memory

2019-01-30 Thread Mikael Pesonen
GB ram? I'd try 16GB and see how it does; watch the total memory usage. On Tue, Jan 29, 2019 at 9:43 AM Mikael Pesonen wrote: On 29/01/2019 16:28, Rob Vesse wrote: This may be partly a case of a simple looking query having unexpected execution semantics.  Strictly speaking yo

Re: Out of memory

2019-01-30 Thread Mikael Pesonen
29/01/2019, 14:06, "Mikael Pesonen" wrote: Server: /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/log4j.properties -Xmx5600M -jar fuseki-server.jar --update --port 3030 --loc=/home/text/tools/jena_data_test/ /ds

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
running and making GSP calls. Rob On 29/01/2019, 14:06, "Mikael Pesonen" wrote: Server: /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/log4j.properties -Xmx5600M -jar fuseki-server.jar --update --port 3030 -

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
In addition to reply to Andy, all queries are run in serial. On 29/01/2019 15:52, Rob Vesse wrote: Comments inline: On 29/01/2019, 11:34, "Mikael Pesonen" wrote: I'm not able to run a basic read-only script without running out of memor

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
xcept to mention the suspects like sorting. With all the questions on the list, I personally don't track the details of each installation so please also remind me of your current setup.     Andy On 29/01/2019 11:32, Mikael Pesonen wrote: I'm not able to run a basic read-only scr

Out of memory

2019-01-29 Thread Mikael Pesonen
50k times. All settings are default, using GSP. -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer

Out of memory

2019-01-29 Thread Mikael Pesonen
50k times. All settings are default, using GSP. Should I set some settings to avoid this behaviour? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books

Re: Using Jena text search with all predicates

2019-01-25 Thread Mikael Pesonen
lude it as part of your configuration. Also see the last part of my message that you quoted: if you think something in Jena (or jena-text) needs to be changed, please open an issue on JIRA and submit a pull request. -Osma Mikael Pesonen kirjoitti 23.1.2019 klo 14.09: Hi, sorry to br

Re: Using Jena text search with all predicates

2019-01-23 Thread Mikael Pesonen
ation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-23 Thread Mikael Pesonen
seki2/fuseki-configuration.html You need to add fuseki:serviceQuery "sparql" as an additional entry to your fuseki:Service definition in order for it to respond to SPARQL queries on /ds/sparql Rob On 22/01/2019, 15:28, "Mikael Pesonen" wrote: This is the call Skos

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
you reboot, but you may have trouble when restarting Fuseki text:directory Le 22/01/2019 à 16:21, Mikael Pesonen a écrit : Sorry had issues with permissions. So now I can load configuration from cmd line /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/l

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
This is the call Skosmos makes: GET http://localhost:3030/ds/sparql?query=... On 22/01/2019 17:21, Mikael Pesonen wrote: Sorry had issues with permissions. So now I can load configuration from cmd line /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
    text:map ( [ text:field "label" ;    text:predicate skos:prefLabel ] ) . <#service> rdf:type fuseki:Service ;     fuseki:name "/ds" ;   # http://host:port/ds-ro     fuseki:serviceQuery "query" ;

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
;     text:map ( [ text:field "label" ;    text:predicate skos:prefLabel ] ) . <#service> rdf:type fuseki:Service ;     fuseki:name "/ds" ;   # http://host:port/ds-ro     fuseki:serviceQuery "query" ;    # SPARQL q

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
eki:dataset   :text_dataset ;     . -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
ot;graph" ; ## enable graph-specific indexing text:map ( [ text:field "label" ; text:predicate skos:prefLabel ] ) ; . hth, Chris On Jan 21, 2019, at 5:21 AM, Mikael Pesonen wrote: Hi, On 18/01/2019 18:13, Chris Tomlinson wrote: Hi,

Re: Text search from sparql

2019-01-21 Thread Mikael Pesonen
:query is invoked, but may be a noop Thanks, Chris On Jan 18, 2019, at 8:08 AM, Mikael Pesonen wrote: On 18/01/2019 13:40, Andy Seaborne wrote: On 17/01/2019 15:45, Mikael Pesonen wrote: On 17/01/2019 17:38, Andy Seaborne wrote: On 17/01/2019 12:51, Mikael Pesonen wrote: On 17/01/2019

Re: Text search from sparql

2019-01-18 Thread Mikael Pesonen
On 18/01/2019 13:40, Andy Seaborne wrote: On 17/01/2019 15:45, Mikael Pesonen wrote: On 17/01/2019 17:38, Andy Seaborne wrote: On 17/01/2019 12:51, Mikael Pesonen wrote: On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying t

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
On 17/01/2019 17:38, Andy Seaborne wrote: On 17/01/2019 12:51, Mikael Pesonen wrote: On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be f

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
Is that path file:///home/text/tools/apache-jena-fuseki-3.9.0/webapp/ correct, should it be file:/home/text/tools/apache-jena-fuseki-3.9.0/webapp/ ? Where does that setting come from? On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm tryi

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be faster. Application is term search using SKOS ontology.   First tested if it's

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
links on the page could be useful too. In the code I used I had to replace "<#dataset>" with ":tdb_dataset_readwrite Le 16/01/2019 à 15:47, Mikael Pesonen a écrit : Thanks for reply. Didn't find any info on fixed Uri on that page, it seemed to be about

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
is in the config file (pasted on the page) but I thought the links on the page could be useful too. In the code I used I had to replace "<#dataset>" with ":tdb_dataset_readwrite Le 16/01/2019 à 15:47, Mikael Pesonen a écrit : Thanks for reply. Didn't find any inf

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
to set a fixed Uri for the dataset (see my question here : https://stackoverflow.com/questions/48318966/fuseki-config-for-2-datasets-text-index-how-to-use-turtle-files) Le 16/01/2019 à 13:50, Mikael Pesonen a écrit : Hi, I'm trying to get text search work. Sparql REGEX takes

Text search from sparql

2019-01-16 Thread Mikael Pesonen
Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be faster. Application is term search using SKOS ontology.  First tested if it's enabled by default  ?concept text:query (skos:prefLabel "medi") .   ?concept skos:prefLabel ?prefLabel Tha

Error 500: RecordRangeIterator: records not strictly increasing

2018-09-07 Thread Mikael Pesonen
+) SELECT count(?subject) WHERE { graph ?g { ?subject ?predicate ?object }} -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mika

Re: TransactionManager ERROR There are now active transactions

2018-08-23 Thread Mikael Pesonen
d set up a simulator for your environment. Then, maybe, it will cause show the log message.  Or maybe not, because of all the different machinery. Maybe it is something to do with connection patterns.     Andy On 22/08/18 14:57, Mikael Pesonen wrote: Any luck reproducing the error yet? Br On

Re: TransactionManager ERROR There are now active transactions

2018-08-22 Thread Mikael Pesonen
Any luck reproducing the error yet? Br On 13.8.2018 13:59, Mikael Pesonen wrote: Sorry https://www.dropbox.com/s/xy9d06ixjv8stif/fuseki_test.zip?dl=0 On 13.8.2018 13:32, Andy Seaborne wrote: On 13/08/18 11:12, Mikael Pesonen wrote: This was just an example, here is the test set with

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
rg/Organization";, "schema:name" : "Lingsoft, Inc." } ] } I didn’t check whether this would be returned by the jena API (it should). Note the: "schema:provider" : { "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6";

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
t;http://schema.org/category";     }   } } {   "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6";,   "@type" : "http://schema.org/Organization";,   "name" : "Lingsoft, Inc.",   "@context" : {     &qu

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
gsoft, Inc." }, by “name” : "Lingsoft, Inc.”, then the structured data testing tool doesn’t complain anymore. I’d be curious to know what schema.org’s people say about that. fps Le 16 août 2018 à 15:07, Mikael Pesonen a écrit : I'm exporting JSON-LD from Fuseki into we

Re: Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
Okay so looks like it might be better to look at microdata or RDFa at this point... I'll send them a note just in case. Thanks! On 16.8.2018 16:31, Damian Steer wrote: On 16 Aug 2018, at 14:07, Mikael Pesonen wrote: I'm exporting JSON-LD from Fuseki into web page, bu

Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
;>http://schema.org/name"</a>;     }   } } Google's validation says name is not a known valid target type for the name property and error is pointing to line containing the first  "name" : { Anyone got an idea what is wrong and how to fix the data? Sorry if this

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
Sorry https://www.dropbox.com/s/xy9d06ixjv8stif/fuseki_test.zip?dl=0 On 13.8.2018 13:32, Andy Seaborne wrote: On 13/08/18 11:12, Mikael Pesonen wrote: This was just an example, here is the test set with instructions: https://www.dropbox.com/s/r1fd48v62822u2n/How%20to%20use%20the

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
e same place in the sequence of operations every time?     Andy On 10/08/18 15:17, Mikael Pesonen wrote: Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.

Re: TransactionManager ERROR There are now active transactions

2018-08-10 Thread Mikael Pesonen
Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.2018 16:28, Andy Seaborne wrote: On 09/08/18 13:20, Mikael Pesonen wrote: Does Fuseki info level

Re: TransactionManager ERROR There are now active transactions

2018-08-09 Thread Mikael Pesonen
requests the scripts are making, then with a copy of the data, it might be possible to recreate the situation. Otherwise it's "something happened".  I can't see how to recreate it without a use case.     Andy On 07/08/18 10:06, Mikael Pesonen wrote: Are there any further t

Re: TransactionManager ERROR There are now active transactions

2018-08-07 Thread Mikael Pesonen
Are there any further tests I could do that might help solving this? On 6.8.2018 14:01, aj...@apache.org wrote: It tells us that the problem seems more likely to be with TDB than with Fuseki, which is a step towards isolating it. Adam On Mon, Aug 6, 2018, 5:55 AM Mikael Pesonen wrote

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
Sorry upcloud is Finnish cloud service provider. On 6.8.2018 12:55, Mikael Pesonen wrote: With in-memory db everything works. Ran ~5 operations x10 (10 scripts in parallel) and no problems. Mem usage was 3g-5,5g (java xmx4000) and vm 10g. So what does this tell? System is upcloud

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
ajs6f On Aug 3, 2018, at 8:01 AM, Mikael Pesonen wrote: Easier fix that sleeping was to add system wide semaphore which puts all concurrent requests to single queue. So the problem is in the way how Fuseki handles situation where (concurrent) requests are coming in faster that it can proce

Re: TransactionManager ERROR There are now active transactions

2018-08-03 Thread Mikael Pesonen
error to client or sleep until there is more space in request queue. Br On 2.8.2018 17:18, Andy Seaborne wrote: On 02/08/18 12:56, Mikael Pesonen wrote: I dont have any configuration, so it's default? Command line: /usr/bin/java -Dlog4j.configuration=file:...log4j.properties -Xmx

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
56, Andy Seaborne wrote: Fuseki configuration? The stacktrace isn't GSP. Im only calling /ds endpoint with php+curl >>> I'm not able to produce a sendable script that >>> would case these errors. It (still) looks like there is an environment factor.     Andy

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
3.7.0. On 2.8.2018 12:40, Andy Seaborne wrote: version? On 02/08/18 10:06, Mikael Pesonen wrote: It does happen in our test environment on high load quite often. More sleep I put in the test script, less frequently error happens. Most of the time transactions are executed after the

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
ore On 2.8.2018 11:03, Andy Seaborne wrote: (subject line changed - this is not the original thread report) On 01/08/18 10:32, Mikael Pesonen wrote: Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could

Re: Fuseki errors with concurrent requests

2018-08-01 Thread Mikael Pesonen
Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could sleep and retry later allowing db to finish the transaction? On 19.6.2018 23:56, Andy Seaborne wrote: On 18/06/18 11:36, Mikael Pesonen wrote

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
t you can do something like: log4.logger.org.apache.jena.sparql=WARN would set all the sparql logs to WARN level. Assuming you are using log4j. On Fri, Jun 29, 2018 at 12:40 PM, Mikael Pesonen wrote: Thanks for the reply. Our log is going to journald so I think it's compressed already. On

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
ePattern='.'-MM-dd-HH log4j.appender.FusekiFileLog.layout=org.apache.log4j.PatternLayout log4j.appender.FusekiFileLog.layout.ConversionPattern=[%d{MMdd-HH:mm:ss}] %-10c{1} %-5p %m%n Mikael Pesonen wrote on 6/28/18 7:37 AM: Hi, we are having trouble with Fuseki log size. Easiest wou

Suppressing SPARQL queries from log

2018-06-28 Thread Mikael Pesonen
Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppi

Re: How ro restore from backup?

2018-06-21 Thread Mikael Pesonen
", so part of what you are seeing may be the absence of mappings that aren't in use. Andy can say more about what might be happening with the indexes themselves or how this does or doesn't apply to TDB2. ajs6f On Jun 14, 2018, at 10:00 AM, Mikael Pesonen wrote: Just managed

Re: Fuseki errors with concurrent requests

2018-06-20 Thread Mikael Pesonen
anslation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki errors with concurrent requests

2018-06-18 Thread Mikael Pesonen
On 18.6.2018 13:30, Andy Seaborne wrote: On 18/06/18 10:55, Mikael Pesonen wrote: Hi Andy, On 18.6.2018 12:05, Andy Seaborne wrote: On 15/06/18 15:36, Mikael Pesonen wrote: Hi, unfortunately I haven't been able to make a standalone package yet. However with jena 3.7.0 thing

Re: Fuseki errors with concurrent requests

2018-06-18 Thread Mikael Pesonen
Hi Andy, On 18.6.2018 12:05, Andy Seaborne wrote: On 15/06/18 15:36, Mikael Pesonen wrote: Hi, unfortunately I haven't been able to make a standalone package yet. However with jena 3.7.0 things are bit better now - errors occur less than before. "The errors" are whi

Re: Fuseki errors with concurrent requests

2018-06-15 Thread Mikael Pesonen
he details that can be run by someone else including how the server is being run, what disk storage you are using, and whether the database starts from fresh or not. Does it happen on earlier versions of Fuseki?     Andy On 30/01/18 09:28, Mikael Pesonen wrote: Hi, My test is dependent

Re: How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
Jun 14, 2018, at 7:55 AM, Mikael Pesonen wrote: Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you -- Lingsoft - 30 years of Leading Language Management

How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you

Re: Querying used disk size

2018-06-05 Thread Mikael Pesonen
would end up over estimating to some extent. Rob On 04/06/2018, 13:18, "Mikael Pesonen" wrote: Hi, what would be best way to estimate how much disk space (bytes) a single graph is using in Fuseki? Only option that came to mind is to get entire db

Querying used disk size

2018-06-04 Thread Mikael Pesonen
estimate. Thank you -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi T

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
14:16:38] Fuseki INFO  [1771] 500 Comparison method violates its general contract! (4.752 s) On 23.5.2018 14:14, Andy Seaborne wrote: The issue is data and query dependent. A shorter query and some data please!     Andy On 23/05/18 12:05, Mikael Pesonen wrote: How do I get it? Th

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
How do I get it? Fuseki is not crashing, just returns then error. Br On 23.5.2018 13:40, Rob Vesse wrote: A stack trace would be helpful... Rob On 23/05/2018, 11:15, "Mikael Pesonen" wrote: Hi, I'm geting this Java error with following query (prefixes omitted)

Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
sd:boolean } ) } } GROUP BY ?p ?label ?range ORDER BY ASC(?label) -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesone

Re: Limit memory usage of Fuseki server?

2018-04-11 Thread Mikael Pesonen
leaving it enabled to protect the wider system. Rob On 10/04/2018, 14:38, "Mikael Pesonen" wrote: More info: latest Fuseki query returned 200 so no error there. Apr 10 15:54:29 -- kernel: curl invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
he dataset configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apache.org/licenses/LICENSE-2.0

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
figuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apache.org/licenses/LICENSE-2.0 ## Fu

Re: Splitting data into graphs vs datasets

2018-03-22 Thread Mikael Pesonen
performance)? (Jena has a permissions framework that can secure information down to the individual triple.) ajs6f On Mar 21, 2018, at 6:35 AM, Mikael Pesonen wrote: Those sure are good reasons for using named graphs. But what about using different datasets too? btw, I couldn't fin

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
an run many datasets by using the --config argument and specifying an appropriate configuration file. This should be used instead of the --loc argument which is a convenience short cut to run a server with a single dataset. http://jena.apache.org/documentation/fuseki2/fuseki-configuration

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
ew version in the same graph. You probably would not want to do this with a large default graph. On Tue, Mar 20, 2018 at 1:16 PM, Mikael Pesonen wrote: Hi, I'm using Fuseki GSP, and so far have put all data into one default dataset and using graphs to split it. If I'm right there wou

Splitting data into graphs vs datasets

2018-03-20 Thread Mikael Pesonen
ons - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki errors with concurrent requests

2018-03-07 Thread Mikael Pesonen
ith a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. What would be preferred way to rebuild data? Data folder: 5226102

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
nment? On 6.3.2018 12:32, Martynas Jusevičius wrote: Maybe you can make a reproducible using JMeter or such. On Tue, Mar 6, 2018 at 11:24 AM, Mikael Pesonen wrote: Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18 15:04, Mikael Pesonen wrote:

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18 15:04, Mikael Pesonen wrote: We are using GSP and our test script is doing ~20 json-ld inserts and sparql updates in a row ASAP, and we are running 10 test scripts concurrently. This test is

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
producible measure. Many sites use Jena in production at all kinds of scales for all kinds of dimensions, including HA setups. If you can explain more about your specific situation, you will get more useful advice. ajs6f On Mar 5, 2018, at 9:45 AM, Mikael Pesonen wrote: To be clear: c

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
would you not start with them? Dumping RDF files on the side is not a bad idea either, but TDB backups (such as are produced by the software itself) should be fine for most disaster-recovery purposes. ajs6f On Mar 5, 2018, at 9:48 AM, Mikael Pesonen wrote: Fortunately this is our develo

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
_any_ database, proper operation includes regular and frequent backups and a plan for rebuilding the store independently of any instance. You _do_ have backups, right? ajs6f On Mar 5, 2018, at 9:43 AM, Mikael Pesonen wrote: Hi, we are using Jena TDP as THE database for document metadata. Data

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
TDB instance from a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. Wha

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
rom a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. What would be pre

List of deployments

2018-03-05 Thread Mikael Pesonen
Is there available any kind of public list of production deployments of Jena databases? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-boo

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
On Jan 24, 2018, at 10:31 AM, Mikael Pesonen wrote: And running the test set with 1 concurrent loop, it was repeated 1 times without errors. So error occurs only with more than one concurrent operations. On 24.1.2018 17:40, ajs6f wrote: Please show your code, including Fuseki

Re: Limit memory usage of Fuseki server?

2018-02-14 Thread Mikael Pesonen
/18 16:11, Laura Morales wrote: You should have another file for the dataset configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # License

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
a:cxtName "arq:queryTimeout" ;  ja:cxtValue "3" ] ;    # Add any custom classes you want to load.    # Must have a "public static void init()" method.    # ja:loadClass "your.code.Class" ;    # End triples.    . On 6.2.2018 16:58, Lorenz Buehmann wrote: I gu

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
Hi, config.ttl is default from package. On 6.2.2018 16:58, Lorenz Buehmann wrote: I guess Andy was hoping to see the Fuseki config file(s) On 06.02.2018 15:56, Mikael Pesonen wrote: Is it this one? File: /lib/systemd/system/apache-jena-fuseki.service: [Unit] Description=Apache Jena Fuseki

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
-fuseki.service On 6.2.2018 16:46, Andy Seaborne wrote: What is the dataset/service setup? On 06/02/18 14:33, Mikael Pesonen wrote: I'm not good with Linux so don't know what setup means. We have Ubuntu 14.04, Jena Fuseki 3.6.0 with default config.ttl and running as a service. Test se

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
ld you provide those please? and a complete minimal example.  The fact you can't create one points towards an environment/config/hardware issue, not a code bug.     Andy On 06/02/18 13:14, Mikael Pesonen wrote: Do you have now enough info for figuring out what's going on? It's a bu

<    1   2   3   4   5   >