Re: Fuseki - support for custom processors like JOSEKI

2012-05-23 Thread Andy Seaborne

On 23/05/12 08:48, Mario Ds Briggs wrote:

thanks Andy for the elaborate response. Yes i was looking at Fuseki for the
SPARQL Graph Store Protocol support.

I am also aware of ARQ's Query extension points, but we dont implement the
QueryEngineFactory interface and thats why my question.

[4] [1] does have this 'While it is possible to replace the entire process
of query evaluation, this is a substantial endeavour. ', which is assume is
not supported.


If you can return a A QueryExecution via your your own means then that's 
fine.  The QueryEngineFactory route means you can reuse, say CONSTRUCT 
processing yet stil implement a general execution of the graph pattern 
which I guess is what you are doing.



Also is there some docs i can read up on about - 'The graph store protocol
implementation is extensible via implementing
DatasetGraph'


The source code is probably the place to look. SPARQL_REST_R and 
SPARQL_REST_RW (not very large).


The implementation executes and performs various API calls -- everything 
turns into add/remove/find of quads on DatasetGraph in some way even if 
via model operations.


Andy



thanks in advance
Mario






[jira] [Resolved] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

 [ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy Seaborne resolved JENA-248.


Resolution: Fixed

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: ARQ, Fuseki
>Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>Assignee: Andy Seaborne
>  Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Assigned] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

 [ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy Seaborne reassigned JENA-248:
--

Assignee: Andy Seaborne

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: ARQ, Fuseki
>Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>Assignee: Andy Seaborne
>  Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

 [ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy Seaborne updated JENA-248:
---

  Component/s: ARQ
Affects Version/s: ARQ 2.9.0
Fix Version/s: ARQ 2.9.1
   Labels: ARQ Fuseki  (was: Fuseki Multi-Threading)

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: ARQ, Fuseki
>Affects Versions: ARQ 2.9.0, Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>Assignee: Andy Seaborne
>  Labels: ARQ, Fuseki
> Fix For: ARQ 2.9.1
>
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281872#comment-13281872
 ] 

Andy Seaborne commented on JENA-248:


Committed to the codebase (and patch attached for reference).

The development build of Fuseki has the the fix in it (actually, its in ARQ 
which has been rebuilt then Fuseki rebuilt to pick up the fix).

Could you test please because while it works for me in my test case that used 
to fail 50% of the time and now does not, the Windows factor, or just being a 
different system, may be a factor as it is timing dependent.  Thanks.

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281859#comment-13281859
 ] 

Hudson commented on JENA-248:
-

Integrated in Jena_ARQ #610 (See [https://builds.apache.org/job/Jena_ARQ/610/])
JENA-248 Read all bytes after SERVICE request and close the connection. 
(Revision 1342006)

 Result = SUCCESS
andy : 
Files : 
* 
/jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/http/Service.java
* 
/jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/iterator/QueryIter.java
* 
/jena/trunk/jena-arq/src/main/java/com/hp/hpl/jena/sparql/engine/main/iterator/QueryIterService.java


> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

 [ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy Seaborne updated JENA-248:
---

Attachment: JENA-248-materialize-result-bytes.patch

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
> Attachments: JENA-248-materialize-result-bytes.patch
>
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: Mail archives setup - request for volunteer

2012-05-23 Thread Benson Margulies
I'm on it.

On Wed, May 23, 2012 at 5:24 AM, Andy Seaborne  wrote:
> Could somebody please work out how to get users@j.a.o and dev@j.a.o archived
> at markmail and make it so.
>
> I think markmail sees the list as jena-users@incubator still but I ran out
> of time to explore it.
>
> mail-archives.apache.org/mod_mbox/ still has jena-users@i.a.o separate from
> users@j.a.o but I think that a monthly batch job will get run one or around
> the 2nd and join the archives together.
>
> (this may be driven by a DOAP file we have yet to do - don't know)
>
>        Andy
>


[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281594#comment-13281594
 ] 

Andy Seaborne commented on JENA-248:


Thanks - that tells me the changes since 0.2.1 aren't relevant.

I think I know a proper fix to put in which does not cause a lot of extra 
copying to happen.  First experiments suggest it is more reliable with the test 
case in the email.

I'll look at putting it in the codebase and dev build as soon as possible (but 
not the next few hours).

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: Mail archives setup - request for volunteer

2012-05-23 Thread Damian Steer

On 23 May 2012, at 13:24, Andy Seaborne wrote:

> Could somebody please work out how to get users@j.a.o and dev@j.a.o archived 
> at markmail and make it so.
> 
> I think markmail sees the list as jena-users@incubator still but I ran out of 
> time to explore it.
> 
> mail-archives.apache.org/mod_mbox/ still has jena-users@i.a.o separate from 
> users@j.a.o but I think that a monthly batch job will get run one or around 
> the 2nd and join the archives together.
> 
> (this may be driven by a DOAP file we have yet to do - don't know)
> 
>   Andy
> 

I won't be able to look at this until tomorrow, but happy to volunteer.

Will also look at the DOAP file, unless anyone else is?

Damian

[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Rahul Sharma (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281572#comment-13281572
 ] 

Rahul Sharma commented on JENA-248:
---

Tried with Fuseki 0.2.2-SNAPSHOT 20120522-0501 and same results!

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281566#comment-13281566
 ] 

Andy Seaborne commented on JENA-248:


Could you try with the current snapshot development version of Fuseki please?

https://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.2-SNAPSHOT/


> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Mail archives setup - request for volunteer

2012-05-23 Thread Andy Seaborne
Could somebody please work out how to get users@j.a.o and dev@j.a.o 
archived at markmail and make it so.


I think markmail sees the list as jena-users@incubator still but I ran 
out of time to explore it.


mail-archives.apache.org/mod_mbox/ still has jena-users@i.a.o separate 
from users@j.a.o but I think that a monthly batch job will get run one 
or around the 2nd and join the archives together.


(this may be driven by a DOAP file we have yet to do - don't know)

Andy



[jira] [Commented] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Andy Seaborne (JIRA)

[ 
https://issues.apache.org/jira/browse/JENA-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281549#comment-13281549
 ] 

Andy Seaborne commented on JENA-248:


This looks like it's the connection saturation issue.

See the thread:

http://markmail.org/message/woxfb2kkhqddkkck

(it's probably easier to answer questions on the mailing list)

> Fuseki server unresponsive  when running multiple construct queries using 
> multi-threading.
> --
>
> Key: JENA-248
> URL: https://issues.apache.org/jira/browse/JENA-248
> Project: Apache Jena
>  Issue Type: Bug
>  Components: Fuseki
>Affects Versions: Fuseki 0.2.1
> Environment: Windows 7 (x64)
>Reporter: Rahul Sharma
>  Labels: Fuseki, Multi-Threading
>
> Hi Andy,
> We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
> http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
> We're running multiple construct queries (approximately 200 queries) using 
> Task Parallel Library of .Net to talk to Fuseki and get response back. We've 
> first tried through dotNetRdf and when about 25 queries have run, the fuseki 
> server freezes and becomes unresponsive. To make it responsive again, we had 
> to restart the fuseki service.
> Now the construct query is a bit that stands out here because its querying 
> two separate service endpoints. Following is the sample construct query that 
> we're using:
> CONSTRUCT
> { 
>    ?predicate ?object . 
>   ?blankNode ?blankNodePredicate ?blankNodeObject .
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
> }
> WHERE
> {
>   SERVICE 
>   {
>    ?predicate ?object .
>   }
>   SERVICE 
>   {
>   OPTIONAL 
>   {
>    ?pred ?blankNode1 .
>   ?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
>   }
>   }
> }
> Then we ran the queries again to make sure its not because of dotNetRdf - so 
> we've used a simple HttpWebRequest - something like this:
> var request = 
> HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; + 
> GetUtf8(sparql)) as HttpWebRequest;
> request.Method = "GET";
> var response = request.GetResponse();
> Could you please help with this problem of Fuseki server becoming 
> unresponsive in the above mentioned case.
> Thanks,
> Rahul

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (JENA-248) Fuseki server unresponsive when running multiple construct queries using multi-threading.

2012-05-23 Thread Rahul Sharma (JIRA)
Rahul Sharma created JENA-248:
-

 Summary: Fuseki server unresponsive  when running multiple 
construct queries using multi-threading.
 Key: JENA-248
 URL: https://issues.apache.org/jira/browse/JENA-248
 Project: Apache Jena
  Issue Type: Bug
  Components: Fuseki
Affects Versions: Fuseki 0.2.1
 Environment: Windows 7 (x64)
Reporter: Rahul Sharma


Hi Andy,

We are running concurrency tests for Fuseki 0.2.1 (downloaded from 
http://www.apache.org/dist/incubator/jena/jena-fuseki-0.2.1-incubating/).
We're running multiple construct queries (approximately 200 queries) using Task 
Parallel Library of .Net to talk to Fuseki and get response back. We've first 
tried through dotNetRdf and when about 25 queries have run, the fuseki server 
freezes and becomes unresponsive. To make it responsive again, we had to 
restart the fuseki service.
Now the construct query is a bit that stands out here because its querying two 
separate service endpoints. Following is the sample construct query that we're 
using:
CONSTRUCT
{ 
 ?predicate ?object . 
?blankNode ?blankNodePredicate ?blankNodeObject .
 ?pred ?blankNode1 .
?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
}
WHERE
{
SERVICE 
{
 ?predicate ?object .
}
SERVICE 
{
OPTIONAL 
{
 ?pred ?blankNode1 .
?blankNode1 ?blankNodePredicate1 ?blankNodeObject1 .
}
}
}

Then we ran the queries again to make sure its not because of dotNetRdf - so 
we've used a simple HttpWebRequest - something like this:
var request = HttpWebRequest.Create("http://localhost:3030/query/sparql?query="; 
+ GetUtf8(sparql)) as HttpWebRequest;
request.Method = "GET";
var response = request.GetResponse();

Could you please help with this problem of Fuseki server becoming unresponsive 
in the above mentioned case.

Thanks,
Rahul


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: Fuseki - support for custom processors like JOSEKI

2012-05-23 Thread Mario Ds Briggs
thanks Andy for the elaborate response. Yes i was looking at Fuseki for the
SPARQL Graph Store Protocol support.

I am also aware of ARQ's Query extension points, but we dont implement the
QueryEngineFactory interface and thats why my question.

[4] [1] does have this 'While it is possible to replace the entire process
of query evaluation, this is a substantial endeavour. ', which is assume is
not supported.

Also is there some docs i can read up on about - 'The graph store protocol
implementation is extensible via implementing
DatasetGraph'

thanks in advance
Mario