Thanks Paolo! This finally works!! -----Original Message----- From: Paolo Castagna [mailto:[email protected]] Sent: Friday, April 27, 2012 11:06 PM To: [email protected] Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao, could you try this for me: svn co http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/ fuseki cd fuseki edit pom.xml adding LARQ dependency: <dependency> <groupId>org.apache.jena</groupId> <artifactId>jena-larq</artifactId> <version>1.0.0-incubating</version> </dependency> mvn clean package java -jar target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar --config=config.ttl ---- config.ttl ---- @prefix : <#> . @prefix fuseki: <http://jena.apache.org/fuseki#> . @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> . @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> . @prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> . @prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> . [] rdf:type fuseki:Server ; fuseki:services ( <#service1> ) . <#service1> rdf:type fuseki:Service ; fuseki:name "ds" ; fuseki:serviceQuery "sparql" ; fuseki:serviceQuery "query" ; fuseki:serviceUpdate "update" ; fuseki:serviceUpload "upload" ; fuseki:serviceReadWriteGraphStore "data" ; fuseki:serviceReadGraphStore "get" ; fuseki:serviceReadGraphStore "" ; fuseki:dataset <#dataset1> ; . <#dataset1> rdf:type tdb:DatasetTDB ; tdb:location "/tmp/tdb" ; ja:textIndex "/tmp/lucene" . ---- I get results when I query with: s-query --service=http://127.0.0.1:3030/ds/sparql "PREFIX pf: <http://jena.hpl.hp.com/ARQ/property#> SELECT * { ?s pf:textMatch 'word'} LIMIT 10" Now, I have done the exactly the same with: http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki -0.2.1-incubating-RC-1/ and http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki -0.2.1-incubating/ and I experience your problem. (I checked both since I was not 100% which tag corresponds to the actual release, it should be jena-fuseki-0.2.1-incubating, right?) The Lucene index is created correctly and it's there, I can query in using the larq.larq command line: java -cp target/jena-fuseki-0.2.1-incubating-server.jar larq.larq --larq=/tmp/lucene "word" The only hypothesis I have is that somehow something goes wrong with the assembler which initialize LARQ. I am sorry not being able to be more helpful at the moment. The only suggestion I have for you is to try using Fuseki from trunk: http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/ and let me know if you experience problems with that. That works for me. In the meantime, I'll see if I can find what's the cause of this problem. Paolo Tao (陶信东) wrote: > Hi Paolo, > The index files seem ok (see below). It was obviously created by > Fuseki (It didn't exist before I create it). It seems that LARQ is not > called when performing the pf:textMatch search. > > -rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt > -rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx > -rw-r--r-- 1 40 Apr 27 14:32 _2.fnm > -rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq > -rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm > -rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx > -rw-r--r-- 1 40894 Apr 27 14:32 _2.tii > -rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis > -rw-r--r-- 1 253 Apr 27 14:32 segments_1 > -rw-r--r-- 1 20 Apr 27 14:32 segments.gen > -rw-r--r-- 1 0 Apr 27 14:32 write.lock > > -----Original Message----- > From: Paolo Castagna [mailto:[email protected]] > Sent: Friday, April 27, 2012 3:26 PM > To: [email protected] > Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating > > Hi Tao, > can you share the bit of your Fuseki configuration where you point at > the path for your Lucene indexes? > > #dataset> rdf:type tdb:DatasetTDB ; > ... > ja:textIndex "/path/to/lucene/index/" ; > . > > Can you do an ls -la of that directory to see the file sizes? > > Can you try to point to a non existing directory and restart Fuseki? > > If the directory exists an empty index will be created (this is a side > effect of opening a Lucene Directory when your Lucene index does not exist). > If the directory does not exist your dataset will be indexed. > > Let's see if you can sort this out and let me know if you have ideas > on how to improve this. > > Paolo > > Tao (陶信东) wrote: >> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still >> doesn't seem to work. See details below. >> >> select * where {?s rdfs:label ?o} limit 10 >> --------------------------------------------------------------------- >> - >> ------ >> - >> | s | o >> | >> ===================================================================== >> = >> ====== >> = >> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label > Property" >> | >> | <http://xmlns.com/foaf/0.1/Person> | "Person" >> | >> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person" >> | >> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing" >> | >> | <http://xmlns.com/foaf/0.1/Document> | "Document" >> | >> | <http://xmlns.com/foaf/0.1/Organization> | "Organization" >> | >> | <http://xmlns.com/foaf/0.1/Group> | "Group" >> | >> | <http://xmlns.com/foaf/0.1/Agent> | "Agent" >> | >> | <http://xmlns.com/foaf/0.1/Project> | "Project" >> | >> | <http://xmlns.com/foaf/0.1/Image> | "Image" >> | >> --------------------------------------------------------------------- >> - >> ------ >> - >> >> prefix pf: <http://jena.hpl.hp.com/ARQ/property#> >> select * where {?s pf:textMatch "+Label"} limit 10 >> ----- >> | s | >> ===== >> ----- >> >> >> -----Original Message----- >> From: Paolo Castagna [mailto:[email protected]] >> Sent: Thursday, April 26, 2012 10:26 PM >> To: [email protected] >> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating >> >> Tao (陶信东) wrote: >>> Thanks Paolo, I'll try that. >>> >>> Meanwhile, would you please clarify whether Fuseki will build LARQ >>> index automatically, after the patch? >> Yes, if the directory does not exist LARQ will create it and build >> the Lucene index automatically, if a directory exists a Lucene index >> will be opened pointing to that directory (however, if the directory >> exists and it's empty, you'll have an empty Lucene index as result): >> >> if ( indexPath != null ) >> { >> File path = new File(indexPath) ; >> if ( !path.exists() ) >> { >> log.debug("Directory {} does not exist, building >> Lucene >> index...") ; >> path.mkdirs() ; >> build ( dataset, path ) ; >> } >> directory = FSDirectory.open(path); >> } else { >> directory = new RAMDirectory(); >> } >> >> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-l >> a >> rq-1.0 >> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerL >> A >> RQ.jav >> a >> >>> Your reply and Venkat's seemed different regarding this. >> This is because things have been improved since the latest release. >> >> Paolo >> >>> Thanks >>> Tao >>> >>> -----Original Message----- >>> From: Paolo Castagna [mailto:[email protected]] >>> Sent: Wednesday, April 25, 2012 6:51 PM >>> To: [email protected] >>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating >>> >>> Hi Tao >>> >>> Tao(陶信东) wrote: >>>> Hi Paolo, >>>> >>>> This is great! I've been waiting for it since several weeks ago. >>> Good to know. >>> >>>> However, after I configured Fuseki for it by adding LARQ to my >>>> class path and the following lines to the assembly file, >>>> pf:textMatch doesn't work (the usual sparql query works). >>>> >>>> <#dataset> rdf:type tdb:DatasetTDB ; >>>> tdb:location "/path/to/my/tdb/indexes/" ; >>>> ja:textIndex "/path/to/lucene/index/" ; >>>> . >>>> >>>> Is Fuseki supported by this LARQ release? >>> Fuseki does not include LARQ. >>> >>> For more details, please, see also: >>> https://issues.apache.org/jira/browse/JENA-63 >>> https://issues.apache.org/jira/browse/JENA-164 >>> >>> The good news is that it is extremely easy to check out Fuseki >>> sources, patch the pom.xml file and repackage it (i.e. mvn package). See: >>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fu >>> s >>> e >>> ki_r12 >>> 03107.patch >>> (be warned, that patch might not be up-to-date, but you see it's >>> just a new dependency on LARQ). >>> >>>> Or should I build the lucene index >>>> by myself when Fuseki started? >>> No, you do not need that. >>> >>> 1. Checkout Fuseki source code. >>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package >>> >>> Let me know how it goes and if you have problems. >>> >>> Cheers, >>> Paolo >>> >>>> Thanks >>>> Tao >>>> >>>> -----Original Message----- >>>> From: Paolo Castagna [mailto:[email protected]] >>>> Sent: Tuesday, April 24, 2012 5:43 AM >>>> To: [email protected] >>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating >>>> >>>> LARQ 1.0.0-incubating has been released, this is the first release >>>> of LARQ as separate module and under the Apache License. >>>> >>>> LARQ is a combination of ARQ and Lucene aimed at providing >>>> developers with the ability to perform free text searches within >>>> their SPARQL >>> queries. >>>> Documentation for LARQ is available here: >>>> >>>> - http://incubator.apache.org/jena/documentation/larq/ >>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/ >>>> >>>> >>>> == Mailing lists >>>> >>>> The user mailing list for Jena is [email protected] >>>> Send email to [email protected] to subscribe. >>>> >>>> See also: >>>> http://incubator.apache.org/jena/help_and_support/index.html >>>> >>>> >>>> == About This Release >>>> >>>> The main new feature in this release is support for updating the >>>> Lucene index as RDF statements are added/removed to the Jena Model >>>> via the Jena APIs. >>>> Moreover, LARQ now depends on Apache Lucene 3.5.0. >>>> >>>> >>>> == Download >>>> >>>> Maven artifacts are here: >>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incub >>>> a >>>> t >>>> i >>>> ng/ >>>> >>>> Source release is here: >>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0 >>>> - >>>> i >>>> n >>>> cubati >>>> ng >>>> >>>> >>>> == Status >>>> >>>> Apache Jena is an effort undergoing incubation at the Apache >>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC. >>>> >>>> Incubation is required of all newly accepted projects until a >>>> further review indicates that the infrastructure, communications, >>>> and decision making process have stabilized in a manner consistent >>>> with other successful ASF projects. >>>> >>>> While incubation status is not necessarily a reflection of the >>>> completeness or stability of the code, it does indicate that the >>>> project has yet to be fully endorsed by the ASF. >>>> >>>> For more information about the incubation status of the Jena >>>> project you can go to the following page: >>>> http://incubator.apache.org/projects/jena.html >>>> >
