The little self-contained program below runs regex queries for a few
regexps against a few phrases for both the java.util and jakarta
regexp packages.
Output when run with lucene 2.4.1 and jakarta-regexp 1.5 is
Added Knowing yourself
Added Old clinic
Added INSIDE
Added Not INSIDE
Default
regexcapabilities=org.apache.lucene.search.regex.javautilregexcapabilit...@0
org.apache.lucene.search.regex.javautilregexcapabilit...@0
0 hits for text:.in
2 hits for text:.*in
0 hits for text:.IN
2 hits for text:.*IN
org.apache.lucene.search.regex.jakartaregexpcapabilit...@0
2 hits for text:.in
2 hits for text:.*in
1 hits for text:.IN
2 hits for text:.*IN
Hope that helps.
--
Ian.
import org.apache.lucene.index.*;
import org.apache.lucene.store.*;
import org.apache.lucene.document.*;
import org.apache.lucene.analysis.*;
import org.apache.lucene.analysis.standard.*;
import org.apache.lucene.search.*;
import org.apache.lucene.search.regex.*;
public class luctest {
public static void main(String[] _args) throws Exception {
RAMDirectory rdir = new RAMDirectory();
IndexWriter writer = new IndexWriter(rdir, new StandardAnalyzer(),
true);
String[] docterms = { "Knowing yourself",
"Old clinic",
"INSIDE",
"Not INSIDE" };
for (String s : docterms) {
Document d = new Document();
d.add(new Field("text",
s,
Field.Store.YES,
Field.Index.NOT_ANALYZED));
writer.addDocument(d);
System.out.printf("Added %s\n", s);
}
writer.close();
IndexSearcher searcher = new IndexSearcher(rdir);
String[] queries = { ".in", ".*in", ".IN", ".*IN" };
RegexCapabilities[] rcaps = { new JavaUtilRegexCapabilities(),
new JakartaRegexpCapabilities() };
RegexQuery qx = new RegexQuery(new Term("x", "x"));
System.out.printf("\nDefault RegexCapabilities=%s\n\n",
qx.getRegexImplementation());
for (RegexCapabilities rcap : rcaps) {
System.out.println(rcap);
for (String s : queries) {
Term t = new Term("text", s);
RegexQuery q = new RegexQuery(t);
q.setRegexImplementation(rcap);
Hits h = searcher.search(q);
System.out.printf("%s hits for %s\n",
h.length(),
q.toString());
}
}
}
}
On Mon, May 11, 2009 at 1:39 PM, Huntsman84 <tpgarci...@gmail.com> wrote:
The RegexQuery class uses that package, and for that reason the
expression
matches.
If my records contained only one word each, this code would work, but I
need
to apply that regular expression to a phrase...
Ian Lea wrote:
The default regex package is java.util.regex and I can't see anywhere
that you tell it to use the Jakarta regexp package. So I don't think
that ".in" will match. Also, you are storing your contents field as
NOT_ANALYZED so you will need to be wary of case sensitivity. Maybe
this is what you want, but maybe not.
--
Ian.
On Mon, May 11, 2009 at 9:00 AM, Huntsman84 <tpgarci...@gmail.com>
wrote:
This is the code for searching:
String index = "index";
String field = "contents";
IndexReader reader = IndexReader.open(index);
Searcher searcher = new IndexSearcher(reader);
System.out.println("Enter query: ");
String line = ".IN.";//in jakarta regexp this is like * IN *
RegexQuery rxquery = new RegexQuery(new Term(field,line));
Hits hits = searcher.search(rxquery);
if(hits!=null){
for(int k = 0; k<100 && k<hits.length(); k++){
if(hits.doc(k)!=null)
System.out.println(hits.doc(k).getField("contents").stringValue());
}
}
And this is the part of creating the index:
File directory = new File("index");
IndexWriter writer = new IndexWriter(directory, new StandardAnalyzer(),
true,
IndexWriter.MaxFieldLength.LIMITED);
List<String> records = getRecords();//returns a list of record values
from
database, all of them are phrases
Iterator<String> i = records.iterator();
while(i.hasNext()){
Document doc = new Document();
doc.add(new Field(field, i.next(), Field.Store.YES,
Field.Index.NOT_ANALYZED));
writer.addDocument(doc);
}
writer.optimize();
writer.close();
This code works as I want but just matching with the first word of the
phrase. I think the problem is the index building, but I don't know how
to
fix it...
Any ideas?
Thank you so much!!
Steven A Rowe wrote:
On 5/8/2009 at 9:13 AM, Ian Lee wrote:
I'm surprised that it matches either - don't you need ".*in" where .*
means match any character zero or more times? See the javadoc for
java.util.regex.Pattern, or for Jakarta Regexp if you are using that
package.
Unless you're an expert in regexps it is probably worth playing with
them outside your lucene code to start with e.g. with simple
String.matches(regexp) calls. They can take some getting used to.
And try to avoid anything with backslashes if you can!
The java.util.regex.Pattern implementation (the default RegexQuery
implementation) actually uses Matcher.lookingAt(), which is equivalent
to
prepending a "^" anchor to the beginning of the pattern, so if
Huntsman84
is using the default implementation, then I agree with Ian: I'm
surprised
it matches either.
However, the Jakarta Regexp implementation uses RE.match(), which does
*not* require a beginning-of-string match.
Hunstman84, are you using the Jakarta Regexp implementation? If so,
then
like you, I'm surprised it's not matching both :).
It would be useful to see some real code, including how you index your
records.
Steve
On Fri, May 8, 2009 at 1:42 PM, Huntsman84 <tpgarci...@gmail.com>
wrote:
Hi,
I am using RegexQuery for searching in a set of records wich are
phrases of several words each. My aim is to find any phrase that
contains the given group of letters (e.g. "in"). For that case,
I am building the query with the regular expression ".in.", so it
should return all phrases with contain "in", but the search only
matches with the first word of the phrase.
For example, if my records are "Knowing yourself" and "Old
clinic", the correct search would return 2 matches, but it only
matches with "Knowing yourself".
How could I fix this?
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
--
View this message in context:
http://www.nabble.com/RegexQuery-Incomplete-Results-tp23445235p23478720.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
--
View this message in context:
http://www.nabble.com/RegexQuery-Incomplete-Results-tp23445235p23482532.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
