Re: What is the proper use of stop words in Lucene?

2014-04-28 Thread Chris Tomlinson
On Apr 28, 2014, at 3:36 PM, Uwe Schindler wrote: > Hi, > >>> What you intend to do is not a "stopword" use case. You want to "ignore" >> some words - Lucene has no support for this, because in native language >> processing this makes no sense. >> >> Thank you for the information. I was unawar

RE: What is the proper use of stop words in Lucene?

2014-04-28 Thread Uwe Schindler
ler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Uwe Schindler [mailto:u...@thetaphi.de] > Sent: Monday, April 28, 2014 10:36 PM > To: java-user@lucene.apache.org > Cc: 'Chris Tomlinson' > Subje

RE: What is the proper use of stop words in Lucene?

2014-04-28 Thread Uwe Schindler
Hi, > > What you intend to do is not a "stopword" use case. You want to "ignore" > some words - Lucene has no support for this, because in native language > processing this makes no sense. > > Thank you for the information. I was unaware that ignoring some words > "makes no sense". I thought I ga

Re: What is the proper use of stop words in Lucene?

2014-04-28 Thread Chris Tomlinson
Hi, On Apr 28, 2014, at 11:45 AM, Uwe Schindler wrote: >> Hello Uwe, >> >> Thank you for the reply. I see that there is a version check for the use of >> setEnablePositionIncrements(false); and, I think I may be able to use an >> earlier api with the eXist-db embedding of Lucene 4.4 to avoid th

RE: What is the proper use of stop words in Lucene?

2014-04-28 Thread Uwe Schindler
> Hello Uwe, > > Thank you for the reply. I see that there is a version check for the > use of setEnablePositionIncrements(false); and, I think I may be able > to use an earlier api with the eXist-db embedding of Lucene 4.4 to > avoid the version check. Hi, you don't need an older version of

Re: What is the proper use of stop words in Lucene?

2014-04-28 Thread Chris Tomlinson
br...@gmail.com] >> Sent: Thursday, April 24, 2014 12:27 PM >> To: java-user@lucene.apache.org >> Subject: Re: What is the proper use of stop words in Lucene? >> >> Hi there, >> The StopFilterFactory can be used to produce StopFilters with

RE: What is the proper use of stop words in Lucene?

2014-04-24 Thread Uwe Schindler
.de > -Original Message- > From: Tincu Gabriel [mailto:tincu.gabr...@gmail.com] > Sent: Thursday, April 24, 2014 12:27 PM > To: java-user@lucene.apache.org > Subject: Re: What is the proper use of stop words in Lucene? > > Hi there, > The StopFilterFactory can be used to produce S

Re: What is the proper use of stop words in Lucene?

2014-04-24 Thread Tincu Gabriel
Hi there, The StopFilterFactory can be used to produce StopFilters with the desired stop-words inside of it . As a constructor argument it takes a Map and one of the valid keys you can pass inside of that is "enablePositionIncrements" . If you don't pass that in then it defaults to true. Is this wh

Re: What is the proper use of stop words in Lucene?

2014-04-23 Thread Ahmet Arslan
Hi, I think you final goal is not full related to stop word elimination.  I would use synonyms instead of setEnablePositionIncrements. Alternatively, Assuming that you have list of stop words, you may simulate previous behaviorsetEnablePositionIncrements(false) via org.apache.lucene.analysis.Ma

What is the proper use of stop words in Lucene?

2014-04-23 Thread Chris Tomlinson
Hello, I've written several times now on the list with this question / problem and no one has yet replied so I don't know if the question is too wrong-headed or if there is simply no one reading the list that can comment on the question. The question that I'm trying to get answered is what is t