Re: Where to get stopword lists?

2003-06-07 Thread prolog_tutor
There are also useful stopword lists at http://www.unine.ch/Info/clef/ best regards René -- +++ GMX - Mail, Messaging & more http://www.gmx.net +++ Bitte lächeln! Fotogalerie online mit GMX ohne eigene Homepage! - To unsubsc

Re: Where to get stopword lists?

2003-06-06 Thread Leo Galambos
Ulrich Mayring wrote: Hello, does anyone know of good stopword lists for use with Lucene? I'm interested in English and German lists. What does mean ``good''? It depends on your corpus IMHO. The best way, how one can get a ``good'' stop-list, is an analysis that's based on idf. Thus, index you

Re: Where to get stopword lists?

2003-06-06 Thread Anthony Eden
There is already an analyzer available in the sandbox. Take a look here: http://jakarta.apache.org/lucene/docs/lucene-sandbox/snowball/ Sincerely, Anthony Eden Ulrich Mayring wrote: Doug Cutting wrote: Snowball stemmers are pre-packaged for use with Lucene at: http://jakarta.apache.org/lucen

Re: Where to get stopword lists?

2003-06-06 Thread Bryan LaPlante
t; <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Friday, June 06, 2003 11:36 AM Subject: Re: Where to get stopword lists? > Doug Cutting wrote: > > > > Snowball stemmers are pre-packaged for use with Lucene at: > > > > http://jakarta.apache.org/lu

Re: Where to get stopword lists?

2003-06-06 Thread Ulrich Mayring
Doug Cutting wrote: Snowball stemmers are pre-packaged for use with Lucene at: http://jakarta.apache.org/lucene/docs/lucene-sandbox/snowball/ These look interesting. Am I right in assuming that in order to use these stemmers, I have to write an Analyzer and in its tokenStream method I return a

Re: Where to get stopword lists?

2003-06-06 Thread Otis Gospodnetic
There is a much more complete list of Englihs stop words included in the Lucene article (the intro one) on Onjava.com. I can't help you with German stop words. Otis --- Ulrich Mayring <[EMAIL PROTECTED]> wrote: > Hello, > > does anyone know of good stopword lists for use with Lucene? I'm > inte

Re: Where to get stopword lists?

2003-06-06 Thread Doug Cutting
Ulrich Mayring wrote: does anyone know of good stopword lists for use with Lucene? I'm interested in English and German lists. The Snowball project has good stop lists. See: http://snowball.tartarus.org/ http://snowball.tartarus.org/english/stop.txt http://snowball.tartarus.org/german/stop

Where to get stopword lists?

2003-06-06 Thread Ulrich Mayring
Hello, does anyone know of good stopword lists for use with Lucene? I'm interested in English and German lists. The default lists aren't very complete, for example the English list doesn't contain words like "every", "because" or "until" and the German list misses "dem" and "des" (definite art