You failed to disclose up front that you are using such an old release of Lucene. Lucene is now on 6.0. I'll defer to others if they wish to provide support for such an old release.
-- Jack Krupansky On Mon, Apr 18, 2016 at 8:01 AM, PK C <tech.kumar...@gmail.com> wrote: > Hi, > > Thank you very much for your quick responses. > > Jack Krupansky, > > The main use case is searching in file names. For example, lucene.txt, > lucene_new.txt, lucene_1_new.txt. If I use 'lucene', I need to get all 3 > files. with 'new' I need to get last two files. Please note that Standard > analyzer/tokenizer of lucene 3.6 is not giving us the results with > tokenization of "." and "_". Are you referring to later versions than 3.6 > ? > > Ahmet, > > 1. Not sure if LetterTokenizer helps with the above example of having > numbers and letters in file names. > 2. WordDelimeterFilter does not seem to be lucene 3.6 > 3. MappingCharFilter is what I am already using overriding initReader > method in my CustomAnalyzer (Source copied from StandardAnalyzer (final > class)). Is this a good way to make use of final class StandardAnalyzer > with some custom changes ? Or composition is better ? > > Thank you again, > Best Regards > > On Tue, Apr 12, 2016 at 8:45 PM, Jack Krupansky <jack.krupan...@gmail.com> > wrote: > > > The standard analyzer/tokenizer should do a decent job of splitting on > dot, > > hyphen, and underscore, in addition to whitespace and other punctuation. > > > > Can you post some specific test cases you are concerned with? (You should > > always run some test cases.) > > > > -- Jack Krupansky > > > > On Tue, Apr 12, 2016 at 10:35 AM, Ahmet Arslan <iori...@yahoo.com.invalid > > > > wrote: > > > > > Hi Chamarty, > > > > > > Well, there are a lot of options here. > > > > > > 1) Use LetterTokenizer > > > 2) Use WordDelimeterFilter combined with WhiteSpaceTokenizer > > > 3) Use MappingCharFilter to replace those characters with spaces > > > . > > > . > > > . > > > > > > Ahmet > > > > > > > > > On Tuesday, April 12, 2016 3:58 PM, PrasannaKumar Chamarty < > > > tech.kumar...@gmail.com> wrote: > > > > > > > > > > > > Hi, > > > > > > What is the best way (in terms of maintenance required with new lucene > > > releases) to allow splitting of words on "." and "_" for indexing ? > Thank > > > you. > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > > > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > > > > > > >
