Re: How do TeeTokenizer and SinkTokenizer work?

2008-08-26 Thread Grant Ingersoll
On Aug 25, 2008, at 7:29 PM, Teruhiko Kurosaka wrote: Thank you, Grant and (Koji) Sekiguchi-san. but I don't understand how the input from reader1 and reader2 are mixed together. Will sink1 first reaturn the reader1 text, and reader2? It depends on the order the fields are added. If

RE: How do TeeTokenizer and SinkTokenizer work?

2008-08-25 Thread Teruhiko Kurosaka
Thank you, Grant and (Koji) Sekiguchi-san. but I don't understand how the input from reader1 and reader2 are mixed together. Will sink1 first reaturn the reader1 text, and reader2? It depends on the order the fields are added. If source1 is used first, then reader1 will be first.

Re: How do TeeTokenizer and SinkTokenizer work?

2008-08-23 Thread Koji Sekiguchi
Hi Kurosaka-san, I'd written an article on my blog several month ago about SinkTokenizer and TeeTokenFilter. See: http://lucene.jugem.jp/?eid=172 Sorry, but all written in Japanese... Koji Teruhiko Kurosaka wrote: Hello, I'm interested in knowing how these tokenizers work together. The

Re: Re: How do TeeTokenizer and SinkTokenizer work?

2008-08-23 Thread tom
AUTOMATIC REPLY Tom Roberts is out of the office till 2nd September 2008. LUX reopens on 1st September 2008 - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

Re: Re: Re: How do TeeTokenizer and SinkTokenizer work?

2008-08-23 Thread tom
AUTOMATIC REPLY Tom Roberts is out of the office till 2nd September 2008. LUX reopens on 1st September 2008 - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

How do TeeTokenizer and SinkTokenizer work?

2008-08-22 Thread Teruhiko Kurosaka
Hello, I'm interested in knowing how these tokenizers work together. The API doc for TeeTokenizer http://lucene.apache.org/java/2_3_1/api/org/apache/lucene/analysis/TeeTokenFilter.html has this sample code: SinkTokenizer sink1 = new SinkTokenizer(null); SinkTokenizer sink2 = new

Re: How do TeeTokenizer and SinkTokenizer work?

2008-08-22 Thread Grant Ingersoll
On Aug 22, 2008, at 3:47 PM, Teruhiko Kurosaka wrote: Hello, I'm interested in knowing how these tokenizers work together. The API doc for TeeTokenizer http://lucene.apache.org/java/2_3_1/api/org/apache/lucene/analysis/TeeTokenFilter.html has this sample code: SinkTokenizer sink1 = new