Re: Writing a TokenConcatenateFilter - junk characters appearing on output.

2011-10-01 Thread Jithin
2011 at 10:57 AM, Jithin [via Lucene] < ml-node+s472066n338441...@n3.nabble.com> wrote: > I meant to say. Now my analser chain looks like this. > > > > > pattern="[-_]" replacement=" " /> > >

Re: Writing a TokenConcatenateFilter - junk characters appearing on output.

2011-09-30 Thread Jithin
I meant to say. Now my analser chain looks like this.

Re: Writing a TokenConcatenateFilter - junk characters appearing on output.

2011-09-30 Thread Jithin
I have added this custom filter at the end of my query. Now only my first document is getting indexed. -- View this message in context: http://lucene.472066.n3.nabble.com/Writing-a-TokenConcatenateFilter-junk-characters-appearing-on-output-tp3383684p3384379.html Sent from the Lucene - Java Users

Re: Writing a TokenConcatenateFilter - junk characters appearing on output.

2011-09-30 Thread Jithin
> http://www.thetaphi.de > eMail: [hidden email]<http://user/SendEmail.jtp?type=node&node=3383905&i=0> > > > -Original Message- > > From: Jithin [mailto:[hidden > > email]<http://user/SendEmail.jtp?type=node&node=3383905&i=1>] > >

Writing a TokenConcatenateFilter - junk characters appearing on output.

2011-09-30 Thread Jithin
Hi, I am trying to write a TokenFilter which just concatenates all the the token in the input TokenStream. Issue I am facing is that my filter is outputting certain junk characters in addition to the concatenated string. I believe this is caused by StringBuilder. This is my incrementToken() functi