Re: iterate through tokens in standardtokenizer

2010-09-12 Thread Karthik K
Thanks a lot for the help.

RE: iterate through tokens in standardtokenizer

2010-09-12 Thread Uwe Schindler
e- > From: Karthik K [mailto:karthikkato...@gmail.com] > Sent: Sunday, September 12, 2010 7:12 AM > To: java-user@lucene.apache.org > Subject: iterate through tokens in standardtokenizer > > Hi, > I am trying to use standardTokenizer in a non-lucene project to generate >

iterate through tokens in standardtokenizer

2010-09-11 Thread Karthik K
Hi, I am trying to use standardTokenizer in a non-lucene project to generate tokens. The previous versions i used supported token.next , getToken to iterate over and retrieve the tokens continuously. 3.0.2 doesnt have that and i cant figure out how to iterate. Can get number of tokens with incremen