http://lucene.apache.org/java/3_0_2/api/core/org/apache/lucene/analysis/pack age-summary.html
Read the example for "Using the new TokenStream API"! Uwe ----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: [email protected] > -----Original Message----- > From: Karthik K [mailto:[email protected]] > Sent: Sunday, September 12, 2010 7:12 AM > To: [email protected] > Subject: iterate through tokens in standardtokenizer > > Hi, > I am trying to use standardTokenizer in a non-lucene project to generate > tokens. The previous versions i used supported token.next , getToken to iterate > over and retrieve the tokens continuously. 3.0.2 doesnt have that and i cant > figure out how to iterate. Can get number of tokens with increment token, but > cant get the exact terms. Is this the right place to ask? > > Thanks --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
