As a new user, reading the TokenStream javadoc is a bit intimidating I think.
One thing that might help I think, is adding just a bit of example code to the following section: The workflow of the new TokenStream API is as follows: 1. Instantiation of TokenStream/TokenFilters which add/get attributes to/from the AttributeSource. 2. The consumer calls reset(). 3. the consumer retrieves attributes from the stream and stores local references to all attributes it wants to access 4. The consumer calls incrementToken() until it returns false and consumes the attributes after each call. -- - Mark http://www.lucidimagination.com --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
