On Mon, 22 Aug 2005, Martin Rode wrote:

Hi Andi,

the same java code:

StandardTokenizer tst = new StandardTokenizer(new StringReader("henk denk schenk"));
tst.next()

works. Can I do the same in Python? (No IndexReader, just plain Strings) ?


StringTokenizer() wants a Reader, ie a unicode character stream. If there is one in Python use it, otherwise use the one in test/Streams.py.

To fix this bug properly, I should do the wrapping with a Reader automatically when you pass the StringIO stream in.

Andi..
_______________________________________________
pylucene-dev mailing list
[email protected]
http://lists.osafoundation.org/mailman/listinfo/pylucene-dev

Reply via email to