David,
I did that and it entered on an infinite loop, see: ?> require 'ferret' => false n\303\264")r = Ferret::Analysis::StandardAnalyzer.new().token_stream(:field, => #<Ferret::Analysis::TokenStream:0x98967d0> >> while token = tokenizer.next >> puts token >> end token["bon":0:3:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] token["":4:4:1] ... ... ... []s -- Posted via http://www.ruby-forum.com/. _______________________________________________ Ferret-talk mailing list [EMAIL PROTECTED] http://rubyforge.org/mailman/listinfo/ferret-talk

