David,

I did that and it entered on an infinite loop, see:

?> require 'ferret'
=> false
n\303\264")r = 
Ferret::Analysis::StandardAnalyzer.new().token_stream(:field,
=> #<Ferret::Analysis::TokenStream:0x98967d0>
>> while token = tokenizer.next
>> puts token
>> end
token["bon":0:3:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
token["":4:4:1]
...
...
...

[]s



-- 
Posted via http://www.ruby-forum.com/.
_______________________________________________
Ferret-talk mailing list
[EMAIL PROTECTED]
http://rubyforge.org/mailman/listinfo/ferret-talk

Reply via email to