i am seeing the same problem as reza - tokenizer.next returns nil. another sample
text = "^德国科隆大学，北京大学，清华大学，同济大学, University of Cologne" returns only: token["university":66:76:1] token["cologne":80:87:2] ruby 1.8.5 (2006-12-25 patchlevel 12) [i686-darwin8.8.2] ferret 0.11.4 kind regards, phillip -- Posted via http://www.ruby-forum.com/. _______________________________________________ Ferret-talk mailing list [email protected] http://rubyforge.org/mailman/listinfo/ferret-talk
