On 8/18/06, Rafe Colburn <[EMAIL PROTECTED]> wrote: > I'm running Ferret 0.9.5 on a MacBook Pro (OS X 10.4.7) under > Locomotive 2.0.7. > > I have a problem where Ferret is hanging when I try to add items to > the index. It doesn't happen with every object that's being indexed, > and I'm not sure what the objects in question have in common (they > are not all instances of the same ActiveRecord object). The process > always locks up on the same line (tokenizers.rb line 49). > > I have other colleagues running the same version of Ferret on the > same platform (Locomotive under OS X) and they're not seeing the same > behavior. Anyone have any ideas? > > I have tried reinstalling Ferret, and both Ferret and Locomotive. > > Here's the difficult to read stack trace: > > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/analysis/ > tokenizers.rb:49:in `next' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/analysis/ > token_filters.rb:21:in `next' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/analysis/ > token_filters.rb:52:in `next' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/ > document_writer.rb:122:in `invert_document' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/ > document_writer.rb:88:in `invert_document' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/ > document_writer.rb:58:in `add_document' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/ > index_writer.rb:158:in `add_document' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/index.rb: > 298:in `<<' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/1.8/monitor.rb:229:in `synchronize' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/ferret-0.9.5/lib/ferret/index/index.rb: > 258:in `<<' > from ./script/../config/../config/../vendor/plugins/ > acts_as_ferret/lib/acts_as_ferret.rb:251:in `rebuild_index' > from ./script/../config/../config/../vendor/plugins/ > acts_as_ferret/lib/acts_as_ferret.rb:250:in `rebuild_index' > from ./script/../config/../config/../vendor/plugins/ > acts_as_ferret/lib/acts_as_ferret.rb:249:in `rebuild_index' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/activerecord-1.14.4/lib/active_record/ > connection_adapters/abstract/database_statements.rb:51:in `transaction' > from /Applications/Locomotive2/Bundles/rails112.locobundle/ > i386/lib/ruby/gems/1.8/gems/activerecord-1.14.4/lib/active_record/ > transactions.rb:91:in `transaction' > from ./script/../config/../config/../vendor/plugins/ > acts_as_ferret/lib/acts_as_ferret.rb:248:in `rebuild_index' > from ./script/../config/../config/../vendor/plugins/ > acts_as_ferret/lib/acts_as_ferret.rb:246:in `rebuild_index'
Hi Rafe, This may be due to a problem with the StandardAnalyzer regular expression. It degrades exponentially on long tokens. If you must use the pure ruby version of Ferret, try using a WhiteSpaceAnalyzer or a LetterAnalyzer. I'd recommend using Ferret with the C extensions whenever possible though. Cheers, Dave _______________________________________________ Ferret-talk mailing list [email protected] http://rubyforge.org/mailman/listinfo/ferret-talk
