Hi Brad: We have since (Bobo) added some perf tests which allows you to do some benchmarking very quickly:
http://code.google.com/p/bobo-browse/wiki/BoboPerformance Let me know if you need help setting up. -John On Mon, Jul 13, 2009 at 10:41 AM, Jason Rutherglen < jason.rutherg...@gmail.com> wrote: > SOLR 1.4 has a new feature > https://issues.apache.org/jira/browse/SOLR-475that speeds up faceting > on fields with many terms by adding > an UnInvertedField. > Bobo uses a custom field cache as well. It may be useful to benchmark the 3 > different approaches (bitsets, SOLR-475, Bobo). This could be a good wiki > page explaining the differences between them? > > On Mon, Jul 13, 2009 at 9:49 AM, Bradford Stephens < > bradfordsteph...@gmail.com> wrote: > > > Thanks for this -- we're also trying out bobo-browse for Lucene, and > > early results look pretty enticing. They greatly sped up how fast you > > read in documents from disk, among other things: > > http://bobo-browse.wiki.sourceforge.net/ > > > > On Sat, Jul 11, 2009 at 12:10 AM, Shalin Shekhar > > Mangar<shalinman...@gmail.com> wrote: > > > On Sat, Jul 11, 2009 at 12:01 AM, Bradford Stephens < > > > bradfordsteph...@gmail.com> wrote: > > > > > >> Does the facet aggregation take place on the Solr search server, or > > >> the Solr client? > > >> > > >> It's pretty slow for me -- on a machine with 8 cores/ 8 GB RAM, 50 > > >> million document index (about 36M unique values in the "author" > > >> field), a query that returns 131,000 hits takes about 20 seconds to > > >> calculate the top 50 authors. The query I'm running is this: > > >> > > >> > > >> > > > http://dttest10:8983/solr/select/select?q=java&facet=true&facet.field=authorname > > >> : > > >> > > >> > > > Is the author field tokenized? Is it multi-valued? It is best to have > > > untokenized fields. > > > > > > Solr 1.4 has huge improvements in faceting performance so you can try > > that > > > and see if it helps. See Yonik's blog post about this - > > > > > > http://yonik.wordpress.com/2008/11/25/solr-faceted-search-performance-improvements/ > > > > > > -- > > > Regards, > > > Shalin Shekhar Mangar. > > > > > > > > > > > -- > > http://www.roadtofailure.com -- The Fringes of Scalability, Social > > Media, and Computer Science > > >