Hi Brad:
We have since (Bobo) added some perf tests which allows you to do some
benchmarking very quickly:
http://code.google.com/p/bobo-browse/wiki/BoboPerformance
Let me know if you need help setting up.
-John
On Mon, Jul 13, 2009 at 10:41 AM, Jason Rutherglen <
jason.rutherg...@gmail.com> wrote:
> SOLR 1.4 has a new feature
> https://issues.apache.org/jira/browse/SOLR-475that speeds up faceting
> on fields with many terms by adding
> an UnInvertedField.
> Bobo uses a custom field cache as well. It may be useful to benchmark the 3
> different approaches (bitsets, SOLR-475, Bobo). This could be a good wiki
> page explaining the differences between them?
>
> On Mon, Jul 13, 2009 at 9:49 AM, Bradford Stephens <
> bradfordsteph...@gmail.com> wrote:
>
> > Thanks for this -- we're also trying out bobo-browse for Lucene, and
> > early results look pretty enticing. They greatly sped up how fast you
> > read in documents from disk, among other things:
> > http://bobo-browse.wiki.sourceforge.net/
> >
> > On Sat, Jul 11, 2009 at 12:10 AM, Shalin Shekhar
> > Mangar<shalinman...@gmail.com> wrote:
> > > On Sat, Jul 11, 2009 at 12:01 AM, Bradford Stephens <
> > > bradfordsteph...@gmail.com> wrote:
> > >
> > >> Does the facet aggregation take place on the Solr search server, or
> > >> the Solr client?
> > >>
> > >> It's pretty slow for me -- on a machine with 8 cores/ 8 GB RAM, 50
> > >> million document index (about 36M unique values in the "author"
> > >> field), a query that returns 131,000 hits takes about 20 seconds to
> > >> calculate the top 50 authors. The query I'm running is this:
> > >>
> > >>
> > >>
> >
> http://dttest10:8983/solr/select/select?q=java&facet=true&facet.field=authorname
> > >> :
> > >>
> > >>
> > > Is the author field tokenized? Is it multi-valued? It is best to have
> > > untokenized fields.
> > >
> > > Solr 1.4 has huge improvements in faceting performance so you can try
> > that
> > > and see if it helps. See Yonik's blog post about this -
> > >
> >
> http://yonik.wordpress.com/2008/11/25/solr-faceted-search-performance-improvements/
> > >
> > > --
> > > Regards,
> > > Shalin Shekhar Mangar.
> > >
> >
> >
> >
> > --
> > http://www.roadtofailure.com -- The Fringes of Scalability, Social
> > Media, and Computer Science
> >
>
