Faceting on a high cardinality string field, like url, on a 120 million record index is going to be very memory intensive.
You will very likely need to shard the index to get the performance that you need. In Solr 4.2, you can make the url field a Disk based DocValue and shift the memory from Solr to the file system cache. But to run efficiently this is still going to take a lot of memory in the OS file cache. On Thu, Apr 18, 2013 at 12:00 PM, Mingfeng Yang <mfy...@wisewindow.com>wrote: > 20G is allocated to Solr already. > > Ming > > > On Wed, Apr 17, 2013 at 11:56 PM, Toke Eskildsen <t...@statsbiblioteket.dk > >wrote: > > > On Wed, 2013-04-17 at 20:06 +0200, Mingfeng Yang wrote: > > > I am doing faceting on an index of 120M documents, > > > on the field of url[...] > > > > I would guess that you would need 3-4GB for that. > > How much memory do you allocate to Solr? > > > > - Toke Eskildsen > > > > > -- Joel Bernstein Professional Services LucidWorks
