But you can read so often about huge solr clusters and I am wondering how they do this. Because I also read often, that the Index size of one shard should fit into RAM. Or at least the heap size should be as big as the index size. So I see a lots of limitations hardware-wise. Or am I on the totally wrong track?
Daniel On Thu, Jan 19, 2012 at 12:14 AM, Mark Miller <markrmil...@gmail.com> wrote: > You can raise the limit to a point. > > On Jan 18, 2012, at 5:59 PM, Daniel Bruegge wrote: > > > Hi, > > > > I am just wondering how I can 'grow' a distributed Solr setup to an index > > size of a couple of terabytes, when one of the distributed Solr > limitations > > is max. 4000 characters in URI limitation. See: > > > > *The number of shards is limited by number of characters allowed for GET > >> method's URI; most Web servers generally support at least 4000 > characters, > >> but many servers limit URI length to reduce their vulnerability to > Denial > >> of Service (DoS) attacks. > >> * > > > > > > > >> *(via > >> > http://lucidworks.lucidimagination.com/display/solr/Distributed+Search+with+Index+Sharding > >> )* > >> > > > > Is the only way then to make multiple distributed solr clusters and query > > them independently and merge them in application code? > > > > Thanks. Daniel > > - Mark Miller > lucidimagination.com > > > > > > > > > > > >
