Hey Yago, 12 T is very impressive.
Can you also share some numbers about the shards, replicas, machine count/specs and docs/second for your case? I think you would not be having a single index of 12 TB too. So some details on that would be really helpful too. https://lucidworks.com/blog/2014/06/03/introducing-the-solr-scale-toolkit/ is a good post how LucidWorks achieved 150k docs/second. If you have any such similar blog, that would be quite useful and popular too. --SG On Fri, Sep 23, 2016 at 5:00 PM, Yago Riveiro <yago.rive...@gmail.com> wrote: > In my company we have a SolrCloud cluster with 12T. > > My advices: > > Be nice with CPU you will needed in some point (very important if you have > not control over the kind of queries to the cluster, clients are greedy, > the want all results at the same time) > > SSD and memory (as many as you can afford if you will do facets) > > Full recoveries are a pain, network it's important and should be as fast > as possible, never less than 1Gbit. > > Divide and conquer, but too much can drive you to an expensive overhead, > data travels over the network. Find the sweet point (only testing you use > case you will know) > > -- > > /Yago Riveiro > > On 23 Sep 2016, 23:44 +0100, Pushkar Raste <pushkar.ra...@gmail.com>, > wrote: > > Solr is RAM hungry. Make sure that you have enough RAM to have most if > the > > index of a core in the RAM itself. > > > > You should also consider using really good SSDs. > > > > That would be a good start. Like others said, test and verify your setup. > > > > --Pushkar Raste > > > > On Sep 23, 2016 4:58 PM, "Jeffery Yuan" <yuanyun...@gmail.com> wrote: > > > > Thanks so much for your prompt reply. > > > > We are definitely going to use SolrCloud. > > > > I am just wondering whether SolrCloud can scale even at TB data level and > > what kind of hardware configuration it should be. > > > > Thanks. > > > > > > > > -- > > View this message in context: http://lucene.472066.n3. > > nabble.com/Whether-solr-can-support-2-TB-data-tp4297790p4297800.html > > Sent from the Solr - User mailing list archive at Nabble.com. >
