Re: Whether solr can support 2 TB data?

2016-09-24 Thread Toke Eskildsen
Jeffery Yuan wrote: > In our application, every data there is about 800mb raw data, we are going > to store this data for 5 years, then it's about 1 or 2 TB data. > I am wondering whether solr can support this much data? Yes it can. Or rather: You could probably construct a scenario where it

Re: Whether solr can support 2 TB data?

2016-09-23 Thread Joel Bernstein
Some anecdotal information. Alfresco is document management system that uses Solr. We did scale testing with documents meant to simulate typical office documents. We found with larger documents that 50 million documents and 500 GB of index size per shard provided acceptable performance. But you wi

Re: Whether solr can support 2 TB data?

2016-09-23 Thread Shawn Heisey
On 9/23/2016 2:33 PM, Jeffery Yuan wrote: > In our application, every data there is about 800mb raw data, we are > going to store this data for 5 years, then it's about 1 or 2 TB data. As long as the filesystem can do it, Solr can handle that much data. Getting good performance with that much da

Re: Whether solr can support 2 TB data?

2016-09-23 Thread Ray Niu
ontext: http://lucene.472066.n3. > nabble.com/Whether-solr-can-support-2-TB-data-tp4297790.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Whether solr can support 2 TB data?

2016-09-23 Thread Jeffery Yuan
solr cloud, what hardware configuration each node should be? Thanks very much for your help. -- View this message in context: http://lucene.472066.n3.nabble.com/Whether-solr-can-support-2-TB-data-tp4297790.html Sent from the Solr - User mailing list archive at Nabble.com.