Re: ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-17 Thread Prasanth R
Dear All, Thanks for your replies. Conclusion is, we can not store more than 2147483647 records per shard as of now. The only option is we need to increase the shard count. Thanks Prasath Rajan On Tuesday, October 14, 2014 9:34:33 PM UTC+5:30, Jörg Prante wrote: You can not store more than

ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-14 Thread Prasanth R
Getting following exception in one of our ElasticSearch Index, [Failed to start shard, message [IndexShardGatewayRecoveryException[[fw][4] failed recovery]; nested: IllegalArgumentException[Too many documents, composite IndexReaders cannot exceed 2147483647]; ]] Please somebody help. Thanks

Re: ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-14 Thread Prasanth R
There is no upper limit... On Tuesday, October 14, 2014 8:02:03 PM UTC+5:30, Alexandre Rafalovitch wrote: Obvious question: how many documents are you expecting to have in there? Including the nested ones if you are storing them as separate documents. Regards, Alex. Personal:

Re: ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-14 Thread Alexandre Rafalovitch
Obvious question: how many documents are you expecting to have in there? Including the nested ones if you are storing them as separate documents. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr

Re: ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-14 Thread Alexandre Rafalovitch
On 14 October 2014 10:33, Prasanth R prasanth.sunr...@gmail.com wrote: There is no upper limit... Well, then you must have an infinitely scalable architecture and a decision when the content starts getting shared. So, then the question is what is your individual shard allowed to grow to. Which

Re: ElasticSearch- IndexReaders cannot exceed 2147483647

2014-10-14 Thread Prasanth R
Thanks for the reply. My scenario here is, 1) No nested docs. 2) I don't have any limit per shard.. I didn't know about internal limit of ES. On Oct 14, 2014 8:23 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: On 14 October 2014 10:33, Prasanth R prasanth.sunr...@gmail.com wrote: There