Re: SolrCloud from "Stopping recovery for" warnings to crash

This night the problem occurred again and I have more data. This time this problem happened only in one solr server and it successfully recovered. solr which had all the leaders: [06:38:58.205 - 06:38:58.222] Stopping recovery for zkNodeName=core_node2core=** *- for all collections* [06:38:5

Re: SolrCloud from "Stopping recovery for" warnings to crash

We tried to set ZK timeout to 1s and did load testing (both indexing and search) and this issue didn't happen. 2014-03-24 17:00 GMT+02:00 Lukas Mikuckis : > Garbage Collectors Summary: > https://apps.sematext.com/spm-reports/s/rgRnwuShgI

Re: SolrCloud from "Stopping recovery for" warnings to crash

Garbage Collectors Summary: https://apps.sematext.com/spm-reports/s/rgRnwuShgI Pool Size: https://apps.sematext.com/spm-reports/s/H16ndqichM First Stopping recovery warning: 4:00, OOM error: 6:30. 2014-03-24 16:35 GMT+02:00 Shalin Shekhar Mangar : > I am guessing that it is all related to memo

Re: SolrCloud from "Stopping recovery for" warnings to crash

I am guessing that it is all related to memory issues. I guess that as the used heap increases, full GC cycles increase causing ZK timeouts which in turn cause more recoveries to be initiated. In the end, everything blows up with the out of memory errors. Do you log GC activity on your servers? I

Re: SolrCloud from "Stopping recovery for" warnings to crash

Yes, we upgraded solr from 4.6.1 to 4.7 3 weeks ago (2 weeks before solr started crashing). When we were upgrading, we just upgraded solr and changed versions in collections configs. When solr crashes we get OOM but only 2h after first Stopping recovery warnings. Maybe you have any ideas when Sto

Re: SolrCloud from "Stopping recovery for" warnings to crash

Did you upgrade recently to Solr 4.7? 4.7 has a bad bug which can cause out of memory issues. Can you check your logs for out of memory errors? On Sun, Mar 23, 2014 at 9:07 PM, Lukas Mikuckis wrote: > Solr version: 4.7 > > Architecture: > 2 solrs (1 shard, leader + replica) > 3 zookeepers > > Ser

Re: SolrCloud from "Stopping recovery for" warnings to crash

Hi Lukas; Did you upgrade your architecture from an old version of Solr to Solr 4.7 or not? Thanks; Furkan KAMACI 23 Mar 2014 17:39 tarihinde "Lukas Mikuckis" yazdı: > Solr version: 4.7 > > Architecture: > 2 solrs (1 shard, leader + replica) > 3 zookeepers > > Servers: > * zookeeper + solr (hea

SolrCloud from "Stopping recovery for" warnings to crash

Solr version: 4.7 Architecture: 2 solrs (1 shard, leader + replica) 3 zookeepers Servers: * zookeeper + solr (heap 4gb) - RAM 8gb, 2 cpu cores * zookeeper + solr (heap 4gb) - RAM 8gb, 2 cpu cores * zookeeper Solr data: * 21 collections * Many fields, small docs, docs count per collection from 1