You could always rsync the index dir and reload (old scripts). But this is still something we should investigate. I had this same issue on high load and never really found a solution. Did you try another Nic card? See if the Nic is configured right? Routing? Speed of transfer?
Bill Bell Sent from mobile On Mar 17, 2011, at 9:11 AM, Vadim Kisselmann <v.kisselm...@googlemail.com> wrote: > On Mar 17, 2011, at 3:19 PM, Shawn Heisey wrote: > > On 3/17/2011 3:43 AM, Vadim Kisselmann wrote: > Unfortunately, this doesn't seem to be the problem. The queries > themselves are running fine. The problem is that the replications is > crawling when there are many queries going on and that the replication > speed stays low even after the load is gone. > > If you run "iostat 5" what are typical values on each iteration for > the various CPU states while you're doing load testing and replication > at the same time? In particular, %iowait is important. > > > > CPU stats from top (iostat doesn't seem to show CPU load correctly): > > 90.1%us, 4.5%sy, 0.0%ni, 5.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st > > Seems like I/O is not the bottleneck here. > > Other interesting thing: When Solr starts its replication under heavy > load, it tries to download the whole index from master. > > From /solr/admin/replication/index.jsp: > > Current Replication Status > > Start Time: Thu Mar 17 15:57:20 CET 2011 > Files Downloaded: 9 / 163 > Downloaded: 83,04 MB / 97,75 GB [0.0%] > Downloading File: _d5x.nrm, Downloaded: 86,82 KB / 86,82 KB [100.0%] > Time Elapsed: 419s, Estimated Time Remaining: 504635s, Speed: 202,94 KB/s
