RE: Snappuller taking up CPU on master
rsync has an option to limit the transfer rate. You give a maximum bandwidth for it to use in the transfer. (Please do not post the same thing if you don't get a response.) -Original Message- From: rahul_k123 [mailto:[EMAIL PROTECTED] Sent: Wednesday, September 24, 2008 10:57 AM To: solr-user@lucene.apache.org Subject: Re: Snappuller taking up CPU on master Any Ideas??? rahul_k123 wrote: > > Hi, > > Thanks for the reply. > > I am not using SOLR for indexing and serving search requests, i am > using only the scripts for replication. > > Yes it looks like I/O, but my question is how to handle this problem > and is there any optimal way to achieve this. > > > Thanks. > > > > > Otis Gospodnetic wrote: >> >> Hi, >> >> Can't tell with certainty without looking, but my guess would be slow >> disk, high IO, and a large number of processes waiting for IO (run >> vmstat and look at the "wa" column). >> >> Otis >> -- >> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch >> >> >> >> - Original Message ---- >>> From: rahul_k123 <[EMAIL PROTECTED]> >>> To: solr-user@lucene.apache.org >>> Sent: Tuesday, September 23, 2008 6:56:48 PM >>> Subject: Snappuller taking up CPU on master >>> >>> >>> Hi, >>> >>> I am using snappuller to sync my slave with master, i am not using >>> rsync daemon, i am doing Rsync using remote shell. >>> >>> When i am serving requests from the master when the snappuller is >>> running (after optimization, total index is arnd 4 gb it doing the >>> transfer of whole index), the performance is very bad actually >>> causing timeouts. >>> >>> >>> >>> Any ideas why this happens . >>> >>> >>> Any suggestions will help. >>> >>> >>> Thanks. >>> -- >>> View this message in context: >>> http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p >>> 19638474.html Sent from the Solr - User mailing list archive at >>> Nabble.com. >> >> >> > > -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19654506 .html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Snappuller taking up CPU on master
Any Ideas??? rahul_k123 wrote: > > Hi, > > Thanks for the reply. > > I am not using SOLR for indexing and serving search requests, i am using > only the scripts for replication. > > Yes it looks like I/O, but my question is how to handle this problem and > is there any optimal way to achieve this. > > > Thanks. > > > > > Otis Gospodnetic wrote: >> >> Hi, >> >> Can't tell with certainty without looking, but my guess would be slow >> disk, high IO, and a large number of processes waiting for IO (run vmstat >> and look at the "wa" column). >> >> Otis >> -- >> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch >> >> >> >> - Original Message ---- >>> From: rahul_k123 <[EMAIL PROTECTED]> >>> To: solr-user@lucene.apache.org >>> Sent: Tuesday, September 23, 2008 6:56:48 PM >>> Subject: Snappuller taking up CPU on master >>> >>> >>> Hi, >>> >>> I am using snappuller to sync my slave with master, i am not using rsync >>> daemon, i am doing Rsync using remote shell. >>> >>> When i am serving requests from the master when the snappuller is >>> running >>> (after optimization, total index is arnd 4 gb it doing the transfer of >>> whole >>> index), the performance is very bad actually causing timeouts. >>> >>> >>> >>> Any ideas why this happens . >>> >>> >>> Any suggestions will help. >>> >>> >>> Thanks. >>> -- >>> View this message in context: >>> http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >> >> >> > > -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19654506.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Snappuller taking up CPU on master
Hi, Thanks for the reply. I am not using SOLR for indexing and serving search requests, i am using only the scripts for replication. Yes it looks like I/O, but my question is how to handle this problem and is there any optimal way to achieve this. Thanks. Otis Gospodnetic wrote: > > Hi, > > Can't tell with certainty without looking, but my guess would be slow > disk, high IO, and a large number of processes waiting for IO (run vmstat > and look at the "wa" column). > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > - Original Message >> From: rahul_k123 <[EMAIL PROTECTED]> >> To: solr-user@lucene.apache.org >> Sent: Tuesday, September 23, 2008 6:56:48 PM >> Subject: Snappuller taking up CPU on master >> >> >> Hi, >> >> I am using snappuller to sync my slave with master, i am not using rsync >> daemon, i am doing Rsync using remote shell. >> >> When i am serving requests from the master when the snappuller is running >> (after optimization, total index is arnd 4 gb it doing the transfer of >> whole >> index), the performance is very bad actually causing timeouts. >> >> >> >> Any ideas why this happens . >> >> >> Any suggestions will help. >> >> >> Thanks. >> -- >> View this message in context: >> http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html >> Sent from the Solr - User mailing list archive at Nabble.com. > > > -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19642053.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Snappuller taking up CPU on master
Hi, Can't tell with certainty without looking, but my guess would be slow disk, high IO, and a large number of processes waiting for IO (run vmstat and look at the "wa" column). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: rahul_k123 <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Tuesday, September 23, 2008 6:56:48 PM > Subject: Snappuller taking up CPU on master > > > Hi, > > I am using snappuller to sync my slave with master, i am not using rsync > daemon, i am doing Rsync using remote shell. > > When i am serving requests from the master when the snappuller is running > (after optimization, total index is arnd 4 gb it doing the transfer of whole > index), the performance is very bad actually causing timeouts. > > > > Any ideas why this happens . > > > Any suggestions will help. > > > Thanks. > -- > View this message in context: > http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html > Sent from the Solr - User mailing list archive at Nabble.com.
Snappuller taking up CPU on master
Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests from the master when the snappuller is running (after optimization, total index is arnd 4 gb it doing the transfer of whole index), the performance is very bad actually causing timeouts. Any ideas why this happens . Any suggestions will help. Thanks. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html Sent from the Solr - User mailing list archive at Nabble.com.
