Re: Snappuller taking up CPU on master
Any Ideas??? rahul_k123 wrote: Hi, Thanks for the reply. I am not using SOLR for indexing and serving search requests, i am using only the scripts for replication. Yes it looks like I/O, but my question is how to handle this problem and is there any optimal way to achieve this. Thanks. Otis Gospodnetic wrote: Hi, Can't tell with certainty without looking, but my guess would be slow disk, high IO, and a large number of processes waiting for IO (run vmstat and look at the wa column). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: rahul_k123 [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Tuesday, September 23, 2008 6:56:48 PM Subject: Snappuller taking up CPU on master Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests from the master when the snappuller is running (after optimization, total index is arnd 4 gb it doing the transfer of whole index), the performance is very bad actually causing timeouts. Any ideas why this happens . Any suggestions will help. Thanks. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19654506.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Snappuller taking up CPU on master
rsync has an option to limit the transfer rate. You give a maximum bandwidth for it to use in the transfer. (Please do not post the same thing if you don't get a response.) -Original Message- From: rahul_k123 [mailto:[EMAIL PROTECTED] Sent: Wednesday, September 24, 2008 10:57 AM To: solr-user@lucene.apache.org Subject: Re: Snappuller taking up CPU on master Any Ideas??? rahul_k123 wrote: Hi, Thanks for the reply. I am not using SOLR for indexing and serving search requests, i am using only the scripts for replication. Yes it looks like I/O, but my question is how to handle this problem and is there any optimal way to achieve this. Thanks. Otis Gospodnetic wrote: Hi, Can't tell with certainty without looking, but my guess would be slow disk, high IO, and a large number of processes waiting for IO (run vmstat and look at the wa column). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: rahul_k123 [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Tuesday, September 23, 2008 6:56:48 PM Subject: Snappuller taking up CPU on master Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests from the master when the snappuller is running (after optimization, total index is arnd 4 gb it doing the transfer of whole index), the performance is very bad actually causing timeouts. Any ideas why this happens . Any suggestions will help. Thanks. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p 19638474.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19654506 .html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Snappuller taking up CPU on master
Hi, Can't tell with certainty without looking, but my guess would be slow disk, high IO, and a large number of processes waiting for IO (run vmstat and look at the wa column). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: rahul_k123 [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Tuesday, September 23, 2008 6:56:48 PM Subject: Snappuller taking up CPU on master Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests from the master when the snappuller is running (after optimization, total index is arnd 4 gb it doing the transfer of whole index), the performance is very bad actually causing timeouts. Any ideas why this happens . Any suggestions will help. Thanks. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Snappuller taking up CPU on master
Hi, Thanks for the reply. I am not using SOLR for indexing and serving search requests, i am using only the scripts for replication. Yes it looks like I/O, but my question is how to handle this problem and is there any optimal way to achieve this. Thanks. Otis Gospodnetic wrote: Hi, Can't tell with certainty without looking, but my guess would be slow disk, high IO, and a large number of processes waiting for IO (run vmstat and look at the wa column). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: rahul_k123 [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Tuesday, September 23, 2008 6:56:48 PM Subject: Snappuller taking up CPU on master Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests from the master when the snappuller is running (after optimization, total index is arnd 4 gb it doing the transfer of whole index), the performance is very bad actually causing timeouts. Any ideas why this happens . Any suggestions will help. Thanks. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19638474.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Snappuller-taking-up-CPU-on-master-tp19638474p19642053.html Sent from the Solr - User mailing list archive at Nabble.com.
