Re: Solr http post performance seems slow - help?

2009-09-25 Thread Constantijn Visinescu
This may or may not help but here goes :) When i was running performance tests i look a look at the simple post tool that comes with the solr examples. First i changed my schema.xml to fit my needs and then i deleted the old index so solr created a blank one when i started up. Then i had a had a

Re: Solr http post performance seems slow - help?

2009-09-24 Thread Lance Norskog
In top, press the '1' key. This will give a list of the CPUs and how much load is on each. The display is otherwise a little weird for multi-cpu machines. But don't be surprised when Solr is I/O bound. The biggest fanciest RAID is often a better investment than CPUs. On one project we bought

Re: Solr http post performance seems slow - help?

2009-09-23 Thread Dan A. Dickey
On Friday 11 September 2009 11:06:20 am Dan A. Dickey wrote: ... Our JBoss expert and I will be looking into why this might be occurring. Does anyone know of any JBoss related slowness with Solr? And does anyone have any other sort of suggestions to speed indexing performance? Thanks for

Re: Solr http post performance seems slow - help?

2009-09-11 Thread Dan A. Dickey
On Thursday 10 September 2009 08:13:33 am Dan A. Dickey wrote: I'm posting documents to Solr using http (curl) from C++/C code and am seeing approximately 3.3 - 3.4 documents per second being posted. Is this to be expected? Granted - I understand that this depends somewhat on the machine

Solr http post performance seems slow - help?

2009-09-10 Thread Dan A. Dickey
I'm posting documents to Solr using http (curl) from C++/C code and am seeing approximately 3.3 - 3.4 documents per second being posted. Is this to be expected? Granted - I understand that this depends somewhat on the machine running Solr. By the way - I'm running Solr inside JBoss. I was

Re: Solr http post performance seems slow - help?

2009-09-10 Thread Yonik Seeley
On Thu, Sep 10, 2009 at 9:13 AM, Dan A. Dickey dan.dic...@savvis.net wrote: I'm posting documents to Solr using http (curl) from C++/C code and am seeing approximately 3.3 - 3.4 documents per second being posted.  Is this to be expected? No, that's very slow. Are you using libcurl, or actually

Re: Solr http post performance seems slow - help?

2009-09-10 Thread Walter Underwood
How big are your documents? Is your index on local disk or network- mounted disk? wunder On Sep 10, 2009, at 6:39 AM, Yonik Seeley wrote: On Thu, Sep 10, 2009 at 9:13 AM, Dan A. Dickey dan.dic...@savvis.net wrote: I'm posting documents to Solr using http (curl) from C++/C code and am

Re: Solr http post performance seems slow - help?

2009-09-10 Thread Dan A. Dickey
On Thursday 10 September 2009 08:39:38 am Yonik Seeley wrote: On Thu, Sep 10, 2009 at 9:13 AM, Dan A. Dickey dan.dic...@savvis.net wrote: I'm posting documents to Solr using http (curl) from C++/C code and am seeing approximately 3.3 - 3.4 documents per second being posted. Is this to be

Re: Solr http post performance seems slow - help?

2009-09-10 Thread Dan A. Dickey
On Thursday 10 September 2009 09:10:27 am Walter Underwood wrote: How big are your documents? For the most part, I'm just indexing metadata that has been pulled from the documents. I think I have currently about 40 or so fields that I'm setting. When the document is an actual document - pdf,

RE: Solr http post performance seems slow - help?

2009-09-10 Thread Walter Underwood
Subject: Re: Solr http post performance seems slow - help? On Thursday 10 September 2009 09:10:27 am Walter Underwood wrote: How big are your documents? For the most part, I'm just indexing metadata that has been pulled from the documents. I think I have currently about 40 or so fields that I'm