RE: indexer threading?

2010-04-27 Thread Wawok, Brian
: Tuesday, April 27, 2010 9:53 AM To: solr-user@lucene.apache.org Subject: Re: indexer threading? Hi Brian, I was testing indexing performance on a high cpu box recently and came to the same issue. I tried different indexing methods ( xml, CSVRequestHandler and Solrj + BinaryRequestWriter with multiple

Re: indexer threading?

2010-04-27 Thread Alexey Serba
Hi Brian, I was testing indexing performance on a high cpu box recently and came to the same issue. I tried different indexing methods ( xml, CSVRequestHandler and Solrj + BinaryRequestWriter with multiple threads ). The last method is the fastest indeed. I believe that multiple threads approach g

indexer threading?

2010-04-26 Thread Wawok, Brian
Hi, I was wondering about how the multi-threading of the indexer works? I am using SolrJ to stream documents to a server. As I add more threads on the client side, I slowly see both speed and CPU usage go up on the indexer side. Once I hit about 4 threads, my indexer is at 100% cpu usage (of 1