You may want to run your jdbc driver in trace mode just to see if it is picking up these different options. I know from experience that the "selectMethod" parameter can sometimes be important to prevent SQLServer drivers from caching the entire resultset in memory.
But something seems very wrong here and maybe driver tuning is really not what you need. 18 minutes to index 500 documents is extreme. Unless the documents were huge or you were doing very unusual, I'd expect this to happen in seconds (<1 second?). Are you indexing on a Raspberry Pi? Possibly, you have a cartesian join somewhere in your sql, or some other little mistake? If you post your entire data-config.xml possibly someone will see the error. Or, could you be extremely memory constrained because of bad JVM heap choices? Do your logs show you the jvm constantly in GC cycles? Just a little note: batchSize goes on the <dataSource /> tag, not on <document />. I really don't think tweaking batchSize is going to fix this though. James Dyer Ingram Content Group (615) 213-4311 -----Original Message----- From: kobe.free.wo...@gmail.com [mailto:kobe.free.wo...@gmail.com] Sent: Thursday, March 28, 2013 1:43 AM To: solr-user@lucene.apache.org Subject: RE: SOLR - "Unable to execute query" error - DIH Thanks James. We have tried the following options *(individually)* including the one you suggested, 1."selectMethod=cursor" 2. "batchSize=-1" 3."responseBuffering=adaptive" But the indexing process doesn't seem to be improving at all. When we try to index set of 500 rows it works well gets completed in 18 min. For 1000K rows it took 22 hours (long) for indexing. But, when we try to index the complete set of 750K rows it doesn't show any progress and keeps on executing. Currently both the SQL server as well as the SOLR machine is running on 4 GB RAM. With this configuration does the above scenario stands justified? If we think of upgrading the RAM, which machine should that be, the SOLR machine or the SQL Server machine? Are there any other efficient methods to import/ index data from SQL Server to SOLR? Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-Unable-to-execute-query-error-DIH-tp4051028p4051981.html Sent from the Solr - User mailing list archive at Nabble.com.
