I think your JDBC driver is complaining because it doesn't like what is being set for the "fetch size" on the Statement. "Fetch size" is controlled by the "batchSize" parameter on <dataSource /> .
Using "batchSize=-1", I believe, is a workaround for MySql but I suspect your driver requires it to be >0 (or at least >-1). If you omit "batchSize" entirely, DIH sets it to 500 as a default. Also, setting it to -1 causes DIH to change this to Integer.MIN_VALUE. James Dyer E-Commerce Systems Ingram Content Group (615) 213-4311 -----Original Message----- From: ashimbose [mailto:ashimb...@gmail.com] Sent: Tuesday, January 15, 2013 4:48 AM To: solr-user@lucene.apache.org Subject: DataImportHandlerException: Unable to execute query with OPTIM I have tried to search for my specific problem but have not found solution. I have also read the wiki on the DIH and seem to have everything set up right but my Query still fails. Thank you for your help I am running Solr 3.6.1 with Tomcat 6.0 Windows7 64bit and IBM Optim Archive File I have all jar file sitting in C:\Program Files\Apache Software Foundation\Tomcat 6.0\lib My solrconfig.xml is <requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler"> <lst name="defaults"> <str name="config">db-data-config.xml</str> </lst> </requestHandler> My db-data-config.xml <?xml version="1.0" encoding="utf-8"?> <dataConfig> <dataSource type="JdbcDataSource" name="SAMPLE_OPTIM_DB" driver="com.ibm.optim.connect.jdbc.NvDriver" url="jdbc:attconnect://198.168.2.89:2551/NAVIGATOR;DefTdpName=SAMPLE_OPTIM_DB" batchSize="-1" user="" password="" readOnly="True" /> <document name="headwords"> <entity name="CUSTOMERS" dataSource="SAMPLE_OPTIM_DB" query="SELECT * FROM SAMPLE_OPTIM_DB:CUSTOMERS" transformer="RegexTransformer"> <field column="CUSTNAME" name="CUSTNAME"/> </entity> </document> </dataConfig> I am Having below error WARNING: no uniqueKey specified in schema. Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrCore <init> INFO: [core0] Opening new SolrCore at solr\core0\, dataDir=solr/core0\data\ Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrCore <init> INFO: JMX monitoring not detected for core: core0 Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrCore initListeners INFO: [core0] Added SolrEventListener for newSearcher: org.apache.solr.core. QuerySenderListener{queries=[{q=solr,start=0,rows=10}, {q=rocks,start=0,rows=10} , {q=static newSearcher warming query from solrconfig.xml}]} Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrCore initListeners INFO: [core0] Added SolrEventListener for firstSearcher: org.apache.solr.cor e.QuerySenderListener{queries=[]} Jan 15, 2013 4:05:44 PM org.apache.solr.core.RequestHandlers initHandlersFromCon fig INFO: created standard: solr.StandardRequestHandler Jan 15, 2013 4:05:44 PM org.apache.solr.core.RequestHandlers initHandlersFromCon fig INFO: created /dataimport: org.apache.solr.handler.dataimport.DataImportHandler Jan 15, 2013 4:05:44 PM org.apache.solr.core.RequestHandlers initHandlersFromCon fig INFO: created /search: org.apache.solr.handler.component.SearchHandler Jan 15, 2013 4:05:44 PM org.apache.solr.core.RequestHandlers initHandlersFromCon fig INFO: created /update: solr.XmlUpdateRequestHandler Jan 15, 2013 4:05:44 PM org.apache.solr.search.SolrIndexSearcher <init> INFO: Opening Searcher@53bc93fe main Jan 15, 2013 4:05:44 PM org.apache.solr.update.CommitTracker <init> INFO: commitTracker AutoCommit: disabled Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.QueryComponent@781fb1f b Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.FacetComponent@68de135 9 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@ 4bc86dd8 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@53a 3a6c6 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.StatsComponent@1d1a3c1 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding debug component:org.apache.solr.handler.component.DebugComponent@2 55d4d5d Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting socketTimeout to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting urlScheme to: http:// Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting connTimeout to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maxConnectionsPerHost to: 20 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting corePoolSize to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maximumPoolSize to: 2147483647 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maxThreadIdleTime to: 5 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting sizeOfQueue to: -1 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting fairnessPolicy to: false Jan 15, 2013 4:05:44 PM org.apache.solr.handler.dataimport.DataImportHandler pro cessConfiguration INFO: Processing configuration from solrconfig.xml: {config=tika-data-config.xml } Jan 15, 2013 4:05:44 PM org.apache.solr.handler.dataimport.DataImporter loadData Config INFO: Data Configuration loaded successfully Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.QueryComponent@781fb1f b Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.FacetComponent@68de135 9 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@ 4bc86dd8 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@53a 3a6c6 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.StatsComponent@1d1a3c1 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.SearchHandler inform INFO: Adding debug component:org.apache.solr.handler.component.DebugComponent@2 55d4d5d Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting socketTimeout to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting urlScheme to: http:// Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting connTimeout to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maxConnectionsPerHost to: 20 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting corePoolSize to: 0 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maximumPoolSize to: 2147483647 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting maxThreadIdleTime to: 5 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting sizeOfQueue to: -1 Jan 15, 2013 4:05:44 PM org.apache.solr.handler.component.HttpShardHandlerFactor y getParameter INFO: Setting fairnessPolicy to: false Jan 15, 2013 4:05:44 PM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to Searcher@53bc93fe main Jan 15, 2013 4:05:44 PM org.apache.solr.core.CoreContainer register INFO: registering core: core0 Jan 15, 2013 4:05:44 PM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener done. Jan 15, 2013 4:05:44 PM org.apache.solr.servlet.SolrDispatchFilter init INFO: user.dir=C:\xampp Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrCore registerSearcher INFO: [core0] Registered new searcher Searcher@53bc93fe main Jan 15, 2013 4:05:44 PM org.apache.solr.servlet.SolrDispatchFilter init INFO: SolrDispatchFilter.init() done Jan 15, 2013 4:05:44 PM org.apache.solr.servlet.SolrServlet init INFO: SolrServlet.init() Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: No /solr/home in JNDI Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) Jan 15, 2013 4:05:44 PM org.apache.solr.servlet.SolrServlet init INFO: SolrServlet.init() done Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: No /solr/home in JNDI Jan 15, 2013 4:05:44 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) Jan 15, 2013 4:05:44 PM org.apache.solr.servlet.SolrUpdateServlet init INFO: SolrUpdateServlet.init() done Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory C:\xampp\tomcat\webapps\docs Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory C:\xampp\tomcat\webapps\examples Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory C:\xampp\tomcat\webapps\host-manager Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory C:\xampp\tomcat\webapps\manager Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory C:\xampp\tomcat\webapps\ROOT Jan 15, 2013 4:05:44 PM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["http-bio-8080"] Jan 15, 2013 4:05:44 PM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-8009"] Jan 15, 2013 4:05:44 PM org.apache.catalina.startup.Catalina start INFO: Server startup in 6315 ms Jan 15, 2013 4:05:45 PM org.apache.solr.handler.dataimport.DataImporter doFullIm port INFO: Starting Full Import Jan 15, 2013 4:05:45 PM org.apache.solr.core.SolrCore execute INFO: [core1] webapp=/solr path=/dataimport params={command=full-import} stat us=0 QTime=20 Jan 15, 2013 4:05:45 PM org.apache.solr.handler.dataimport.SimplePropertiesWrite r readIndexerProperties INFO: Read dataimport.properties Jan 15, 2013 4:05:45 PM org.apache.solr.update.DirectUpdateHandler2 deleteAll INFO: [core1] REMOVING ALL DOCUMENTS FROM INDEX Jan 15, 2013 4:05:45 PM org.apache.solr.core.SolrDeletionPolicy onInit INFO: SolrDeletionPolicy.onInit: commits:num=1 commit{dir=C:\xampp\solr\core1\data\index,segFN=segments_10,version=1 354599552617,generation=36,filenames=[segments_10] Jan 15, 2013 4:05:45 PM org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: newest commit = 1354599552617 Jan 15, 2013 4:05:45 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a connection for entity CUSTOMERS with URL: jdbc:attconnect ://ESMART12:2551/NAVIGATOR;DefTdpName=SAMPLE_OPTIM_DB Jan 15, 2013 4:05:45 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken for getConnection(): 666 Jan 15, 2013 4:05:45 PM org.apache.solr.common.SolrException log SEVERE: Exception while processing: CUSTOMERS document : SolrInputDocument [{}]:org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to ex ecute query: select * FROM SAMPLE_OPTIM_DB:CUSTOMERS Processing Document # 1 at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAnd Throw(DataImportHandlerException.java:72) at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.< init>(JdbcDataSource.java:253) at org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSou rce.java:210) at org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSou rce.java:39) at org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEn tityProcessor.java:59) at org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEnti tyProcessor.java:73) at org.apache.solr.handler.dataimport.EntityProcessorWrapper.pullRow(Ent ityProcessorWrapper.java:330) at org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(Ent ityProcessorWrapper.java:296) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilde r.java:683) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilde r.java:619) at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.j ava:327) at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java :225) at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImpo rter.java:375) at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.j ava:445) at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.ja va:426) Caused by: java.sql.SQLException: JBC0062E: Invalid value supplied for argument "fech size" at com.ibm.optim.connect.jdbc.NvSQLWarning.createSQLException(Unknown So urce) at com.ibm.optim.connect.jdbc.NvStatement.setFetchSize(Unknown Source) at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.< init>(JdbcDataSource.java:242) ... 13 more Jan 15, 2013 4:05:45 PM org.apache.solr.update.processor.LogUpdateProcessor fini sh INFO: {deleteByQuery=*:*} 0 20 Jan 15, 2013 4:05:45 PM org.apache.solr.common.SolrException log SEVERE: Full Import failed:java.lang.RuntimeException: java.lang.RuntimeExceptio n: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to exec ute query: select * FROM SAMPLE_OPTIM_DB:CUSTOMERS Processing Document # 1 at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java :264) at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImpo rter.java:375) at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.j ava:445) at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.ja va:426) Caused by: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataIm portHandlerException: Unable to execute query: select * FROM SAMPLE_OPTIM_DB: CUSTOMERS Processing Document # 1 at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilde r.java:621) at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.j ava:327) at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java :225) ... 3 more Caused by: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query: select * FROM SAMPLE_OPTIM_DB:CUSTOMERS Processing Doc ument # 1 at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAnd Throw(DataImportHandlerException.java:72) at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.< init>(JdbcDataSource.java:253) at org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSou rce.java:210) at org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSou rce.java:39) at org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEn tityProcessor.java:59) at org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEnti tyProcessor.java:73) at org.apache.solr.handler.dataimport.EntityProcessorWrapper.pullRow(Ent ityProcessorWrapper.java:330) at org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(Ent ityProcessorWrapper.java:296) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilde r.java:683) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilde r.java:619) ... 5 more Caused by: java.sql.SQLException: JBC0062E: Invalid value supplied for argument "fech size" at com.ibm.optim.connect.jdbc.NvSQLWarning.createSQLException(Unknown So urce) at com.ibm.optim.connect.jdbc.NvStatement.setFetchSize(Unknown Source) at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.< init>(JdbcDataSource.java:242) ... 13 more Jan 15, 2013 4:05:45 PM org.apache.solr.update.DirectUpdateHandler2 rollback INFO: start rollback Jan 15, 2013 4:05:45 PM org.apache.solr.update.DirectUpdateHandler2 rollback INFO: end_rollback Please Please help me to come out from this error. -- View this message in context: http://lucene.472066.n3.nabble.com/DataImportHandlerException-Unable-to-execute-query-with-OPTIM-tp4033436.html Sent from the Solr - User mailing list archive at Nabble.com.
