DataImportHandler backwards compatibility
Hi, I'm in the process of implementing a DataImportHandler config for Solr 1.3 and I've hit across the Postgresql/JDBC Out Of Memory problem. Whilst the solution is documented on the wiki FAQ page: http://wiki.apache.org/solr/DataImportHandlerFaq it appears that the JDBC driver parameters were implemented in DataImportHandler post the 1.3 release. I was wondering if it would be safe to take a nightly build of just the DataImportHandler contrib and run it against a Solr 1.3 installation? Many thanks, kevin
Re: DataImportHandler backwards compatibility
On Thu, Jun 11, 2009 at 6:42 PM, Kevin Lloyd wrote: > > I'm in the process of implementing a DataImportHandler config for Solr 1.3 > and I've hit across the Postgresql/JDBC Out Of Memory problem. Whilst the > solution is documented on the wiki FAQ page: > > http://wiki.apache.org/solr/DataImportHandlerFaq > > it appears that the JDBC driver parameters were implemented in > DataImportHandler post the 1.3 release. Yes, those parameters are new in 1.4 (we should note that on the wiki). > I was wondering if it would be safe to take a nightly build of just the > DataImportHandler contrib and run it against a Solr 1.3 installation? > Solr 1.4 has a rollback command which 1.3 did not have. So, you'd need to hack the DataImportHandler code to remove references to RollBackCommand. You can use the 1.4 dih jar with 1.3 if you comment out the code in SolrWriter.rollback method, remove the import of RollbackUpdateCommand and recompile. -- Regards, Shalin Shekhar Mangar.
Re: DataImportHandler backwards compatibility
Thanks for the info. Just FYI, I've decided to retrofit the 1.3 DataImportHandler with the JDBC driver params functionality to get us around the OOM error problem with as few changes as possible. kevin On 11 Jun 2009, at 14:42, Shalin Shekhar Mangar wrote: On Thu, Jun 11, 2009 at 6:42 PM, Kevin Lloyd wrote: I'm in the process of implementing a DataImportHandler config for Solr 1.3 and I've hit across the Postgresql/JDBC Out Of Memory problem. Whilst the solution is documented on the wiki FAQ page: http://wiki.apache.org/solr/DataImportHandlerFaq it appears that the JDBC driver parameters were implemented in DataImportHandler post the 1.3 release. Yes, those parameters are new in 1.4 (we should note that on the wiki). I was wondering if it would be safe to take a nightly build of just the DataImportHandler contrib and run it against a Solr 1.3 installation? Solr 1.4 has a rollback command which 1.3 did not have. So, you'd need to hack the DataImportHandler code to remove references to RollBackCommand. You can use the 1.4 dih jar with 1.3 if you comment out the code in SolrWriter.rollback method, remove the import of RollbackUpdateCommand and recompile. -- Regards, Shalin Shekhar Mangar.
Re: DataImportHandler backwards compatibility
you can just drop in the new JdbcDataSource.java into the 1.3 release (and build it) and it should be just fine. On Fri, Jun 12, 2009 at 5:55 PM, Kevin Lloyd wrote: > Thanks for the info. Just FYI, I've decided to retrofit the 1.3 > DataImportHandler with the JDBC driver params functionality to get us around > the OOM error problem with as few changes as possible. > > kevin > > > On 11 Jun 2009, at 14:42, Shalin Shekhar Mangar wrote: > >> On Thu, Jun 11, 2009 at 6:42 PM, Kevin Lloyd wrote: >> >>> >>> I'm in the process of implementing a DataImportHandler config for Solr >>> 1.3 >>> and I've hit across the Postgresql/JDBC Out Of Memory problem. Whilst the >>> solution is documented on the wiki FAQ page: >>> >>> http://wiki.apache.org/solr/DataImportHandlerFaq >>> >>> it appears that the JDBC driver parameters were implemented in >>> DataImportHandler post the 1.3 release. >> >> >> Yes, those parameters are new in 1.4 (we should note that on the wiki). >> >> >>> I was wondering if it would be safe to take a nightly build of just the >>> DataImportHandler contrib and run it against a Solr 1.3 installation? >>> >> >> Solr 1.4 has a rollback command which 1.3 did not have. So, you'd need to >> hack the DataImportHandler code to remove references to RollBackCommand. >> You >> can use the 1.4 dih jar with 1.3 if you comment out the code in >> SolrWriter.rollback method, remove the import of RollbackUpdateCommand and >> recompile. >> >> -- >> Regards, >> Shalin Shekhar Mangar. > > -- - Noble Paul | Principal Engineer| AOL | http://aol.com
