Would it be possible to just run two sepearate deltas, one that updates records
that changed in ds1 and another that updates records that changed in ds2 ? Of
course this would be inefficient if a lot of records typically change in both
places at the same time.
With this approach, you might have to run the deltas using "command=full-import
/ clean=false" as shown here:
http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta
James Dyer
E-Commerce Systems
Ingram Content Group
(615) 213-4311
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: Thursday, July 28, 2011 9:14 AM
To: solr-user@lucene.apache.org
Subject: Re: Solr DataImport with multiple DBs
Often, the easiest solution when DIH gets really complex is to do one of
two things:
1> Use SolrJ instead. You can do complex things more easily much of
the time with DIH.
2> You could consider using a custom Transformer in conjunction with your
primary delta query to access the second table, see:
http://wiki.apache.org/solr/DIHCustomTransformer
Best
Erick
On Tue, Jul 26, 2011 at 7:27 PM, spravin wrote:
> Hi All
>
> I am stuck with an issue with delta-import while configuring solr in an
> environment where multiple databases exist.
>
> My schema looks like this:
>
> names exist in one DB and keywords in a table in the other DB (with id as
> foreign key).
>
> For delta import, I would need to check against the updated column in both
> the tables. But they are in two different databases, so I can't do this in a
> single deltaquery.
> So I'm not able to detect if the field in the second database has changed.
>
> The relevant part of my dataconfig xml looks like this:
>
>
>
>
>
> query="SELECT ID, Name, Updated FROM records"
> deltaImportQuery="SELECT ID, Name, Updated FROM records WHERE ID
> = '${dataimporter.delta.ID <http://dataimporter.delta.id/>}'"
> deltaQuery="SELECT ID FROM records WHERE Updated >
> '${dataimporter.last_index_time}'">
>
> query="SELECT Keyword,Updated AS KeywordUpdated FROM
> keywords WHERE ID = '${name.ID}'">
>
>
>
>
>
>
> I'm hoping someone in this list could point me to a solution: a way to
> specify deltaQuery across multiple databases.
>
> (In the above example, I would like to add "OR ID IN (SELECT ID FROM
> keywords WHERE Updated > '${dataimporter.last_index_time}')" to the
> deltaQuery, but this table can be accessed only from a different dataSource.
>
> Thanks
> - PS
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-DataImport-with-multiple-DBs-tp3201843p3201843.html
> Sent from the Solr - User mailing list archive at Nabble.com.
