Hi,
We have a database that has numeric values for some columns, which
correspond to text values in drop-downs on a website. We need to
index both the numeric and text equivalents into Solr, and can do
that via a lookup on a different table from the one holding the
main data. We are currently doing this via a JOIN on the numeric
field, between the main data table and the lookup table, but this
dramatically slows down indexing.
We could try using the CachedSqlEntity processor, but there are
some issues in doing that, as the data import handler is quite
complicated.
As the lookups need to be done only once, I was planning the
following:
(a) Do the lookups in a custom data source that extends
JDBCDataSource, and store them in arrays.
(b) Implement a custom transformer that uses the array data
to convert numeric values read from the database to text.
Comments on this approach, or suggestions for simpler ones would be
much appreciated.
Regards,
Gora
