All,
I have a few questions regarding the data import handler. We have some
pretty gnarly SQL queries to load our indices and our current loader
implementation is extremely fragile. I am looking to migrate over to the
DIH; however, I am looking to use SolrJ + EmbeddedSolr + some custom stuff
to rem
d))
>>> > 3) Support in DIH or Solr to post documents to a remote index (i.e.
>>> create a
>>> > new UpdateHandler instead of DirectUpdateHandler2).
>>> >
>>> > If any of these exist or anyone else is working on this (OR you have
>>> better
>>> > suggestions), please let me know.
>>> >
>>> > Thanks!
>>> > Amit
>>> >
>>>
>>>
>>>
>>> --
>>>
>>> -
>>>
>>
>
>
>
> --
> --Noble Paul
>
>
--
View this message in context:
http://old.nabble.com/DataImportHandler-Questions-Load-data-in-parallel-and-temp-tables-tp23266396p26371403.html
Sent from the Solr - User mailing list archive at Nabble.com.
>>> > SQL though unless it can be generalized to other sources.
>>>> > 2) Parallel support
>>>> > - Including some mechanism to get the number of records (whether it
>>>> be
>>>> > count or the MAX(custom_id)-MIN(custom_id))
>>&g
On Tue, Apr 28, 2009 at 3:43 AM, Amit Nithian wrote:
> All,
> I have a few questions regarding the data import handler. We have some
> pretty gnarly SQL queries to load our indices and our current loader
> implementation is extremely fragile. I am looking to migrate over to the
> DIH; however, I
there is an issue already to write to the index in a separate thread.
https://issues.apache.org/jira/browse/SOLR-1089
On Tue, Apr 28, 2009 at 4:15 AM, Shalin Shekhar Mangar
wrote:
> On Tue, Apr 28, 2009 at 3:43 AM, Amit Nithian wrote:
>
>> All,
>> I have a few questions regarding the data impor
Amit,
You might want to take a look at LuSql[1] and see if it may be
appropriate for the issues you have.
thanks,
Glen
[1]http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql
2009/4/27 Amit Nithian :
> All,
> I have a few questions regarding the data import handler. We have some
I do remember LuSQL and a discussion regarding the performance implications
of using it compared to the DIH. My only reason to stick with DIH is that we
may have other data sources for document loading in the near term that may
make LuSQL too specific for our needs.
Regarding the bug to write to t
writing to a remote Solr through SolrJ is in the cards. I may even
take it up after 1.4 release. For now your best bet is to override the
class SolrWriter and override the corresponding methods for
add/delete.
On Wed, Apr 29, 2009 at 2:06 AM, Amit Nithian wrote:
> I do remember LuSQL and a discus
