Sub entities can slow down indexing remarkably.What is that
datasource? DB? then try using CachedSqlEntityProcessor
On Tue, Jun 14, 2011 at 8:31 PM, Mark wrote:
> Hello all,
>
> We are using DIH to index our data (~6M documents) and its taking an
> extremely long time (~24 hours). I am trying to
On Tue, Jun 14, 2011 at 8:31 PM, Mark wrote:
> Hello all,
>
> We are using DIH to index our data (~6M documents) and its taking an
> extremely long time (~24 hours). I am trying to find ways that we can speed
> this up. I've been reading through older posts and it's my understanding
> this should
Hello all,
We are using DIH to index our data (~6M documents) and its taking an
extremely long time (~24 hours). I am trying to find ways that we can
speed this up. I've been reading through older posts and it's my
understanding this should not take that long.
One probably bottleneck is that
I am using Solr 3.1 but tried it with 4.0 beta too
Does it depend on the batchSize argument? I also have table relationships,
tried without them same effect
Is there an full featured example of how to use this threads parameter ?
On Tue, May 10, 2011 at 5:58 PM, Jamroz Marcin
wrote:
> Hallo,
>
> I have a problem using threads option in entity in DIH it just does not work,
> it either hangs it self or fails to import anything.
>
> Does this feature even work ?
>
> Without threads the import works fine, just too slow
[...]
Hallo,
I have a problem using threads option in entity in DIH it just does not work,
it either hangs it self or fails to import anything.
Does this feature even work ?
Without threads the import works fine, just too slow
**
Di
