solr cloud and DIH, indexation runs only on one shard.

2013-09-03 Thread jerome . dupont
Hello again, I still trying to index a with solr cloud and dih. I can index but it seems that indexation is done on only 1 shard. (my goal was to parallelze that to go fast) This my conf: I have 2 tomcat instances, One with zookeeper embedded in solr 4.4.0 started and 1 shard (port 8080) The

Re: solr cloud and DIH, indexation runs only on one shard.

2013-09-03 Thread Shalin Shekhar Mangar
DataImportHandler does not parallelize indexing at all. It is a single threaded indexer which runs on a single node. However, the documents themselves are routed to the correct shard by SolrCloud. Therefore, what you are observing on your servers is normal. If you want to parallelize indexing

Re: solr cloud and DIH, indexation runs only on one shard.

2013-09-03 Thread YouPeng Yang
Hi jerome.dupont please check what is the updateHandler in your solrconfig.xml updateRequestProcessorChain name=sample processor class=solr.LogUpdateProcessorFactory / processor class=solr.NoOpDistributingUpdateProcessorFactory/ -- by default,it is

Re: solr cloud and DIH, indexation runs only on one shard.

2013-09-03 Thread jerome . dupont
It works I've done what you said: _ In my request to get list of documents, I add a where clause filtering on the select getting the documents to index: where noticebib.numnoticebib LIKE '%${dataimporter.request.suffixeNotice}' _ And I called my dih on each shard with the parameter