Batch replica transfer from master shard solr cloud

[Cp Mishra]

Hi,

 

We were getting pretty low ingest throughput when using replicas. We traced it 
to the following logic in indexing code: 

-          Read SolrInputDocument from stream

-          Index a document

-          Add to ConcurrentUpdateSolrServer instance for sending to replica

 

So, we changed the logic to:

-          Read SolrInputDocument objects from stream in batches of 500.

-          Add  documents to ConcurrentUpdateSolrServer instance

-          Index documents in a loop

 

This has improved indexing speed significantly. 

 

What are the caveats to this approach? 

 

Thanks,

CP