Hi

We are using solr 6.2.1 for server and solrj 6.2.0, 
with no explicit commits, and - 

<maxDocs>30000</maxDocs> 
<maxTime>300000</maxTime> 
for autoCommit.

Each request to solr contains 300 small documents with different keys., with
a commitWithin of 300 ms.

We have lots of requests coming in. 

The behavior is as the following: 

Fast - When all threads are using the same key generator, means that solr
gets lots of similar documents in a second we get high throughput, and a
very high cpu. 

Slow - When each thread is using different keys, at each iteration we get
~20 bulks with 300 docs each, means 6000 different keys. The throughput is
terrible.
We don't even see any special cpu or ram usage. 

What is the bottleneck in the slow scenario?
What is the reason for that? Does solr have some kind of cache and when we
send lots of similar keys, It is immediately updating the matching doc with
no further operations?

Why is the fast scenario is so light and fast?

Thanks!









--
View this message in context: 
http://lucene.472066.n3.nabble.com/slow-indexing-when-keys-are-verious-tp4327681.html
Sent from the Solr - User mailing list archive at Nabble.com.

Reply via email to