I have 8 node solr cloud cluster connected with external zookeeper. Each node
: 30 Gb, 4 core.
I have created around 100 collections, each collection is having approx. 30
shards. (Why I need it, let be a different story, business isolation,
business requirement could be anything).
Now, I am ingesting data into cluster on 30 collections simultaneously. I
see that ingestion to few collections is getting failed. In solr logs, I can
see this "Connection Reset" exception occurring. Overall time for ingestion
is in the tune of 10 hours.
Any suggestion? Even if it is due to resource starvation how can I prove
that connection reset is coming because of lack of resources.
==== Exception ======
2015-01-30 09:16:14,454 ERROR [updateExecutor-1-thread-8151] ? (:) - error
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
~[?:1.7.0_55]
at java.net.SocketInputStream.read(SocketInputStream.java:122)
~[?:1.7.0_55]
at
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
~[httpcore-4.3.jar:4.3]
at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
~[httpclient-4.3.1.jar:4.3.1]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner.run(ConcurrentUpdateSolrServer.java:233)
[solr-solrj-4.10.0.jar:4.10.0 1620776 - rjernst - 2014-08-26 20:49:51]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[?:1.7.0_55]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[?:1.7.0_55]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_55]
--
View this message in context:
http://lucene.472066.n3.nabble.com/Solr-throwing-SocketException-Connection-Reset-tp4183434.html
Sent from the Solr - User mailing list archive at Nabble.com.
