This is difficult to diagnose, but here¹s some questions I would ask myself:
Can you reliably recreate the error? Can you recreate the error faster by writing to all 100 collections at once? Can you recreate the error faster if I have less nodes? Is just one solr node or one solr collection throwing the error? Are all the updates coming from one machine? Is there some other bottleneck in your network (like a load balancer) that is limiting connections? Good luck, Jim Musil On 2/2/15, 5:29 AM, "nkgupta" <nitinkumargu...@gmail.com> wrote: >I have 8 node solr cloud cluster connected with external zookeeper. Each >node >: 30 Gb, 4 core. >I have created around 100 collections, each collection is having approx. >30 >shards. (Why I need it, let be a different story, business isolation, >business requirement could be anything). > >Now, I am ingesting data into cluster on 30 collections simultaneously. I >see that ingestion to few collections is getting failed. In solr logs, I >can >see this "Connection Reset" exception occurring. Overall time for >ingestion >is in the tune of 10 hours. > >Any suggestion? Even if it is due to resource starvation how can I prove >that connection reset is coming because of lack of resources. > >==== Exception ====== >2015-01-30 09:16:14,454 ERROR [updateExecutor-1-thread-8151] ? (:) - error >java.net.SocketException: Connection reset > at java.net.SocketInputStream.read(SocketInputStream.java:196) >~[?:1.7.0_55] > at java.net.SocketInputStream.read(SocketInputStream.java:122) >~[?:1.7.0_55] > at >org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSess >ionInputBuffer.java:160) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.jav >a:84) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessio >nInputBuffer.java:273) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpR >esponseParser.java:140) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpR >esponseParser.java:57) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser. >java:260) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(Ab >stractHttpClientConnection.java:283) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(De >faultClientConnection.java:251) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeade >r(ManagedClientConnectionImpl.java:197) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequest >Executor.java:271) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.j >ava:123) >~[httpcore-4.3.jar:4.3] > at >org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultReque >stDirector.java:682) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestD >irector.java:486) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClien >t.java:863) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClien >t.java:82) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClien >t.java:106) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClien >t.java:57) >~[httpclient-4.3.1.jar:4.3.1] > at >org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner.run(Co >ncurrentUpdateSolrServer.java:233) >[solr-solrj-4.10.0.jar:4.10.0 1620776 - rjernst - 2014-08-26 20:49:51] > at >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: >1145) >[?:1.7.0_55] > at >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java >:615) >[?:1.7.0_55] > at java.lang.Thread.run(Thread.java:745) [?:1.7.0_55] > > > >-- >View this message in context: >http://lucene.472066.n3.nabble.com/Solr-throwing-SocketException-Connectio >n-Reset-tp4183434.html >Sent from the Solr - User mailing list archive at Nabble.com.
