GitHub user ryandonglin opened a pull request:
https://github.com/apache/lucene-solr/pull/170
ReadTimeOut Exception occurred while building index
Recently changed our cluster structure into one shard, three replicas, and
the application is running on physical machine with 8G Xmx and Xms, the gc
collector is CMS.
While using HttpSolrClient to update our index, large amount of
SocketTimeOut exceptions are occurred, and the replication full recovery
becomes more frequent than ever (about 30 - 40 minutes per time), can any help
can offered?
Here is the exception log in my solr :
```
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:243)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/lucene-solr branch_5x
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/lucene-solr/pull/170.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #170
----
commit 890497b08184688361d0e9c2dd0725d9117dca12
Author: Noble Paul <[email protected]>
Date: 2016-02-09T23:08:41Z
SOLR-6594 Mark old schema APIs as deprecated
commit c3cdb84dc60afb265441ca67714685e6bd16ca22
Author: Mikhail Khludnev <[email protected]>
Date: 2016-02-09T23:36:31Z
SOLR-8466: facet.method=uif for UnInvertedField faceting, like it was with
'fc' earlier.
commit 2b2c516477f25effbd5fab39de4d33e576cb71d1
Author: nknize <[email protected]>
Date: 2016-02-10T03:51:30Z
LUCENE-6997: refactor GeoPointField and query classes from lucene.spatial
to lucene.spatial.geopoint package
commit 24f4025dc13aaaea7e89e349249e8819ba925279
Author: Shai Erera <[email protected]>
Date: 2016-02-10T14:32:27Z
SOLR-8621: fix solrconfig.xml under contrib and example
commit 0417cc41dc381fd036b0b67565fced3400779f62
Author: markrmiller <[email protected]>
Date: 2016-02-10T15:27:43Z
SOLR-7281: Improve 'best effort', we don't want this best effort method to
easily throw exceptions.
commit f72c3e3a8ff4bdfc65764a180227c72c43429856
Author: Mark Robert Miller <[email protected]>
Date: 2016-01-07T19:43:09Z
SOLR-8450: Our HttpClient retry policy is too permissive.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1723616
13f79535-47bb-0310-9956-ffa450edef68
commit 42c17d225e2190893227ac6c710effda000afd98
Author: markrmiller <[email protected]>
Date: 2016-02-10T15:36:43Z
SOLR-8450: Add CHANGES entry.
commit 9da8846535bce8793b28a7d8816e10f3b1c5a912
Author: Mark Robert Miller <[email protected]>
Date: 2016-01-15T13:53:15Z
SOLR-8450: Fix debug logging.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1724807
13f79535-47bb-0310-9956-ffa450edef68
commit df004731dd3f2b1cd54af96f1aa1ead27fcf70b2
Author: Mark Robert Miller <[email protected]>
Date: 2016-01-15T14:13:36Z
SOLR-8450: Do not retry admin requests, they are not idempotent.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1724813
13f79535-47bb-0310-9956-ffa450edef68
commit 5d106503e7d4fbb8ac015c4fc723883f4ab7397e
Author: Christine Poerschke <[email protected]>
Date: 2016-02-09T21:13:46Z
SOLR-8621: add IndexSchema arg to MergePolicyFactory constructor
commit bbbc90f58b2f336c4c51f4844cd0f63121c76ccf
Author: Christine Poerschke <[email protected]>
Date: 2016-02-10T21:22:17Z
SOLR-8621: fix mergePolicyFacory vs. mergePolicyFactory typos in comments
in solr/contrib and solr/example solrconfig.xml files.
commit 8b71a1baf5b9c6d16d24134cebeaf7f22333580d
Author: Mike McCandless <[email protected]>
Date: 2016-02-10T22:55:07Z
LUCENE-6938: switch from svn to git
commit 14bd3c4d3859719f8c0d5d0edebbf17f36531b72
Author: Varun Thacker <[email protected]>
Date: 2016-02-11T00:28:13Z
SOLR-8534: Fix SolrJ APIs to add async support
commit 6301fbb79073dbf06e32fe001d4d7d03e104ca6e
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T08:53:48Z
bump version for 5.5.0 release
commit bdef478737792afb861dc73ca33cb9a1775af4fe
Author: Christine Poerschke <[email protected]>
Date: 2016-02-10T22:19:06Z
SOLR-8621: WrapperMergePolicyFactory logic tweaks
* fix so that getMergePolicy() can now be called more than once
* added WrapperMergePolicyFactoryTest.testUpgradeIndexMergePolicyFactory()
* account for overlap between wrapping and wrapped setters (and disallow
it)
** illustration:
<mergePolicyFactory class="UpgradeMergePolicyFactory">
<int name="noCFSRatio">0.24</int>
<str name="wrapped.prefix">mergePolicy</str>
<str
name="mergePolicy.class">TieredMergePolicyFactory</str>
<int name="mergePolicy.noCFSRatio">0.42</int>
</mergePolicyFactory>
** implementation details: the wrapping MP's setter calls the wrapped MP's
setter and in the current code the wrapping MP's value prevails i.e. the 0.24
value in the illustration since the wrapped MP is constructed before the
wrapping MP. an end-user however might reasonably assume that the wrapped MP's
0.42 value will prevail. at best configuring the same setter twice within the
same overall <mergePolicyFactory> element is ambiguous and so the code now
disallows it.
commit 68ba7a5e5275d4ad10e4e8f70e223f9b61d70b54
Author: markrmiller <[email protected]>
Date: 2016-02-11T13:36:30Z
SOLR-8575: Revert while investigated. (reverted from commit
482b40f841660820f633267a21e6df44aff55346)
commit a900e5fdf49037fc409f032f8cb2c72f11eb41e9
Author: Steve Rowe <[email protected]>
Date: 2016-02-11T14:21:18Z
LUCENE-6997: Maven config: build a spatial module test-jar, and add a test
dependency on it to the sandbox module
commit 144ab5b107aeb7cf79d7e5fd97b8ff5d2ba2ba2f
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T14:52:48Z
LUCENE-6938: switch from svn to git
commit 3989732f70df3981ad0533929f64af3a8d30b92d
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T14:59:13Z
LUCENE-6938: fix buggy detection of dirty git checkout
commit 9fe6a8f20a8e6ff1fded6379a096db2e390c9675
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T15:07:05Z
LUCENE-6938: add TODO that we should also detect unpushed commits
commit af08166b91c901ea30256abe899e1dfcf00c7d75
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T15:08:29Z
fix usage line
commit 383c3ca976a3f216afbfdfbff02619a21dbd2d9c
Author: Mike McCandless <[email protected]>
Date: 2016-02-11T20:19:43Z
LUCENE-6938: fix some places in smoke tester to accept git commit hash
instead of svn revison
commit b2e83b6788b5b3c9ee6cf13be1cddec7f21014f4
Author: Christine Poerschke <[email protected]>
Date: 2016-02-11T17:05:17Z
SOLR-8621: factor out protected abstract
WrapperMergePolicyFactory.getMergePolicyInstance method
Here in SOLR-8621:
* UpgradeIndexMergePolicyFactory extends WrapperMergePolicyFactory
* (WrapperMergePolicyFactoryTest's) DefaultingWrapperMergePolicyFactory
extends WrapperMergePolicyFactory
Elsewhere in SOLR-5730:
* SortingMergePolicyFactory will extend WrapperMergePolicyFactory
commit d76be85a42e58ff906342c1283b3d4608d59df36
Author: Christine Poerschke <[email protected]>
Date: 2016-02-11T17:29:34Z
SOLR-8621: add (test-framework) RandomForceMergePolicyFactory for existing
(test-framework) RandomForceMergePolicy
commit a267fa729bc62267173760ca5a05e912f7089fa9
Author: Christine Poerschke <[email protected]>
Date: 2016-02-11T20:41:35Z
SOLR-8621: solrconfig.xml in solr/server/solr/configsets and
test-files/solr/configsets/bad-mergepolicy now also use <mergePolicyFactory>
instead of <mergePolicy>
commit 8488cc7ba2188a0d8212af3b876090541cc9fb0a
Author: Christine Poerschke <[email protected]>
Date: 2016-02-12T19:04:45Z
SOLR-8621: SolrIndexConfig.toMap() fix to distinguish mergePolicyInfo and
mergePolicyFactoryInfo, associated SolrIndexConfigTest and TestConfig tweaks.
commit 805eeb932a872205cd6b43ab1a158c75ca939ea7
Author: Christine Poerschke <[email protected]>
Date: 2016-02-12T20:16:02Z
SOLR-5730: Make Lucene's SortingMergePolicy and
EarlyTerminatingSortingCollector configurable in Solr.
Cherry-picked commit 6777790 from master and resolved merge conflicts for
solr/core/src/java/org/apache/solr/search/Query(Command|Result).java and
SolrIndexSearcher.java
(the former had previously been factored out from the latter in master but
not branch_5x).
commit a48d85fdc7d62011c2514748b963accc3c102f1c
Author: Christine Poerschke <[email protected]>
Date: 2016-02-12T23:41:30Z
SOLR-5730: rename TestSegmentTerminateEarlyState to
SegmentTerminateEarlyTestState
commit b4811f63bc2f1af174886b379a628391fbcf2012
Author: Uwe Schindler <[email protected]>
Date: 2016-02-13T12:53:17Z
SOLR-5730: Workaround non-working javadocs link (cannot refer to classes
from packages in other modules that already exist in lucene-core.jar)
commit 7abc0c6de6ae51f0b3b805c8d9d83185e78bff69
Author: Uwe Schindler <[email protected]>
Date: 2016-02-13T17:02:57Z
LUCENE-7027: Fixed NumericTermAttribute to not throw
IllegalArgumentException after NumericTokenStream was exhausted
# Conflicts:
# lucene/core/src/java/org/apache/lucene/analysis/NumericTokenStream.java
#
lucene/core/src/test/org/apache/lucene/analysis/TestNumericTokenStream.java
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
