Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2487/
6 tests failed. FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840]:0) FAILED: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch Error Message: org.apache.http.NoHttpResponseException: The target server failed to respond Stack Trace: org.apache.solr.client.solrj.SolrServerException: org.apache.http.NoHttpResponseException: The target server failed to respond at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840:C0DDC2482940687C]:0) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:736) at org.apache.solr.cloud.HttpPartitionTest.sendDoc(HttpPartitionTest.java:480) at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:201) at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:114) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251) at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:464) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:552) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:549) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testDistribSearch Error Message: org.apache.http.NoHttpResponseException: The target server failed to respond Stack Trace: org.apache.solr.client.solrj.SolrServerException: org.apache.http.NoHttpResponseException: The target server failed to respond at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840:C0DDC2482940687C]:0) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:736) at org.apache.solr.cloud.HttpPartitionTest.sendDoc(HttpPartitionTest.java:480) at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:77) at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.doTest(LeaderFailoverAfterPartitionTest.java:50) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251) at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:464) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:552) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:549) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnCommitTest.testDistribSearch Error Message: IOException occured when talking to server at: http://127.0.0.1:60526/qj_/c8n_1x3_commits_shard1_replica1 Stack Trace: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:60526/qj_/c8n_1x3_commits_shard1_replica1 at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840:C0DDC2482940687C]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:572) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:169) at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:147) at org.apache.solr.cloud.LeaderInitiatedRecoveryOnCommitTest.oneShardTest(LeaderInitiatedRecoveryOnCommitTest.java:141) at org.apache.solr.cloud.LeaderInitiatedRecoveryOnCommitTest.doTest(LeaderInitiatedRecoveryOnCommitTest.java:70) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251) at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:464) ... 48 more FAILED: org.apache.solr.cloud.ReplicationFactorTest.testDistribSearch Error Message: org.apache.http.NoHttpResponseException: The target server failed to respond Stack Trace: org.apache.solr.client.solrj.SolrServerException: org.apache.http.NoHttpResponseException: The target server failed to respond at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840:C0DDC2482940687C]:0) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:736) at org.apache.solr.cloud.ReplicationFactorTest.sendDoc(ReplicationFactorTest.java:312) at org.apache.solr.cloud.ReplicationFactorTest.testRf3(ReplicationFactorTest.java:226) at org.apache.solr.cloud.ReplicationFactorTest.doTest(ReplicationFactorTest.java:123) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251) at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:464) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:552) at org.apache.solr.client.solrj.impl.CloudSolrClient$2.call(CloudSolrClient.java:549) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more Build Log: [...truncated 9090 lines...] [junit4] Suite: org.apache.solr.cloud.ReplicationFactorTest [junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/init-core-data-001 [junit4] 2> 213015 T390 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /am_k/ii [junit4] 2> 213025 T390 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 213028 T390 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 213030 T391 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 213129 T390 oasc.ZkTestServer.run start zk server on port:49728 [junit4] 2> 213130 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 213132 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 213141 T398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2da0474e name:ZooKeeperConnection Watcher:127.0.0.1:49728 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 213141 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 213142 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 213143 T390 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 213159 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 213162 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 213166 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69c806c name:ZooKeeperConnection Watcher:127.0.0.1:49728/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 213167 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 213169 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 213169 T390 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 213176 T390 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 213180 T390 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 213183 T390 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 213187 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 213187 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 213192 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 213193 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 213297 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 213298 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 213303 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 213305 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 213310 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 213311 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 213317 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 213318 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 213323 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 213324 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 213330 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 213331 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 213337 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 213338 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 213345 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 213346 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 213351 T390 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 213353 T390 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 216909 T390 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 216917 T390 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49756 [junit4] 2> 216919 T390 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf [junit4] 2> 216919 T390 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 216920 T390 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002 [junit4] 2> 216921 T390 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002/' [junit4] 2> 217074 T390 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002/solr.xml [junit4] 2> 217337 T390 oasc.CoreContainer.<init> New CoreContainer 1676756704 [junit4] 2> 217337 T390 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002/] [junit4] 2> 217340 T390 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 217341 T390 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 217341 T390 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 217342 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 217343 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 217343 T390 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 217344 T390 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 217344 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 217345 T390 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 217345 T390 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 217346 T390 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false [junit4] 2> 217347 T390 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 217348 T390 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 217349 T390 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 217349 T390 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 217350 T390 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49728/solr [junit4] 2> 217350 T390 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 217351 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 217352 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 217356 T413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36eb16bf name:ZooKeeperConnection Watcher:127.0.0.1:49728 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 217357 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 217358 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 217363 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 217366 T416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55f23d9a name:ZooKeeperConnection Watcher:127.0.0.1:49728/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 217366 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 217370 T390 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 217375 T390 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 217379 T390 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 217384 T390 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 217388 T390 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 217393 T390 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 217396 T390 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49755_am_k%2Fii [junit4] 2> 217398 T390 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49755_am_k%2Fii [junit4] 2> 217401 T390 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 217404 T390 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 217407 T390 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 217411 T390 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49755_am_k%2Fii [junit4] 2> 217411 T390 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 217414 T390 oasc.Overseer.start Overseer (id=93149480651063299-127.0.0.1:49755_am_k%2Fii-n_0000000000) starting [junit4] 2> 217419 T390 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 217432 T390 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 217433 T418 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 217434 T390 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 217439 T390 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 217442 T390 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 217448 T417 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 217457 T420 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection [junit4] 2> 217458 T420 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 217460 T416 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 217460 T420 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 217466 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = { [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:49755_am_k%2Fii", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49755/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"1"} current state version: 0 [junit4] 2> 217468 T417 oasco.ReplicaMutator.updateState Update state numShards=1 message={ [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:49755_am_k%2Fii", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49755/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"1"} [junit4] 2> 217468 T417 oasco.ClusterStateMutator.createCollection building a new cName: control_collection [junit4] 2> 217468 T417 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1 [junit4] 2> 217471 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 218461 T420 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 218462 T420 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection [junit4] 2> 218463 T420 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 218463 T420 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 218464 T420 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 218465 T420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002/collection1/' [junit4] 2> 218469 T420 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-002/collection1/lib/.svn/' to classloader [junit4] 2> 218472 T420 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-002/collection1/lib/README' to classloader [junit4] 2> 218473 T420 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-002/collection1/lib/classes/' to classloader [junit4] 2> 218578 T420 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1 [junit4] 2> 218583 T420 oasc.Config.<init> loaded config solrconfig.xml with version 0 [junit4] 2> 218614 T420 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1 [junit4] 2> 218689 T420 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.1.0 [junit4] 2> 218772 T420 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 218874 T420 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 218900 T420 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 219590 T420 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 219638 T420 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 219643 T420 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 219676 T420 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 219687 T420 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 219696 T420 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 219697 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 219698 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 219699 T420 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 219700 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 219701 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 219701 T420 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 219701 T420 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 219702 T420 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-002/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/control/data/ [junit4] 2> 219702 T420 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27d07bf1 [junit4] 2> 219704 T420 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/control/data [junit4] 2> 219705 T420 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/control/data/index/ [junit4] 2> 219705 T420 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/control/data/index' doesn't exist. Creating new index... [junit4] 2> 219706 T420 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/control/data/index [junit4] 2> 219707 T420 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] [junit4] 2> 219709 T420 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7761c4f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33c8e772),segFN=segments_1,generation=1} [junit4] 2> 219710 T420 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 219719 T420 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 220202 T420 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 220203 T420 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 220204 T420 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 220204 T420 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 220204 T420 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 220205 T420 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 220206 T420 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 220206 T420 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 220208 T420 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 220208 T420 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 220209 T420 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 220209 T420 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 220210 T420 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 220211 T420 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler [junit4] 2> 220211 T420 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler [junit4] 2> 220212 T420 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler [junit4] 2> 220213 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler [junit4] 2> 220214 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler [junit4] 2> 220215 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler [junit4] 2> 220216 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler [junit4] 2> 220217 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler [junit4] 2> 220218 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler [junit4] 2> 220219 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler [junit4] 2> 220219 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler [junit4] 2> 220220 T420 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 220221 T420 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 220288 T420 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 220292 T420 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 220296 T420 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 220299 T420 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 220317 T420 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 220327 T420 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 220327 T420 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 220329 T420 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20538156641112026] [junit4] 2> 220330 T420 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7761c4f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33c8e772),segFN=segments_1,generation=1} [junit4] 2> 220332 T420 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 220332 T420 oass.SolrIndexSearcher.<init> Opening Searcher@179de168[collection1] main [junit4] 2> 220333 T420 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 220334 T420 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 220334 T420 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 220335 T420 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 220336 T420 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 220336 T420 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 220337 T420 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 220338 T420 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 220338 T420 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 220339 T420 oash.ReplicationHandler.inform Commits will be reserved for 10000 [junit4] 2> 220340 T421 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@179de168[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 220341 T420 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 220343 T424 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49755/am_k/ii collection:control_collection shard:shard1 [junit4] 2> 220344 T390 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1 [junit4] 2> 220345 T390 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 220345 T424 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 220351 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 220353 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 220357 T428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a122c57 name:ZooKeeperConnection Watcher:127.0.0.1:49728/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 220357 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 220357 T424 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 [junit4] 2> 220359 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 220362 T390 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 220364 T424 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 220365 T416 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 220365 T424 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C1584 name=collection1 org.apache.solr.core.SolrCore@73a71932 url=http://127.0.0.1:49755/am_k/ii/collection1 node=127.0.0.1:49755_am_k%2Fii C1584_STATE=coll:control_collection core:collection1 props:{state=down, node_name=127.0.0.1:49755_am_k%2Fii, base_url=http://127.0.0.1:49755/am_k/ii, core=collection1} [junit4] 2> 220366 T424 C1584 P49755 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49755/am_k/ii/collection1/ [junit4] 2> 220366 T424 C1584 P49755 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 220367 T424 C1584 P49755 oasc.SyncStrategy.syncToMe http://127.0.0.1:49755/am_k/ii/collection1/ has no replicas [junit4] 2> 220367 T424 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49755/am_k/ii/collection1/ shard1 [junit4] 2> 220367 T424 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 220370 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 220371 T390 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 220372 T390 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2 [junit4] 2> 220372 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 220373 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 220374 T428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 220374 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 220377 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@551fb6d8 name:ZooKeeperConnection Watcher:127.0.0.1:49728/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 220378 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 220380 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 220388 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:49755/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 2 [junit4] 2> 220394 T432 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 220395 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = { [junit4] 2> "operation":"create", [junit4] 2> "name":"collection1", [junit4] 2> "numShards":"3", [junit4] 2> "stateFormat":2} current state version: 2 [junit4] 2> 220396 T417 oasco.ClusterStateMutator.createCollection building a new cName: collection1 [junit4] 2> 220398 T428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 220507 T417 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json [junit4] 2> 220510 T428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 220542 T424 oasc.ZkController.register We are http://127.0.0.1:49755/am_k/ii/collection1/ and leader is http://127.0.0.1:49755/am_k/ii/collection1/ [junit4] 2> 220542 T424 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49755/am_k/ii [junit4] 2> 220543 T424 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 220543 T424 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection [junit4] 2> 220543 T424 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 220548 T416 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 220553 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = { [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "node_name":"127.0.0.1:49755_am_k%2Fii", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "base_url":"http://127.0.0.1:49755/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"3"} current state version: 4 [junit4] 2> 220555 T417 oasco.ReplicaMutator.updateState Update state numShards=3 message={ [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "node_name":"127.0.0.1:49755_am_k%2Fii", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "base_url":"http://127.0.0.1:49755/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"3"} [junit4] 2> 220668 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 220668 T428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 224581 T390 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 224583 T390 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 224588 T390 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49806 [junit4] 2> 224589 T390 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf [junit4] 2> 224590 T390 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 224590 T390 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003 [junit4] 2> 224591 T390 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003/' [junit4] 2> 224729 T390 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003/solr.xml [junit4] 2> 224887 T390 oasc.CoreContainer.<init> New CoreContainer 1515305589 [junit4] 2> 224887 T390 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003/] [junit4] 2> 224889 T390 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 224889 T390 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 224889 T390 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 224890 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 224890 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 224890 T390 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 224891 T390 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 224891 T390 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 224892 T390 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 224892 T390 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 224892 T390 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false [junit4] 2> 224893 T390 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 224894 T390 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 224894 T390 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 224894 T390 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 224895 T390 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49728/solr [junit4] 2> 224895 T390 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 224895 T390 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 224896 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 224899 T444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34ed6891 name:ZooKeeperConnection Watcher:127.0.0.1:49728 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 224899 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 224900 T390 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 224903 T390 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 224905 T447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1315a9d0 name:ZooKeeperConnection Watcher:127.0.0.1:49728/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 224905 T390 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 224913 T390 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 225920 T390 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49805_am_k%2Fii [junit4] 2> 225921 T390 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49805_am_k%2Fii [junit4] 2> 225927 T390 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 225946 T448 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 225947 T448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 225950 T416 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 225951 T448 oasc.ZkController.preRegister Registering watch for external collection collection1 [junit4] 2> 225952 T448 oascc.ZkStateReader.addZkWatch addZkWatch collection1 [junit4] 2> 225952 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = { [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:49805_am_k%2Fii", [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49805/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"3"} current state version: 5 [junit4] 2> 225953 T448 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... [junit4] 2> 225953 T417 oasco.ReplicaMutator.updateState Update state numShards=3 message={ [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:49805_am_k%2Fii", [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49805/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "numShards":"3"} [junit4] 2> 225953 T417 oasco.ReplicaMutator.updateState Collection already exists with numShards=3 [junit4] 2> 225954 T417 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard3 [junit4] 2> 225955 T448 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 [junit4] 2> 225955 T448 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 225957 T417 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0 [junit4] 2> 225958 T447 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 225959 T447 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 [junit4] 2> 226955 T448 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 226956 T448 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 226957 T448 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 226958 T448 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 226959 T448 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 226960 T448 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003/collection1/' [junit4] 2> 226963 T448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-003/collection1/lib/.svn/' to classloader [junit4] 2> 226965 T448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-003/collection1/lib/README' to classloader [junit4] 2> 226966 T448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest%20413B4C505E1F0840-001/tempDir-003/collection1/lib/classes/' to classloader [junit4] 2> 227026 T448 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1 [junit4] 2> 227033 T448 oasc.Config.<init> loaded config solrconfig.xml with version 0 [junit4] 2> 227054 T448 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1 [junit4] 2> 227087 T448 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.1.0 [junit4] 2> 227138 T448 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 227239 T448 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 227251 T448 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 227983 T448 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 228027 T448 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 228033 T448 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 228066 T448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 228076 T448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 228085 T448 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 228087 T448 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 228088 T448 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 228089 T448 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 228091 T448 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 228091 T448 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 228092 T448 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 228092 T448 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 228093 T448 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-003/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/jetty1/ [junit4] 2> 228093 T448 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27d07bf1 [junit4] 2> 228095 T448 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/jetty1 [junit4] 2> 228095 T448 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/jetty1/index/ [junit4] 2> 228095 T448 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/jetty1/index' doesn't exist. Creating new index... [junit4] 2> 228096 T448 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ReplicationFactorTest 413B4C505E1F0840-001/tempDir-001/jetty1/index [junit4] 2> 228097 T448 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] [junit4] 2> 228098 T448 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@70510342 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56ad1ba9),segFN=segments_1,generation=1} [junit4] 2> 228099 T448 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 228112 T448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 228112 T448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 228113 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 228113 T448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 228114 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 228114 T448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 228115 T448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 228116 T448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 228116 T448 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 228118 T448 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 228119 T448 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 228120 T448 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 228121 T448 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 228122 T448 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 228123 T448 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler [junit4] 2> 228147 T448 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler [junit4] 2> 228148 T448 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler [junit4] 2> 228150 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler [junit4] 2> 228151 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler [junit4] 2> 228152 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler [junit4] 2> 228153 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler [junit4] 2> 228154 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler [junit4] 2> 228155 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler [junit4] 2> 228156 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler [junit4] 2> 228157 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler [junit4] 2> 228158 T448 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 228160 T448 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 228227 T448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 228245 T448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 228249 T448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 228253 T448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 228256 T448 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 228261 T448 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 228261 T448 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 228263 T448 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20538156641112026] [junit4] 2> 228264 T448 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@70510342 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56ad1ba9),segFN=segments_1,generation=1} [junit4] 2> 228265 T448 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 228265 T448 oass.SolrIndexSearcher.<init> Opening Searcher@33ef3e7d[collection1] main [junit4] 2> 228266 T448 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 228268 T448 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 228268 T448 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 228269 T448 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 228269 T448 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 228270 T448 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 228271 T448 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 228271 T448 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 228272 T448 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 228272 T448 oash.ReplicationHandler.inform Commits will be reserved for 10000 [junit4] 2> 228274 T449 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33ef3e7d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 228275 T448 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 228276 T452 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49805/am_k/ii collection:collection1 shard:shard3 [junit4] 2> 228277 T390 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1 [junit4] 2> 228278 T390 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 228278 T452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election [junit4] 2> 228288 T452 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3 [junit4] 2> 228291 T416 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 228292 T452 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 228292 T452 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C1585 name=collection1 org.apache.solr.core.SolrCore@689c46d9 url=http://127.0.0.1:49805/am_k/ii/collection1 node=127.0.0.1:49805_am_k%2Fii C1585_STATE=coll:collection1 core:collection1 props:{state=down, node_name=127.0.0.1:49805_am_k%2Fii, base_url=http://127.0.0.1:49805/am_k/ii, core=collection1} [junit4] 2> 228293 T452 C1585 P49805 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49805/am_k/ii/collection1/ [junit4] 2> 228293 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard3", [junit4] 2> "collection":"collection1"} current state version: 5 [junit4] 2> 228293 T452 C1585 P49805 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 228294 T452 C1585 P49805 oasc.SyncStrategy.syncToMe http://127.0.0.1:49805/am_k/ii/collection1/ has no replicas [junit4] 2> 228294 T452 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49805/am_k/ii/collection1/ shard3 [junit4] 2> 228295 T452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3 [junit4] 2> 228296 T417 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1 [junit4] 2> 228298 T447 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 228299 T447 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 [junit4] 2> 228306 T417 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard3", [junit4] 2> "collection":"collection1", [junit4] 2> "base_url":"http://127.0.0.1:49805/am_k/ii", [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} curr [...truncated too long message...] akControl.java:365) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 13) Thread[id=3944, name=Thread-1746, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.lang.Object.wait(Object.java:503) [junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:937) [junit4] 2> 14) Thread[id=3924, name=Thread-1735, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.lang.Object.wait(Object.java:503) [junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:937) [junit4] 2> 15) Thread[id=3943, name=searcherExecutor-1944-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 16) Thread[id=4670, name=zkCallback-438-thread-115, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) [junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) [junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) [junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 17) Thread[id=3927, name=HashSessionScavenger-137, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552) [junit4] 2> at java.util.TimerThread.run(Timer.java:505) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {a_i=FST50, rnd_b=FST50, a_t=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=LuceneFixedGap), id=FST50}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=hr_HR, timezone=America/Ojinaga [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=19,free=82578776,total=267911168 [junit4] 2> NOTE: All tests run in this JVM: [TestDocSet, ReturnFieldsTest, TestSolrJ, TestMissingGroups, TestReplicationHandlerBackup, DistributedSuggestComponentTest, DistanceFunctionTest, ZkSolrClientTest, SignatureUpdateProcessorFactoryTest, SortByFunctionTest, PeerSyncTest, TestPhraseSuggestions, ShardRoutingTest, TestFieldResource, TestIBSimilarityFactory, TestInfoStreamLogging, SolrRequestParserTest, OverseerStatusTest, TestDynamicFieldCollectionResource, TestGroupingSearch, TestPostingsSolrHighlighter, TestDefaultStatsCache, TestSearcherReuse, TestStressLucene, CurrencyFieldXmlFileTest, CacheHeaderTest, TestChildDocTransformer, RollingRestartTest, TestConfigReload, TestExceedMaxTermLength, TestSerializedLuceneMatchVersion, StressHdfsTest, SpatialRPTFieldTypeTest, LeaderFailoverAfterPartitionTest, TestManagedResourceStorage, TimeZoneUtilsTest, TestMergePolicyConfig, TestManagedSynonymFilterFactory, MBeansHandlerTest, ResourceLoaderTest, HighlighterConfigTest, PathHierarchyTokenizerFactoryTest, StatelessScriptUpdateProcessorFactoryTest, FileUtilsTest, TestFoldingMultitermQuery, TestSolrXmlPersistor, TestNonDefinedSimilarityFactory, NumericFieldsTest, UnloadDistributedZkTest, ChangedSchemaMergeTest, EchoParamsTest, TestInitQParser, TestLRUCache, TestUniqueKeyFieldResource, BasicDistributedZk2Test, TestReplicationHandler, MultiThreadedOCPTest, DeleteInactiveReplicaTest, TestCloudPivotFacet, ChaosMonkeySafeLeaderTest] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=413B4C505E1F0840 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hr_HR -Dtests.timezone=America/Ojinaga -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 0.00s J2 | ChaosMonkeySafeLeaderTest (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([413B4C505E1F0840]:0) [junit4] Completed on J2 in 7223.89s, 1 test, 2 errors <<< FAILURES! [...truncated 17 lines...] BUILD FAILED /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:529: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:477: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:190: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:508: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1363: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:970: There were test failures: 462 suites, 1872 tests, 1 suite-level error, 5 errors, 61 ignored (22 assumptions) Total time: 160 minutes 10 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2431 Archived 5 artifacts Archive block size is 32768 Received 0 blocks and 175685414 bytes Compression is 0.0% Took 31 sec Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org