Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21582/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC

6 tests failed.
FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalMove

Error Message:
Error from server at http://127.0.0.1:38265/solr: delete the collection time 
out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:38265/solr: delete the collection time out:180s
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:98259DD001E725C2]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
        at 
org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:97)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.test

Error Message:
Error from server at http://127.0.0.1:38265/solr: delete the collection time 
out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:38265/solr: delete the collection time out:180s
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:B6A915AD2AFA8A20]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
        at 
org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:97)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalMove

Error Message:
Error from server at http://127.0.0.1:33991/solr: delete the collection time 
out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:33991/solr: delete the collection time out:180s
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:98259DD001E725C2]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
        at 
org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:97)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.test

Error Message:
Error from server at http://127.0.0.1:33991/solr: delete the collection time 
out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:33991/solr: delete the collection time out:180s
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:B6A915AD2AFA8A20]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
        at 
org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:97)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:9430F98533D53208]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at org.junit.Assert.assertFalse(Assert.java:79)
        at 
org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:303)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([3EFD2A778406E7D8:9430F98533D53208]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at org.junit.Assert.assertFalse(Assert.java:79)
        at 
org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:303)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 13633 lines...]
   [junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/init-core-data-001
   [junit4]   2> 834361 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
   [junit4]   2> 834361 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 834362 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 834362 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 834362 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-001
   [junit4]   2> 834363 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 834363 INFO  (Thread-2222) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 834363 INFO  (Thread-2222) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 834371 ERROR (Thread-2222) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 834463 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:33131
   [junit4]   2> 834465 INFO  (zkConnectionManagerCallback-1621-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834467 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 834467 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 834467 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 834467 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 834468 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 834468 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 834468 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 834468 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1d8acfdc{/solr,null,AVAILABLE}
   [junit4]   2> 834482 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@d9d0fae{HTTP/1.1,[http/1.1]}{127.0.0.1:44385}
   [junit4]   2> 834482 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.e.j.s.Server Started @836840ms
   [junit4]   2> 834482 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44385}
   [junit4]   2> 834483 ERROR (jetty-launcher-1618-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 834483 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 834483 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 834483 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 834483 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-06T19:07:27.209285Z
   [junit4]   2> 834506 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 834506 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 834506 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 834514 INFO  (zkConnectionManagerCallback-1623-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834515 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 834515 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 834515 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 834515 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 834515 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@92057df{/solr,null,AVAILABLE}
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3fdb9045{/solr,null,AVAILABLE}
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@6f3044b{HTTP/1.1,[http/1.1]}{127.0.0.1:41393}
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.e.j.s.Server Started @836874ms
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41393}
   [junit4]   2> 834516 ERROR (jetty-launcher-1618-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 834516 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-06T19:07:27.242917Z
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@653b5237{HTTP/1.1,[http/1.1]}{127.0.0.1:46131}
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.e.j.s.Server Started @836887ms
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=46131}
   [junit4]   2> 834529 ERROR (jetty-launcher-1618-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 834529 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-06T19:07:27.255893Z
   [junit4]   2> 834529 INFO  (zkConnectionManagerCallback-1625-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834530 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 834534 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 834534 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 834534 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 834534 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@a9a81e4{/solr,null,AVAILABLE}
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7295f3ca{HTTP/1.1,[http/1.1]}{127.0.0.1:36833}
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.e.j.s.Server Started @836893ms
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36833}
   [junit4]   2> 834535 ERROR (jetty-launcher-1618-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 834535 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-06T19:07:27.261648Z
   [junit4]   2> 834550 INFO  (jetty-launcher-1618-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33131/solr
   [junit4]   2> 834565 INFO  (zkConnectionManagerCallback-1627-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834565 INFO  (zkConnectionManagerCallback-1630-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834566 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 834566 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 834570 INFO  (jetty-launcher-1618-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33131/solr
   [junit4]   2> 834574 INFO  (zkConnectionManagerCallback-1634-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834581 DEBUG (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$174/1636087406@2da63d6
   [junit4]   2> 834581 INFO  (jetty-launcher-1618-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33131/solr
   [junit4]   2> 834582 INFO  (zkConnectionManagerCallback-1637-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834591 DEBUG (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$174/1636087406@6289738b
   [junit4]   2> 834595 INFO  (zkConnectionManagerCallback-1643-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834596 INFO  
(zkConnectionManagerCallback-1641-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834596 INFO  (jetty-launcher-1618-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33131/solr
   [junit4]   2> 834596 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1001dda6da90007, likely client has closed socket
   [junit4]   2> 834596 DEBUG (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$174/1636087406@6aac058d
   [junit4]   2> 834597 INFO  
(zkConnectionManagerCallback-1646-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834622 INFO  (zkConnectionManagerCallback-1649-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834623 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1001dda6da9000a, likely client has closed socket
   [junit4]   2> 834643 DEBUG (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$174/1636087406@79a8b9cd
   [junit4]   2> 834652 INFO  
(zkConnectionManagerCallback-1651-thread-1-processing-n:127.0.0.1:46131_solr) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834658 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 834658 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834658 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 834658 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 834659 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 834659 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 834663 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 834667 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 834667 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834668 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 834668 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 834668 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 834669 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 834669 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 834670 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 834670 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834670 DEBUG (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/72090418017796105-127.0.0.1:44385_solr-n_0000000000
   [junit4]   2> 834670 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 834670 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:44385_solr
   [junit4]   2> 834670 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 834670 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 834671 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 834671 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer Overseer 
(id=72090418017796105-127.0.0.1:44385_solr-n_0000000000) starting
   [junit4]   2> 834672 INFO  
(zkConnectionManagerCallback-1655-thread-1-processing-n:127.0.0.1:36833_solr) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834673 DEBUG (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/72090418017796107-127.0.0.1:46131_solr-n_0000000001
   [junit4]   2> 834674 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 834674 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: 
/solr/overseer_elect/election/72090418017796105-127.0.0.1:44385_solr-n_0000000000
   [junit4]   2> 834674 DEBUG (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/72090418017796105-127.0.0.1:44385_solr-n_0000000000 to 
know if I could be the leader
   [junit4]   2> 834674 DEBUG (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/72090418017796104-127.0.0.1:41393_solr-n_0000000002
   [junit4]   2> 834674 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46131_solr
   [junit4]   2> 834675 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: 
/solr/overseer_elect/election/72090418017796107-127.0.0.1:46131_solr-n_0000000001
   [junit4]   2> 834675 DEBUG (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/72090418017796107-127.0.0.1:46131_solr-n_0000000001 to 
know if I could be the leader
   [junit4]   2> 834675 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41393_solr
   [junit4]   2> 834675 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834675 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834675 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834687 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834687 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834691 INFO  
(zkCallback-1640-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 834691 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834692 INFO  
(zkCallback-1650-thread-1-processing-n:127.0.0.1:46131_solr) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 834692 INFO  
(zkCallback-1645-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834695 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 834695 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 834696 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 834696 DEBUG (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/72090418017796108-127.0.0.1:36833_solr-n_0000000003
   [junit4]   2> 834697 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: 
/solr/overseer_elect/election/72090418017796104-127.0.0.1:41393_solr-n_0000000002
   [junit4]   2> 834697 DEBUG (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/72090418017796104-127.0.0.1:41393_solr-n_0000000002 to 
know if I could be the leader
   [junit4]   2> 834697 DEBUG (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:36833_solr as DOWN
   [junit4]   2> 834697 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36833_solr
   [junit4]   2> 834698 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834698 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834698 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834698 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834707 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834707 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834707 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834707 INFO  
(zkCallback-1645-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 834707 INFO  
(zkCallback-1640-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 834707 INFO  
(zkCallback-1650-thread-1-processing-n:127.0.0.1:46131_solr) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 834716 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834716 INFO  
(zkCallback-1654-thread-1-processing-n:127.0.0.1:36833_solr) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 834724 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 834725 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue-work
   [junit4]   2> 834725 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 834725 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:36833_solr"} current state version: 0
   [junit4]   2> 834725 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:36833_solr
   [junit4]   2> 834726 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46131.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834731 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 834732 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Cleaning up 
work-queue. #Running tasks: 0
   [junit4]   2> 834732 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 834732 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 834733 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 834733 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 834733 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 
elements. ExcludeSet: []
   [junit4]   2> 834733 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834733 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46131.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834734 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46131.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834735 INFO  (jetty-launcher-1618-thread-2) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-001/node2/.
   [junit4]   2> 834737 DEBUG (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:44385_solr as DOWN
   [junit4]   2> 834738 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 834738 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44385_solr
   [junit4]   2> 834738 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834738 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834738 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834738 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 834743 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 834744 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834744 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834744 INFO  
(zkCallback-1640-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 834744 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/autoscaling.json
   [junit4]   2> 834744 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 834745 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:36833_solr, 127.0.0.1:46131_solr, 127.0.0.1:41393_solr]
   [junit4]   2> 834745 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 834745 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 834747 INFO  
(zkCallback-1650-thread-1-processing-n:127.0.0.1:46131_solr) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 834747 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834748 INFO  
(zkCallback-1654-thread-1-processing-n:127.0.0.1:36833_solr) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 834748 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 834748 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834748 INFO  
(zkCallback-1645-thread-2-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 834751 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41393.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834759 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:44385_solr"} current state version: 0
   [junit4]   2> 834759 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:44385_solr
   [junit4]   2> 834759 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 834760 DEBUG 
(OverseerAutoScalingTriggerThread-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 834760 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 834760 DEBUG (ScheduledTrigger-3517-thread-1) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 4
   [junit4]   2> 834767 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36833.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834783 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41393.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834783 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41393.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834784 INFO  (jetty-launcher-1618-thread-4) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-001/node4/.
   [junit4]   2> 834792 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36833.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834792 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36833.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834816 INFO  (jetty-launcher-1618-thread-1) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-001/node1/.
   [junit4]   2> 834826 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44385.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834833 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44385.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834833 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44385.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@39ce084d
   [junit4]   2> 834834 INFO  (jetty-launcher-1618-thread-3) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-001/node3/.
   [junit4]   2> 834860 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 834860 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 834902 INFO  (zkConnectionManagerCallback-1663-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834904 INFO  (zkConnectionManagerCallback-1667-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 834904 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 834904 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 834904 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 834904 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 834904 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 834905 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 834905 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33131/solr ready
   [junit4]   2> 834907 INFO  (qtp1770211762-8493) [n:127.0.0.1:41393_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 834908 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834908 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/overseer/collection-queue-work/qnr-0000000000
   [junit4]   2> 834908 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834908 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.ZkDistributedQueue Found child node with 
improper name: qnr-0000000000
   [junit4]   2> 834908 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834908 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834908 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.ZkDistributedQueue Found child node with 
improper name: qnr-0000000000
   [junit4]   2> 834908 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskQueue Returning topN 
elements: [/overseer/collection-queue-work/qn-0000000000, ]
   [junit4]   2> 834908 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from 
work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Marked task 
[/overseer/collection-queue-work/qn-0000000000] as running
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection 
Message Handler: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 
message:{"operation":"overseerstatus"}
   [junit4]   2> 834909 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Runner processing 
/overseer/collection-queue-work/qn-0000000000
   [junit4]   2> 834909 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler 
OverseerCollectionMessageHandler.processMessage : overseerstatus , 
{"operation":"overseerstatus"}
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Cleaning up 
work-queue. #Running tasks: 1
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 834909 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskQueue Peeking for top 99 
elements. ExcludeSet: [/overseer/collection-queue-work/qn-0000000000],[]
   [junit4]   2> 834910 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Completed 
task:[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 834910 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/overseer/collection-queue-work/qnr-0000000000
   [junit4]   2> 834910 DEBUG 
(zkCallback-1640-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.OverseerTaskQueue NodeDataChanged fired on 
path /overseer/collection-queue-work/qnr-0000000000 state SyncConnected 
latchEventType null
   [junit4]   2> 834911 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Marked task 
[/overseer/collection-queue-work/qn-0000000000] as completed.
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 834911 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834911 DEBUG 
(OverseerThreadFactory-3520-thread-1-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection 
Message Handler: Message id:/overseer/collection-queue-work/qn-0000000000 
complete, 
response:{leader=127.0.0.1:44385_solr,overseer_queue_size=0,overseer_work_queue_size=0,overseer_collection_queue_size=2,overseer_operations={am_i_leader={requests=3,errors=0,avgRequestsPerSecond=16.091410453910314,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=0.196907,medianRequestTime=0.158103,75thPcRequestTime=0.321793,95thPcRequestTime=0.321793,99thPcRequestTime=0.321793,999thPcRequestTime=0.321793},downnode={requests=2,errors=0,avgRequestsPerSecond=10.832985933015694,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=0.041992,medianRequestTime=0.048307,75thPcRequestTime=0.048307,95thPcRequestTime=0.048307,99thPcRequestTime=0.048307,999thPcRequestTime=0.048307}},collection_operations={am_i_leader={requests=3,errors=0,avgRequestsPerSecond=16.83545227047988,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=0.190491,medianRequestTime=0.157861,75thPcRequestTime=0.278182,95thPcRequestTime=0.278182,99thPcRequestTime=0.278182,999thPcRequestTime=0.278182},overseerstatus={requests=0,errors=0,avgRequestsPerSecond=0.0,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=0.0,medianRequestTime=0.0,75thPcRequestTime=0.0,95thPcRequestTime=0.0,99thPcRequestTime=0.0,999thPcRequestTime=0.0}},overseer_queue={},overseer_internal_queue={peek={avgRequestsPerSecond=5.395987511310664,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=0.264125,medianRequestTime=0.264125,75thPcRequestTime=0.264125,95thPcRequestTime=0.264125,99thPcRequestTime=0.264125,999thPcRequestTime=0.264125}},collection_queue={peektopn_wait2000={avgRequestsPerSecond=5.646525313245933,5minRateRequestsPerSecond=0.0,15minRateRequestsPerSecond=0.0,avgTimePerRequest=175.800511,medianRequestTime=175.800511,75thPcRequestTime=175.800511,95thPcRequestTime=175.800511,99thPcRequestTime=175.800511,999thPcRequestTime=175.800511}}}
   [junit4]   2> 834911 DEBUG 
(OverseerCollectionConfigSetProcessor-72090418017796105-127.0.0.1:44385_solr-n_0000000000)
 [n:127.0.0.1:44385_solr    ] o.a.s.c.ZkDistributedQueue Found child node with 
improper name: qnr-0000000000
   [junit4]   2> 834911 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834911 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 834912 INFO  (qtp1770211762-8493) [n:127.0.0.1:41393_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 835113 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 835123 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 835125 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
jetty-6.1.x
   [junit4]   2> 835128 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_localdomain_44469_hdfs____2g5qhd/webapp
   [junit4]   2> 835198 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44469
   [junit4]   2> 835276 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 835278 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
jetty-6.1.x
   [junit4]   2> 835281 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_35451_datanode____1m2hat/webapp
   [junit4]   2> 835353 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35451
   [junit4]   2> 835425 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 835427 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
jetty-6.1.x
   [junit4]   2> 835434 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_38239_datanode____.onak92/webapp
   [junit4]   2> 835502 ERROR (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-002/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-002/hdfsBaseDir/data/data2/]]
  heartbeating to localhost.localdomain/127.0.0.1:39429) [    ] 
o.a.h.h.s.d.DirectoryScanner 
dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 
ms/sec. Assuming default value of 1000
   [junit4]   2> 835509 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0x1c78677f32642: from storage 
DS-7cbed103-41e1-442a-8ad1-c451b5221d79 node 
DatanodeRegistration(127.0.0.1:43835, 
datanodeUuid=f80f7d42-bddb-437e-a347-f3ec54132163, infoPort=34145, 
infoSecurePort=0, ipcPort=46635, 
storageInfo=lv=-56;cid=testClusterID;nsid=1056182773;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 835509 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0x1c78677f32642: from storage 
DS-1e27d589-92b3-4122-9067-39635d58a9d9 node 
DatanodeRegistration(127.0.0.1:43835, 
datanodeUuid=f80f7d42-bddb-437e-a347-f3ec54132163, infoPort=34145, 
infoSecurePort=0, ipcPort=46635, 
storageInfo=lv=-56;cid=testClusterID;nsid=1056182773;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 835523 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38239
   [junit4]   2> 835657 ERROR (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-002/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-001/tempDir-002/hdfsBaseDir/data/data4/]]
  heartbeating to localhost.localdomain/127.0.0.1:39429) [    ] 
o.a.h.h.s.d.DirectoryScanner 
dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 
ms/sec. Assuming default value of 1000
   [junit4]   2> 835667 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0x1c786816b7020: from storage 
DS-7c1fa292-0536-4c79-8509-00c13df29d81 node 
DatanodeRegistration(127.0.0.1:42179, 
datanodeUuid=a31a237f-ca9f-4f97-a5c5-e8fb3fb986a9, infoPort=36715, 
infoSecurePort=0, ipcPort=41977, 
storageInfo=lv=-56;cid=testClusterID;nsid=1056182773;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 1 msecs
   [junit4]   2> 835667 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0x1c786816b7020: from storage 
DS-f3e61f80-7c4d-46ff-8c4a-f22d6a7772f0 node 
DatanodeRegistration(127.0.0.1:42179, 
datanodeUuid=a31a237f-ca9f-4f97-a5c5-e8fb3fb986a9, infoPort=36715, 
infoSecurePort=0, ipcPort=41977, 
storageInfo=lv=-56;cid=testClusterID;nsid=1056182773;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 835761 DEBUG (ScheduledTrigger-3517-thread-1) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 4
   [junit4] IGNOR/A 0.00s J1 | MoveReplicaHDFSTest.testNormalFailedMove
   [junit4]    > Assumption #1: 'badapple' test group is disabled 
(@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";))
   [junit4]   2> 835821 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testFailedMove
   [junit4]   2> 835821 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 835821 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 835822 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 835822 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 835822 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 835822 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 835823 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 835843 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 835843 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 835843 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 835844 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@21718b85{/solr,null,AVAILABLE}
   [junit4]   2> 835844 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7359691c{HTTP/1.1,[http/1.1]}{127.0.0.1:33991}
   [junit4]   2> 835844 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.e.j.s.Server Started @838202ms
   [junit4]   2> 835844 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=33991}
   [junit4]   2> 835845 ERROR 
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 835845 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 835845 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 835845 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 835845 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-06T19:07:28.571296Z
   [junit4]   2> 835871 INFO  (zkConnectionManagerCallback-1670-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 835872 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 835894 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33131/solr
   [junit4]   2> 835967 INFO  (zkConnectionManagerCallback-1674-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 835969 DEBUG 
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$174/1636087406@7952ede9
   [junit4]   2> 835991 INFO  
(zkConnectionManagerCallback-1676-thread-1-processing-n:127.0.0.1:33991_solr) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 836008 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 836009 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836009 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 836009 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 836009 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 836009 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 836009 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 836010 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 836010 DEBUG 
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/72090418017796113-127.0.0.1:33991_solr-n_0000000004
   [junit4]   2> 836010 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: 
/solr/overseer_elect/election/72090418017796108-127.0.0.1:36833_solr-n_0000000003
   [junit4]   2> 836010 DEBUG 
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/72090418017796108-127.0.0.1:36833_solr-n_0000000003 to 
know if I could be the leader
   [junit4]   2> 836011 DEBUG 
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:33991_solr as DOWN
   [junit4]   2> 836011 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 836011 INFO  
(TEST-MoveReplicaHDFSTest.testFailedMove-seed#[3EFD2A778406E7D8]) 
[n:127.0.0.1:33991_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33991_solr
   [junit4]   2> 836011 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 836012 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33991_solr"} current state version: 0
   [junit4]   2> 836012 DEBUG 
(OverseerStateUpdate-72090418017796105-127.0.0.1:44385_solr-n_0000000000) 
[n:127.0.0.1:44385_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:33991_solr
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836012 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 836013 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836013 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836013 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836013 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836013 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 836013 INFO  (zkCallback-1666-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 836013 INFO  
(zkCallback-1640-thread-1-processing-n:127.0.0.1:41393_solr) 
[n:127.0.0.1:41393_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 836013 INFO  
(zkCallback-1650-thread-1-processing-n:127.0.0.1:46131_solr) 
[n:127.0.0.1:46131_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 836013 INFO  
(zkCallback-1654-thread-1-processing-n:127.0.0.1:36833_solr) 
[n:127.0.0.1:36833_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 836013 INFO  
(zkCallback-1645-thread-2-processing-n:127.0.0.1:44385_solr) 
[n:127.0.0.1:44385_s

[...truncated too long message...]

collection-queue-work/qn-0000000012]
   [junit4]   2> 603577 DEBUG 
(OverseerThreadFactory-224-thread-5-processing-n:127.0.0.1:42293_solr) 
[n:127.0.0.1:42293_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection 
Message Handler: Message id:/overseer/collection-queue-work/qn-0000000012 
complete, response:{Operation delete caused 
exception:=org.apache.solr.common.SolrException: Could not fully remove 
collection: MoveReplicaHDFSTest_failed_coll_true,exception={msg=Could not fully 
remove collection: MoveReplicaHDFSTest_failed_coll_true,rspCode=500}}
   [junit4]   2> 603577 WARN  
(OverseerAutoScalingTriggerThread-72090548410253323-127.0.0.1:42293_solr-n_0000000001)
 [n:127.0.0.1:42293_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 603577 DEBUG (jetty-closer-99-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 603578 INFO  (jetty-closer-99-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5587d00f{/solr,null,UNAVAILABLE}
   [junit4]   2> 603578 INFO  (jetty-closer-99-thread-1) [    ] o.e.j.s.session 
Stopped scavenging
   [junit4]   2> 603578 ERROR 
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 603579 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:32965 32965
   [junit4]   2> 604358 INFO  (Thread-2014) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:32965 32965
   [junit4]   2> 604359 WARN  (Thread-2014) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        11      
/solr/collections/MoveReplicaHDFSTest_failed_coll_true/terms/shard1
   [junit4]   2>        11      /solr/clusterprops.json
   [junit4]   2>        11      /solr/aliases.json
   [junit4]   2>        10      
/solr/collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard1
   [junit4]   2>        9       /solr/configs/conf1
   [junit4]   2>        7       
/solr/collections/MoveReplicaHDFSTest_failed_coll_true/terms/shard2
   [junit4]   2>        7       
/solr/collections/MoveReplicaHDFSTest_failed_coll_false/terms/shard2
   [junit4]   2>        6       /solr/security.json
   [junit4]   2>        5       
/solr/collections/MoveReplicaHDFSTest_failed_coll_true/collectionprops.json
   [junit4]   2>        4       
/solr/collections/MoveReplicaHDFSTest_failed_coll_false/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        318     
/solr/collections/MoveReplicaHDFSTest_failed_coll_true/state.json
   [junit4]   2>        31      
/solr/collections/MoveReplicaHDFSTest_failed_coll_false/state.json
   [junit4]   2>        11      /solr/clusterstate.json
   [junit4]   2>        3       
/solr/overseer_elect/election/72090548410253324-127.0.0.1:33931_solr-n_0000000002
   [junit4]   2>        2       /solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        17      /solr/live_nodes
   [junit4]   2>        17      /solr/collections
   [junit4]   2>        2       /solr/overseer/queue
   [junit4]   2>        2       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 604360 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 604426 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 604526 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data4/]]
  heartbeating to localhost.localdomain/127.0.0.1:37189) [    ] 
o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager 
interrupted
   [junit4]   2> 604526 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data4/]]
  heartbeating to localhost.localdomain/127.0.0.1:37189) [    ] 
o.a.h.h.s.d.DataNode Ending block pool service for: Block pool 
BP-318970847-88.99.242.108-1520365237343 (Datanode Uuid 
ab5f1a56-705f-4f71-9234-5865a28c5b06) service to 
localhost.localdomain/127.0.0.1:37189
   [junit4]   2> 604528 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 604550 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 604652 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data2/]]
  heartbeating to localhost.localdomain/127.0.0.1:37189) [    ] 
o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager 
interrupted
   [junit4]   2> 604652 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002/tempDir-002/hdfsBaseDir/data/data2/]]
  heartbeating to localhost.localdomain/127.0.0.1:37189) [    ] 
o.a.h.h.s.d.DataNode Ending block pool service for: Block pool 
BP-318970847-88.99.242.108-1520365237343 (Datanode Uuid 
57c3326e-a2e5-422e-98d7-02507e33a33a) service to 
localhost.localdomain/127.0.0.1:37189
   [junit4]   2> 604658 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] o.m.log 
Stopped 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 604770 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[3EFD2A778406E7D8]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:32965 32965
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_3EFD2A778406E7D8-002
   [junit4]   2> Mar 06, 2018 7:49:13 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 66 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))},
 docValues:{}, maxPointsInLeafNode=1487, maxMBSortInHeap=7.356460472897405, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@388ca915),
 locale=en-TK, timezone=Africa/Sao_Tome
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 9.0.4 
(64-bit)/cpus=8,threads=2,free=171179448,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [MoveReplicaHDFSTest, 
MoveReplicaHDFSTest]
   [junit4] Completed [5/5 (2!)] on J1 in 526.20s, 4 tests, 1 failure, 2 errors 
<<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1561: 
The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: 
There were test failures: 5 suites, 20 tests, 3 errors, 1 failure [seed: 
3EFD2A778406E7D8]

Total time: 10 minutes 18 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   2/5 failed: org.apache.solr.cloud.MoveReplicaHDFSTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=2ff27ca507c9bf3921b9c6a4eabcb737b7cb6921, 
workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21581
Recording test results
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to