Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4309/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at 
http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2: 
ClusterState says we are the leader 
(http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2), but 
locally we don't think so. Request came from null

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from 
server at http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2: 
ClusterState says we are the leader 
(http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2), but 
locally we don't think so. Request came from null
        at 
__randomizedtesting.SeedInfo.seed([2AE4528A62B924E7:6291263E648A0B72]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:549)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1012)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:460)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at 
http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2: 
ClusterState says we are the leader 
(http://127.0.0.1:54374/solr/awhollynewcollection_0_shard2_replica_n2), but 
locally we don't think so. Request came from null
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:526)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more




Build Log:
[...truncated 12117 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/init-core-data-001
   [junit4]   2> 804277 WARN  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=22 numCloses=22
   [junit4]   2> 804277 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 804281 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) 
w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 804281 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 804283 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001
   [junit4]   2> 804283 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 804283 INFO  (Thread-1534) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 804283 INFO  (Thread-1534) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 804285 ERROR (Thread-1534) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 804389 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:54370
   [junit4]   2> 804404 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 804404 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 804404 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 804404 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 804406 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@650c6192{/solr,null,AVAILABLE}
   [junit4]   2> 804407 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7b2c727c{/solr,null,AVAILABLE}
   [junit4]   2> 804408 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6219edd4{/solr,null,AVAILABLE}
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@f2258d8{HTTP/1.1,[http/1.1]}{127.0.0.1:54373}
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.e.j.s.Server Started @807493ms
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=54373}
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@e098424{HTTP/1.1,[http/1.1]}{127.0.0.1:54374}
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.e.j.s.Server Started @807493ms
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=54374}
   [junit4]   2> 804409 ERROR (jetty-launcher-1387-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 804409 ERROR (jetty-launcher-1387-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@630fbf87{HTTP/1.1,[http/1.1]}{127.0.0.1:54372}
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.e.j.s.Server Started @807494ms
   [junit4]   2> 804409 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=54372}
   [junit4]   2> 804409 ERROR (jetty-launcher-1387-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-12-03T15:11:00.951Z
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 804410 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-12-03T15:11:00.951Z
   [junit4]   2> 804411 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 804411 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 804411 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 804411 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-12-03T15:11:00.952Z
   [junit4]   2> 804412 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@69b7d4f1{/solr,null,AVAILABLE}
   [junit4]   2> 804413 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@5ce140b4{HTTP/1.1,[http/1.1]}{127.0.0.1:54376}
   [junit4]   2> 804413 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.e.j.s.Server Started @807497ms
   [junit4]   2> 804413 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=54376}
   [junit4]   2> 804413 ERROR (jetty-launcher-1387-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 804413 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 804414 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 804414 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 804414 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-12-03T15:11:00.955Z
   [junit4]   2> 804415 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 804415 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 804416 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 804419 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 804419 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 804419 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 804419 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 804421 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 804422 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 804422 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 804424 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 804424 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 804427 INFO  (jetty-launcher-1387-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54370/solr
   [junit4]   2> 804427 INFO  (jetty-launcher-1387-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54370/solr
   [junit4]   2> 804427 INFO  (jetty-launcher-1387-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54370/solr
   [junit4]   2> 804431 INFO  (jetty-launcher-1387-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54370/solr
   [junit4]   2> 804587 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 804587 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 804587 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:54376_solr
   [junit4]   2> 804588 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 804588 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54374_solr
   [junit4]   2> 804589 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer Overseer 
(id=99111001183092748-127.0.0.1:54376_solr-n_0000000000) starting
   [junit4]   2> 804590 INFO  
(zkCallback-1406-thread-1-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 804591 INFO  
(zkCallback-1407-thread-1-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 804591 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 804592 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 804594 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54373_solr
   [junit4]   2> 804595 INFO  
(zkCallback-1407-thread-1-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 804595 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 804595 INFO  
(zkCallback-1406-thread-1-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 804596 INFO  
(zkCallback-1408-thread-1-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 804605 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 804608 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54372_solr
   [junit4]   2> 804610 INFO  
(zkCallback-1406-thread-1-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 804610 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 804611 INFO  
(zkCallback-1407-thread-1-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 804611 INFO  
(zkCallback-1408-thread-1-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 804616 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54376_solr
   [junit4]   2> 804620 INFO  
(zkCallback-1407-thread-1-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 804620 INFO  
(zkCallback-1406-thread-1-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 804620 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 804620 INFO  
(zkCallback-1408-thread-1-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 804705 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804711 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804742 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804742 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804753 INFO  (jetty-launcher-1387-thread-2) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node2
   [junit4]   2> 804774 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804774 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804781 INFO  (jetty-launcher-1387-thread-3) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node3
   [junit4]   2> 804803 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804804 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804850 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804851 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804853 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804853 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 804857 INFO  (jetty-launcher-1387-thread-4) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node4
   [junit4]   2> 804858 INFO  (jetty-launcher-1387-thread-1) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node1
   [junit4]   2> 804937 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 804939 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54370/solr ready
   [junit4]   2> 804972 INFO  
(TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[2AE4528A62B924E7]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Starting addReplicaTest
   [junit4]   2> 804973 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 804974 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 804974 INFO  
(TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[2AE4528A62B924E7]) [ 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 804974 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 804975 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804975 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 804978 INFO  (qtp2004659444-7467) [n:127.0.0.1:54376_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=4&name=addReplicaColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 804979 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 804979 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/overseer/collection-queue-work/qnr-0000000000
   [junit4]   2> 804979 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 804979 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.ZkDistributedQueue Found child node with 
improper name: qnr-0000000000
   [junit4]   2> 804979 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/collection-queue-work
   [junit4]   2> 804980 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 804980 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.ZkDistributedQueue Found child node with 
improper name: qnr-0000000000
   [junit4]   2> 804980 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskQueue Returning topN 
elements: [/overseer/collection-queue-work/qn-0000000000, ]
   [junit4]   2> 804980 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from 
work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
   [junit4]   2> 804980 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor Marked task 
[/overseer/collection-queue-work/qn-0000000000] as running
   [junit4]   2> 804980 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection 
Message Handler: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>   "name":"addReplicaColl",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"conf",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 804981 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor Runner processing 
/overseer/collection-queue-work/qn-0000000000
   [junit4]   2> 804981 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
OverseerCollectionMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"addReplicaColl",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"conf",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 804981 INFO  
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
addReplicaColl
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor Cleaning up 
work-queue. #Running tasks: 1
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor RunningTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: 
[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 804981 DEBUG 
(OverseerCollectionConfigSetProcessor-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerTaskQueue Peeking for top 99 
elements. ExcludeSet: [/overseer/collection-queue-work/qn-0000000000],[]
   [junit4]   2> 804982 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Assign Identify nodes using default
   [junit4]   2> 804982 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating 
collections conf node /collections/addReplicaColl 
   [junit4]   2> 804983 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 804983 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 804983 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 804983 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 804983 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 804984 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804984 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804984 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804984 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804985 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804985 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 804985 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Check for collection 
zkNode:addReplicaColl
   [junit4]   2> 804986 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Collection zkNode 
exists
   [junit4]   2> 804987 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 804987 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 804988 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "name":"addReplicaColl",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"conf",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 804988 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: addReplicaColl
   [junit4]   2> 804988 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/addReplicaColl/state.json
   [junit4]   2> 804989 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 804990 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805096 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Creating SolrCores for 
new collection addReplicaColl, shardNames [shard1, shard2] , nrtReplicas : 2, 
tlogReplicas: 0, pullReplicas: 0
   [junit4]   2> 805098 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Creating core 
addReplicaColl_shard1_replica_n1 as part of shard shard1 of collection 
addReplicaColl on 127.0.0.1:54376_solr
   [junit4]   2> 805099 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805100 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805100 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 805100 INFO  
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 805101 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Creating core 
addReplicaColl_shard1_replica_n2 as part of shard shard1 of collection 
addReplicaColl on 127.0.0.1:54374_solr
   [junit4]   2> 805102 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-ffffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 805102 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-ffffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>       "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805103 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805104 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805106 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 805106 INFO  
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 805108 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Creating core 
addReplicaColl_shard2_replica_n4 as part of shard shard2 of collection 
addReplicaColl on 127.0.0.1:54373_solr
   [junit4]   2> 805109 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-ffffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>       "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805109 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-ffffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>       "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>       "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805110 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805111 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805112 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, 
message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 805112 INFO  
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 805115 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.CreateCollectionCmd Creating core 
addReplicaColl_shard2_replica_n6 as part of shard shard2 of collection 
addReplicaColl on 127.0.0.1:54372_solr
   [junit4]   2> 805116 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard2:{
   [junit4]   2>   "range":"0-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 805116 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator New Slice: shard2:{
   [junit4]   2>   "range":"0-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node7":{
   [junit4]   2>       "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>       "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805118 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805118 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerCollectionMessageHandler Expecting 
4 cores but found 0
   [junit4]   2> 805118 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805119 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 805119 INFO  
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 805122 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard2:{
   [junit4]   2>   "range":"0-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node7":{
   [junit4]   2>       "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>       "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805122 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.SliceMutator New Slice: shard2:{
   [junit4]   2>   "range":"0-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node7":{
   [junit4]   2>       "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>       "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node8":{
   [junit4]   2>       "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>       "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 805226 DEBUG 
(OverseerThreadFactory-3436-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.OverseerCollectionMessageHandler Expecting 
4 cores but found 0
   [junit4]   2> 805232 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/addReplicaColl/state.json version: 0
   [junit4]   2> 805233 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805234 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805333 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 805334 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 805335 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 805335 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n6&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 805335 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 805335 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n4&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 805336 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 805336 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 805338 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805338 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805338 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805339 DEBUG (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 805339 DEBUG (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 805339 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805339 DEBUG (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 805339 DEBUG (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 805340 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805340 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805340 DEBUG (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.ZkController Registering watch for collection addReplicaColl
   [junit4]   2> 805340 DEBUG (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.ZkController Registering watch for collection addReplicaColl
   [junit4]   2> 805341 DEBUG (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.ZkController Registering watch for collection addReplicaColl
   [junit4]   2> 805341 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805341 DEBUG (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.ZkController Registering watch for collection addReplicaColl
   [junit4]   2> 805341 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805341 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805341 DEBUG (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for 
addReplicaColl_shard1_replica_n1
   [junit4]   2> 805341 DEBUG (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for 
addReplicaColl_shard1_replica_n2
   [junit4]   2> 805341 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805341 DEBUG (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for 
addReplicaColl_shard2_replica_n6
   [junit4]   2> 805342 DEBUG (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for 
addReplicaColl_shard2_replica_n4
   [junit4]   2> 805342 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 805342 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Will update state for 
replica: 
core_node5:{"core":"addReplicaColl_shard1_replica_n2","base_url":"http://127.0.0.1:54374/solr","node_name":"127.0.0.1:54374_solr","state":"down","type":"NRT"}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: 
DocCollection(addReplicaColl//collections/addReplicaColl/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard1":{
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>           "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}},
   [junit4]   2>     "shard2":{
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node7":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>           "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node8":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>           "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54376_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54376_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Will update state for 
replica: 
core_node3:{"core":"addReplicaColl_shard1_replica_n1","base_url":"http://127.0.0.1:54376/solr","node_name":"127.0.0.1:54376_solr","state":"down","type":"NRT"}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: 
DocCollection(addReplicaColl//collections/addReplicaColl/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard1":{
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54376_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>           "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}},
   [junit4]   2>     "shard2":{
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node7":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>           "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node8":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>           "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>   "core_node_name":"core_node8",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54372_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>   "core_node_name":"core_node8",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54372_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 805343 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Will update state for 
replica: 
core_node8:{"core":"addReplicaColl_shard2_replica_n6","base_url":"http://127.0.0.1:54372/solr","node_name":"127.0.0.1:54372_solr","state":"down","type":"NRT"}
   [junit4]   2> 805344 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: 
DocCollection(addReplicaColl//collections/addReplicaColl/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard1":{
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54376_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>           "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}},
   [junit4]   2>     "shard2":{
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node7":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>           "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node8":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>           "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54372_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 805344 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>   "core_node_name":"core_node7",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54373_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 805344 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>   "core_node_name":"core_node7",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:54373_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 805344 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Will update state for 
replica: 
core_node7:{"core":"addReplicaColl_shard2_replica_n4","base_url":"http://127.0.0.1:54373/solr","node_name":"127.0.0.1:54373_solr","state":"down","type":"NRT"}
   [junit4]   2> 805344 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: 
DocCollection(addReplicaColl//collections/addReplicaColl/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard1":{
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:54376/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54376_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>           "base_url":"http://127.0.0.1:54374/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54374_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}},
   [junit4]   2>     "shard2":{
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node7":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>           "base_url":"http://127.0.0.1:54373/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54373_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node8":{
   [junit4]   2>           "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>           "base_url":"http://127.0.0.1:54372/solr";,
   [junit4]   2>           "node_name":"127.0.0.1:54372_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 805452 DEBUG 
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/addReplicaColl/state.json version: 1
   [junit4]   2> 805452 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805452 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805452 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805453 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805453 INFO  
(zkCallback-1406-thread-1-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805453 INFO  
(zkCallback-1407-thread-1-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805453 INFO  
(zkCallback-1408-thread-1-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805453 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805453 INFO  
(zkCallback-1407-thread-2-processing-n:127.0.0.1:54373_solr) 
[n:127.0.0.1:54373_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805453 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 805454 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805454 INFO  
(zkCallback-1409-thread-2-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805454 INFO  
(zkCallback-1408-thread-2-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805454 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805454 INFO  
(zkCallback-1406-thread-2-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 805454 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805454 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805455 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805455 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805455 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805455 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/addReplicaColl/state.json
   [junit4]   2> 805456 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 805625 DEBUG (ScheduledTrigger-3434-thread-1) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: [127.0.0.1:54376_solr, 
127.0.0.1:54373_solr, 127.0.0.1:54372_solr, 127.0.0.1:54374_solr]
   [junit4]   2> 806385 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 806385 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 806385 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 806392 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 806404 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 806406 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 806407 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 806407 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 806407 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 806408 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n2' 
using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 806408 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n4' 
using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 806408 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.addReplicaColl.shard2.replica_n4' (registry 
'solr.core.addReplicaColl.shard2.replica_n4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 806408 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.addReplicaColl.shard1.replica_n2' (registry 
'solr.core.addReplicaColl.shard1.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 806408 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 806408 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 806408 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n4] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node1/addReplicaColl_shard2_replica_n4],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node1/addReplicaColl_shard2_replica_n4/data/]
   [junit4]   2> 806408 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 806408 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n1' 
using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 806408 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node2/addReplicaColl_shard1_replica_n2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node2/addReplicaColl_shard1_replica_n2/data/]
   [junit4]   2> 806410 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.addReplicaColl.shard1.replica_n1' (registry 
'solr.core.addReplicaColl.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 806410 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 806410 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node4/addReplicaColl_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node4/addReplicaColl_shard1_replica_n1/data/]
   [junit4]   2> 806412 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 806414 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 806414 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n6' 
using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 806414 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.addReplicaColl.shard2.replica_n6' (registry 
'solr.core.addReplicaColl.shard2.replica_n6') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@777e25e6
   [junit4]   2> 806414 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 806414 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n6] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node3/addReplicaColl_shard2_replica_n6],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001/tempDir-001/node3/addReplicaColl_shard2_replica_n6/data/]
   [junit4]   2> 806486 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 806486 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 806487 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 806487 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 806490 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 806490 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 806490 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 806490 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 806491 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 806491 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 806491 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4471e4c0[addReplicaColl_shard2_replica_n4] main]
   [junit4]   2> 806492 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@646c0d32[addReplicaColl_shard1_replica_n2] main]
   [junit4]   2> 806492 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 806493 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 806494 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 806494 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 806494 INFO  (qtp2004659444-7468) [n:127.0.0.1:54376_solr 
c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 806494 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 806494 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 806495 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 806495 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 806495 INFO  (qtp1910507549-7457) [n:127.0.0.1:54373_solr 
c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1585776021246836736
   [junit4]   2> 806495 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 806495 INFO  (qtp2117958752-7449) [n:127.0.0.1:54372_solr 
c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 806495 INFO  (qtp2052026599-7475) [n:127.0.0.1:54374_solr 
c:addReplicaColl s:shard1 r:core_node5 x:addRepli

[...truncated too long message...]

tricRegistry@234a82ca
   [junit4]   2> 889060 INFO  (coreCloseExecutor-3620-thread-1) 
[n:127.0.0.1:54372_solr c:withconfigset2 s:shard1 r:core_node2 
x:withconfigset2_shard1_replica_n1] o.a.s.c.SolrCore 
[withconfigset2_shard1_replica_n1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@34df668f
   [junit4]   2> 889060 INFO  (coreCloseExecutor-3620-thread-1) 
[n:127.0.0.1:54372_solr c:withconfigset2 s:shard1 r:core_node2 
x:withconfigset2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.withconfigset2.shard1.replica_n1, tag=887056015
   [junit4]   2> 889060 INFO  (coreCloseExecutor-3620-thread-1) 
[n:127.0.0.1:54372_solr c:withconfigset2 s:shard1 r:core_node2 
x:withconfigset2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@18bc1dbc: rootName = null, 
domain = solr.core.withconfigset2.shard1.replica_n1, service url = null, agent 
id = null] for registry solr.core.withconfigset2.shard1.replica_n1 / 
com.codahale.metrics.MetricRegistry@62d866dc
   [junit4]   2> 889062 INFO  (jetty-closer-1388-thread-4) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54376_solr
   [junit4]   2> 889063 INFO  
(zkCallback-1409-thread-1-processing-n:127.0.0.1:54376_solr) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 889063 INFO  
(zkCallback-1408-thread-4-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 889063 INFO  
(zkCallback-1433-thread-2-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 889064 INFO  (jetty-closer-1388-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 889066 INFO  (jetty-closer-1388-thread-4) [    ] 
o.a.s.c.Overseer Overseer 
(id=99111001183092748-127.0.0.1:54376_solr-n_0000000000) closing
   [junit4]   2> 889066 INFO  
(OverseerStateUpdate-99111001183092748-127.0.0.1:54376_solr-n_0000000000) 
[n:127.0.0.1:54376_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:54376_solr
   [junit4]   2> 889067 WARN  
(OverseerAutoScalingTriggerThread-99111001183092748-127.0.0.1:54376_solr-n_0000000000)
 [n:127.0.0.1:54376_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 889069 INFO  (coreCloseExecutor-3620-thread-1) 
[n:127.0.0.1:54372_solr c:withconfigset2 s:shard1 r:core_node2 
x:withconfigset2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.withconfigset2.shard1.leader, 
tag=887056015
   [junit4]   2> 889071 INFO  
(zkCallback-1408-thread-4-processing-n:127.0.0.1:54372_solr) 
[n:127.0.0.1:54372_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:54372_solr
   [junit4]   2> 889072 INFO  (jetty-closer-1388-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@69b7d4f1{/solr,null,UNAVAILABLE}
   [junit4]   2> 889073 INFO  (jetty-closer-1388-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 889073 INFO  (jetty-closer-1388-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@13460dd9: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty / com.codahale.metrics.MetricRegistry@23c0da80
   [junit4]   2> 889074 INFO  
(zkCallback-1433-thread-2-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:54374_solr
   [junit4]   2> 889075 INFO  (jetty-closer-1388-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@650c6192{/solr,null,UNAVAILABLE}
   [junit4]   2> 889075 INFO  (jetty-closer-1388-thread-1) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54374_solr
   [junit4]   2> 889077 INFO  (jetty-closer-1388-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 889077 INFO  
(zkCallback-1433-thread-2-processing-n:127.0.0.1:54374_solr) 
[n:127.0.0.1:54374_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (0)
   [junit4]   2> 889079 INFO  (jetty-closer-1388-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2c435530{/solr,null,UNAVAILABLE}
   [junit4]   2> 889080 ERROR 
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 889081 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2AE4528A62B924E7]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:54370 54370
   [junit4]   2> 889082 INFO  (Thread-1581) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:54370 54370
   [junit4]   2> 889641 WARN  (Thread-1581) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        14      /solr/configs/conf
   [junit4]   2>        12      /solr/aliases.json
   [junit4]   2>        12      /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        26      /solr/collections/reloaded_collection/state.json
   [junit4]   2>        24      
/solr/collections/nodes_used_collection/state.json
   [junit4]   2>        15      
/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2>        14      
/solr/collections/halfdeletedcollection/state.json
   [junit4]   2>        12      /solr/clusterstate.json
   [junit4]   2>        5       /solr/collections/withconfigset2/state.json
   [junit4]   2>        5       /solr/collections/created_and_deleted/state.json
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        234     /solr/collections
   [junit4]   2>        12      /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_2AE4528A62B924E7-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{_version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 id=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=170, 
maxMBSortInHeap=7.975993396658326, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@311a9206),
 locale=el-GR, timezone=Africa/Harare
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 
(64-bit)/cpus=3,threads=1,free=355604480,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [GraphQueryTest, 
DeleteLastCustomShardedReplicaTest, OverseerStatusTest, ExecutePlanActionTest, 
TestPullReplicaErrorHandling, TestPayloadCheckQParserPlugin, 
TestComponentsName, BlockJoinFacetRandomTest, DocValuesNotIndexedTest, 
OverseerModifyCollectionTest, ConcurrentDeleteAndCreateCollectionTest, 
AtomicUpdateProcessorFactoryTest, SpellingQueryConverterTest, BufferStoreTest, 
TermsComponentTest, CoreMergeIndexesAdminHandlerTest, RollingRestartTest, 
BadComponentTest, UpdateRequestProcessorFactoryTest, TestCloudDeleteByQuery, 
TestXmlQParserPlugin, ConnectionManagerTest, VersionInfoTest, TestCustomSort, 
TestPartialUpdateDeduplication, BJQParserTest, TestOrdValues, 
TestTestInjection, TestFieldCollectionResource, 
TestFieldTypeCollectionResource, ActionThrottleTest, TestHashQParserPlugin, 
QueryEqualityTest, TestFastWriter, TestHalfAndHalfDocValues, 
TestNestedDocsSort, CdcrUpdateLogTest, V2StandaloneTest, TestReload, 
DistributedQueryComponentOptimizationTest, PeerSyncReplicationTest, 
SolrJmxReporterCloudTest, TestFilteredDocIdSet, TestLRUCache, 
DocumentBuilderTest, ShardRoutingCustomTest, TestSolrQueryParser, 
TestCloudSearcherWarming, MoveReplicaHDFSFailoverTest, TestConfigSets, 
TestCoreContainer, TestDistributedGrouping, TestUseDocValuesAsStored2, 
ChaosMonkeySafeLeaderTest, TestReplicaProperties, SolrShardReporterTest, 
ReplicationFactorTest, SampleTest, TestBulkSchemaConcurrent, 
TestBM25SimilarityFactory, SubstringBytesRefFilterTest, TestStandardQParsers, 
SolrCoreMetricManagerTest, HttpTriggerListenerTest, 
DistributedIntervalFacetingTest, TestBlendedInfixSuggestions, 
BasicAuthIntegrationTest, DOMUtilTest, CloudExitableDirectoryReaderTest, 
SuggestComponentTest, SharedFSAutoReplicaFailoverTest, TestSolrCoreSnapshots, 
TestDynamicFieldCollectionResource, TestSubQueryTransformerDistrib, 
TestDocumentBuilder, TestGroupingSearch, ParsingFieldUpdateProcessorsTest, 
TestWordDelimiterFilterFactory, TestCloudJSONFacetJoinDomain, TestTrie, 
DirectoryFactoryTest, TestPKIAuthenticationPlugin, DebugComponentTest, 
TestPivotHelperCode, TestPrepRecovery, ZkNodePropsTest, 
ManagedSchemaRoundRobinCloudTest, JsonLoaderTest, TolerantUpdateProcessorTest, 
SolrIndexConfigTest, TestReqParamsAPI, TestFieldCacheSort, 
TestManagedSchemaAPI, NodeLostTriggerTest, ImplicitSnitchTest, 
OpenExchangeRatesOrgProviderTest, HLLSerializationTest, AnalyticsQueryTest, 
RemoteQueryErrorTest, MBeansHandlerTest, TestRecoveryHdfs, 
TestFreeTextSuggestions, TestPointFields, TestDocBasedVersionConstraints, 
TestSolrCloudWithDelegationTokens, TestRemoteStreaming, 
TestSchemaSimilarityResource, PreAnalyzedFieldTest, JavabinLoaderTest, 
TestDocSet, LeaderFailureAfterFreshStartTest, SolrCoreTest, ZkStateReaderTest, 
TestRTimerTree, TestStressReorder, CollectionsAPIDistributedZkTest]
   [junit4] Completed [191/752 (1!)] on J1 in 85.38s, 19 tests, 1 error <<< 
FAILURES!

[...truncated 49182 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to