Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4104/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

6 tests failed.
FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
Failed to list contents of 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr

Stack Trace:
java.io.IOException: Failed to list contents of 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr
        at 
__randomizedtesting.SeedInfo.seed([9161079465C49241:1935384ECB38FFB9]:0)
        at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1426)
        at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1388)
        at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1268)
        at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1237)
        at 
org.apache.solr.BaseDistributedSearchTestCase.seedSolrHome(BaseDistributedSearchTestCase.java:1092)
        at 
org.apache.solr.BaseDistributedSearchTestCase.createServers(BaseDistributedSearchTestCase.java:337)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1009)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.TestDistributedGrouping

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.TestDistributedGrouping:   
  1) Thread[id=13993, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-TestDistributedGrouping]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=13994, 
name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-TestDistributedGrouping]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.TestDistributedGrouping: 
   1) Thread[id=13993, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-TestDistributedGrouping]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=13994, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-TestDistributedGrouping]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([9161079465C49241]:0)


FAILED:  
org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter

Error Message:
Collection not found: withShardField

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: withShardField
        at 
__randomizedtesting.SeedInfo.seed([9161079465C49241:C431EF06C93D5DB1]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1120)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:803)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:774)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
        at 
org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at 
org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter(CustomCollectionTest.java:141)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter

Error Message:
Collection not found: routeFieldColl

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: routeFieldColl
        at 
__randomizedtesting.SeedInfo.seed([9161079465C49241:39579949FAA5791B]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1120)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:803)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:774)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
        at 
org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at 
org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter(CustomCollectionTest.java:166)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI

Error Message:
Could not find collection : implicitcoll

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
        at 
__randomizedtesting.SeedInfo.seed([9161079465C49241:FB8089FF585E2439]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
        at 
org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
        at 
org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Could not find collection:collection2

Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
        at 
__randomizedtesting.SeedInfo.seed([9161079465C49241:1935384ECB38FFB9]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:909)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12102 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/init-core-data-001
   [junit4]   2> 1499104 WARN  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[9161079465C49241]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 1499104 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[9161079465C49241]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1499107 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[9161079465C49241]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
 w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1499107 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[9161079465C49241]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /z_c/gu
   [junit4]   2> 1499108 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1499108 INFO  (Thread-2726) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1499108 INFO  (Thread-2726) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1499111 ERROR (Thread-2726) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1499218 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:60059
   [junit4]   2> 1499274 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1499277 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1499281 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1499283 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1499286 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1499288 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1499290 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1499292 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1499295 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1499297 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1499299 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1499302 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly 
asked otherwise
   [junit4]   2> 1499693 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1499694 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5a86618a{/z_c/gu,null,AVAILABLE}
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@19a81d5b{HTTP/1.1,[http/1.1]}{127.0.0.1:60062}
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server Started @1505824ms
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/tempDir-001/control/data,
 hostContext=/z_c/gu, hostPort=60062, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/control-001/cores}
   [junit4]   2> 1499695 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.0.0
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1499695 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-25T12:54:10.197Z
   [junit4]   2> 1499698 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1499699 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/control-001/solr.xml
   [junit4]   2> 1499704 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1499706 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60059/solr
   [junit4]   2> 1499737 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1499737 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.OverseerElectionContext I am going to 
be the leader 127.0.0.1:60062_z_c%2Fgu
   [junit4]   2> 1499739 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.Overseer Overseer 
(id=98198831078572036-127.0.0.1:60062_z_c%2Fgu-n_0000000000) starting
   [junit4]   2> 1499748 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60062_z_c%2Fgu
   [junit4]   2> 1499750 INFO  
(zkCallback-2144-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (0) -> (1)
   [junit4]   2> 1499828 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1499831 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1499831 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1499832 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/control-001/cores
   [junit4]   2> 1499850 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1499852 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60059/solr ready
   [junit4]   2> 1499854 INFO  (qtp946399440-12906) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
pullReplicas=0&replicationFactor=1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:60062_z_c%252Fgu&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1499857 INFO  
(OverseerThreadFactory-6189-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CreateCollectionCmd Create collection 
control_collection
   [junit4]   2> 1499858 INFO  
(OverseerThreadFactory-6189-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CreateCollectionCmd Only one config 
set found in zk - using it:conf1
   [junit4]   2> 1499965 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1499965 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1500081 INFO  
(zkCallback-2144-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1500993 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1501002 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1501055 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1501077 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' 
using configuration from collection control_collection, trusted=true
   [junit4]   2> 1501077 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.control_collection.shard1.replica_n1' (registry 
'solr.core.control_collection.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1501077 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1501077 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore 
at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/control-001/cores/control_collection_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1501079 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=41, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=10.767578125, 
floorSegmentMB=1.4521484375, forceMergeDeletesPctAllowed=15.114334684109977, 
segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5880183796939019
   [junit4]   2> 1501081 WARN  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1501128 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1501128 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1501129 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1501129 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1501130 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=31, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=74.5361328125, 
floorSegmentMB=0.701171875, forceMergeDeletesPctAllowed=27.0737589533453, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1501130 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@79148be7[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1501132 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1501132 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1501133 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1501133 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1571181299378421760
   [junit4]   2> 1501134 INFO  
(searcherExecutor-6192-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu 
x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) 
[n:127.0.0.1:60062_z_c%2Fgu c:control_collection s:shard1  
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore 
[control_collection_shard1_replica_n1] Registered new searcher 
Searcher@79148be7[control_collection_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:60062/z_c/gu/control_collection_shard1_replica_n1/
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:60062/z_c/gu/control_collection_shard1_replica_n1/ has no 
replicas
   [junit4]   2> 1501141 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1501147 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:60062/z_c/gu/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1501261 INFO  
(zkCallback-2144-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1501317 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1501320 INFO  (qtp946399440-12908) [n:127.0.0.1:60062_z_c%2Fgu 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1355
   [junit4]   2> 1501324 INFO  (qtp946399440-12906) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at 
most 30 seconds. Check all shard replicas
   [junit4]   2> 1501432 INFO  
(zkCallback-2144-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1501861 INFO  
(OverseerCollectionConfigSetProcessor-98198831078572036-127.0.0.1:60062_z_c%2Fgu-n_0000000000)
 [n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1502333 INFO  (qtp946399440-12906) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={pullReplicas=0&replicationFactor=1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:60062_z_c%252Fgu&wt=javabin&version=2}
 status=0 QTime=2479
   [junit4]   2> 1502363 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1502364 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60059/solr ready
   [junit4]   2> 1502364 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1502365 INFO  (qtp946399440-12909) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
pullReplicas=0&replicationFactor=1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&tlogReplicas=0&createNodeSet=&stateFormat=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1502424 INFO  
(OverseerThreadFactory-6189-thread-2-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CreateCollectionCmd Create collection 
collection1
   [junit4]   2> 1502424 INFO  
(OverseerThreadFactory-6189-thread-2-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CreateCollectionCmd Only one config 
set found in zk - using it:conf1
   [junit4]   2> 1502425 WARN  
(OverseerThreadFactory-6189-thread-2-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.CreateCollectionCmd It is unusual to 
create a collection (collection1) without cores.
   [junit4]   2> 1502656 INFO  (qtp946399440-12909) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at 
most 30 seconds. Check all shard replicas
   [junit4]   2> 1502656 INFO  (qtp946399440-12909) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={pullReplicas=0&replicationFactor=1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&tlogReplicas=0&createNodeSet=&stateFormat=2&wt=javabin&version=2}
 status=0 QTime=291
   [junit4]   2> 1503056 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001
 of type NRT
   [junit4]   2> 1503057 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1503058 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@67526c39{/z_c/gu,null,AVAILABLE}
   [junit4]   2> 1503059 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@654a7a5f{HTTP/1.1,[http/1.1]}{127.0.0.1:60071}
   [junit4]   2> 1503059 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server Started @1509188ms
   [junit4]   2> 1503059 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/tempDir-001/jetty1,
 solrconfig=solrconfig.xml, hostContext=/z_c/gu, hostPort=60071, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001/cores}
   [junit4]   2> 1503059 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1503059 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.0.0
   [junit4]   2> 1503060 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1503060 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1503060 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-25T12:54:13.562Z
   [junit4]   2> 1503065 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1503065 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001/solr.xml
   [junit4]   2> 1503072 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1503081 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60059/solr
   [junit4]   2> 1503107 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (0) -> (1)
   [junit4]   2> 1503116 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1503119 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60071_z_c%2Fgu
   [junit4]   2> 1503122 INFO  (zkCallback-2151-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1503122 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (1) -> (2)
   [junit4]   2> 1503122 INFO  
(zkCallback-2144-thread-1-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (1) -> (2)
   [junit4]   2> 1503227 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1503230 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1503230 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1503232 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001/cores
   [junit4]   2> 1503253 INFO  (qtp946399440-12911) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with 
params 
node=127.0.0.1:60071_z_c%252Fgu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1503257 INFO  
(OverseerThreadFactory-6189-thread-3-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.AddReplicaCmd addReplica() : {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "node":"127.0.0.1:60071_z_c%2Fgu",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"addreplica"}
   [junit4]   2> 1503258 INFO  
(OverseerCollectionConfigSetProcessor-98198831078572036-127.0.0.1:60062_z_c%2Fgu-n_0000000000)
 [n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1503259 INFO  
(OverseerThreadFactory-6189-thread-3-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.AddReplicaCmd Node Identified 
127.0.0.1:60071_z_c%2Fgu for creating new replica
   [junit4]   2> 1503263 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu  
  ] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1503263 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu  
  ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1503388 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1504381 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1504404 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema 
[collection1_shard2_replica_n0] Schema name=test
   [junit4]   2> 1504598 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1504650 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1_shard2_replica_n0' using configuration from 
collection collection1, trusted=true
   [junit4]   2> 1504651 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard2.replica_n0' (registry 
'solr.core.collection1.shard2.replica_n0') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1504651 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1504651 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SolrCore 
[[collection1_shard2_replica_n0] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001/cores/collection1_shard2_replica_n0],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-1-001/cores/collection1_shard2_replica_n0/data/]
   [junit4]   2> 1504654 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=41, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=10.767578125, 
floorSegmentMB=1.4521484375, forceMergeDeletesPctAllowed=15.114334684109977, 
segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5880183796939019
   [junit4]   2> 1504677 WARN  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1504788 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1504788 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1504790 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 1504790 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 1504791 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=31, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=74.5361328125, 
floorSegmentMB=0.701171875, forceMergeDeletesPctAllowed=27.0737589533453, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1504792 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7109240f[collection1_shard2_replica_n0] main]
   [junit4]   2> 1504793 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1504794 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1504794 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1504794 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1571181303217258496
   [junit4]   2> 1504795 INFO  
(searcherExecutor-6203-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu 
x:collection1_shard2_replica_n0 s:shard2 c:collection1) 
[n:127.0.0.1:60071_z_c%2Fgu c:collection1 s:shard2  
x:collection1_shard2_replica_n0] o.a.s.c.SolrCore 
[collection1_shard2_replica_n0] Registered new searcher 
Searcher@7109240f[collection1_shard2_replica_n0] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1504802 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1504803 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1504803 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:60071/z_c/gu/collection1_shard2_replica_n0/
   [junit4]   2> 1504803 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 1504803 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy 
http://127.0.0.1:60071/z_c/gu/collection1_shard2_replica_n0/ has no replicas
   [junit4]   2> 1504803 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1504827 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:60071/z_c/gu/collection1_shard2_replica_n0/ shard2
   [junit4]   2> 1504932 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1504959 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 1504962 INFO  (qtp41651769-12947) [n:127.0.0.1:60071_z_c%2Fgu 
c:collection1 s:shard2  x:collection1_shard2_replica_n0] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1699
   [junit4]   2> 1504977 INFO  (qtp946399440-12911) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:60071_z_c%252Fgu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
 status=0 QTime=1723
   [junit4]   2> 1505084 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1505272 INFO  
(OverseerCollectionConfigSetProcessor-98198831078572036-127.0.0.1:60062_z_c%2Fgu-n_0000000000)
 [n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1505712 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001
 of type NRT
   [junit4]   2> 1505712 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1505714 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@765ed23c{/z_c/gu,null,AVAILABLE}
   [junit4]   2> 1505715 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7244205{HTTP/1.1,[http/1.1]}{127.0.0.1:60077}
   [junit4]   2> 1505715 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server Started @1511844ms
   [junit4]   2> 1505715 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/tempDir-001/jetty2,
 solrconfig=solrconfig.xml, hostContext=/z_c/gu, hostPort=60077, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001/cores}
   [junit4]   2> 1505715 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1505716 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.0.0
   [junit4]   2> 1505716 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1505716 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1505716 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-25T12:54:16.218Z
   [junit4]   2> 1505721 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1505721 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001/solr.xml
   [junit4]   2> 1505728 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1505733 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60059/solr
   [junit4]   2> 1505750 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (0) -> (2)
   [junit4]   2> 1505755 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1505765 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60077_z_c%2Fgu
   [junit4]   2> 1505768 INFO  
(zkCallback-2162-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (2) -> (3)
   [junit4]   2> 1505768 INFO  (zkCallback-2151-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1505768 INFO  
(zkCallback-2144-thread-2-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (2) -> (3)
   [junit4]   2> 1505768 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (2) -> (3)
   [junit4]   2> 1506105 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1506116 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1506116 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1506118 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001/cores
   [junit4]   2> 1506204 INFO  (qtp946399440-12904) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with 
params 
node=127.0.0.1:60077_z_c%252Fgu&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1506233 INFO  
(OverseerThreadFactory-6189-thread-4-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.AddReplicaCmd addReplica() : {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "node":"127.0.0.1:60077_z_c%2Fgu",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"addreplica"}
   [junit4]   2> 1506235 INFO  
(OverseerThreadFactory-6189-thread-4-processing-n:127.0.0.1:60062_z_c%2Fgu) 
[n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.AddReplicaCmd Node Identified 
127.0.0.1:60077_z_c%2Fgu for creating new replica
   [junit4]   2> 1506240 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
   ] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1506241 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
   ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1506354 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1506354 INFO  
(zkCallback-2162-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1507303 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1507318 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema 
[collection1_shard3_replica_n0] Schema name=test
   [junit4]   2> 1507451 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1507490 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1_shard3_replica_n0' using configuration from 
collection collection1, trusted=true
   [junit4]   2> 1507491 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard3.replica_n0' (registry 
'solr.core.collection1.shard3.replica_n0') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b
   [junit4]   2> 1507491 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1507491 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SolrCore 
[[collection1_shard3_replica_n0] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001/cores/collection1_shard3_replica_n0],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-2-001/cores/collection1_shard3_replica_n0/data/]
   [junit4]   2> 1507493 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=41, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=10.767578125, 
floorSegmentMB=1.4521484375, forceMergeDeletesPctAllowed=15.114334684109977, 
segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5880183796939019
   [junit4]   2> 1507498 WARN  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1507619 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1507619 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1507622 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 1507622 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 1507623 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=31, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=74.5361328125, 
floorSegmentMB=0.701171875, forceMergeDeletesPctAllowed=27.0737589533453, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1507623 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@85a493[collection1_shard3_replica_n0] main]
   [junit4]   2> 1507625 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1507625 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1507626 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1507627 INFO  
(searcherExecutor-6214-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu 
x:collection1_shard3_replica_n0 s:shard3 c:collection1) 
[n:127.0.0.1:60077_z_c%2Fgu c:collection1 s:shard3  
x:collection1_shard3_replica_n0] o.a.s.c.SolrCore 
[collection1_shard3_replica_n0] Registered new searcher 
Searcher@85a493[collection1_shard3_replica_n0] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1507631 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1571181306192068608
   [junit4]   2> 1507639 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1507639 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1507640 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:60077/z_c/gu/collection1_shard3_replica_n0/
   [junit4]   2> 1507640 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 1507640 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy 
http://127.0.0.1:60077/z_c/gu/collection1_shard3_replica_n0/ has no replicas
   [junit4]   2> 1507640 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1507656 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:60077/z_c/gu/collection1_shard3_replica_n0/ shard3
   [junit4]   2> 1507761 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1507761 INFO  
(zkCallback-2162-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1507766 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 1507769 INFO  (qtp771596896-12977) [n:127.0.0.1:60077_z_c%2Fgu 
c:collection1 s:shard3  x:collection1_shard3_replica_n0] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1529
   [junit4]   2> 1507773 INFO  (qtp946399440-12904) [n:127.0.0.1:60062_z_c%2Fgu 
   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:60077_z_c%252Fgu&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2}
 status=0 QTime=1569
   [junit4]   2> 1507873 INFO  
(zkCallback-2162-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1507873 INFO  
(zkCallback-2156-thread-1-processing-n:127.0.0.1:60071_z_c%2Fgu) 
[n:127.0.0.1:60071_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader A cluster state 
change: [WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1508242 INFO  
(OverseerCollectionConfigSetProcessor-98198831078572036-127.0.0.1:60062_z_c%2Fgu-n_0000000000)
 [n:127.0.0.1:60062_z_c%2Fgu    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1509110 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-3-001
 of type NRT
   [junit4]   2> 1509110 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1509112 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@742aa05f{/z_c/gu,null,AVAILABLE}
   [junit4]   2> 1509112 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@ef9759c{HTTP/1.1,[http/1.1]}{127.0.0.1:60093}
   [junit4]   2> 1509112 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.e.j.s.Server Started @1515242ms
   [junit4]   2> 1509112 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/tempDir-001/jetty3,
 replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/z_c/gu, 
hostPort=60093, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-3-001/cores}
   [junit4]   2> 1509113 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1509114 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.0.0
   [junit4]   2> 1509114 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1509114 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1509114 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-25T12:54:19.616Z
   [junit4]   2> 1509118 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1509118 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_9161079465C49241-001/shard-3-001/solr.xml
   [junit4]   2> 1509125 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@483e594b, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1509135 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60059/solr
   [junit4]   2> 1509184 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60093_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (0) -> (3)
   [junit4]   2> 1509207 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60093_z_c%2Fgu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1509211 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[9161079465C49241]) 
[n:127.0.0.1:60093_z_c%2Fgu    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60093_z_c%2Fgu
   [junit4]   2> 1509218 INFO  
(zkCallback-2162-thread-1-processing-n:127.0.0.1:60077_z_c%2Fgu) 
[n:127.0.0.1:60077_z_c%2Fgu    ] o.a.s.c.c.ZkStateReader Updated live nodes 
from ZooKeeper... (3) -> (4)
   [junit4]   2> 1509219 INFO  (zkCallback-2151-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1509219 INFO  (zkCallback-2156-thread

[...truncated too long message...]

c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 2051124 INFO  
(zkCallback-2747-thread-2-processing-n:127.0.0.1:61347_solr) 
[n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 2051131 INFO  (coreCloseExecutor-8225-thread-1) 
[n:127.0.0.1:61347_solr c:testCreateShardRepFactor s:a r:core_node2 
x:testCreateShardRepFactor_a_replica_n1] o.a.s.m.SolrMetricManager Closing 
metric reporters for 
registry=solr.collection.testCreateShardRepFactor.a.leader, tag=657546339
   [junit4]   2> 2051131 INFO  (coreCloseExecutor-8226-thread-1) 
[n:127.0.0.1:61346_solr c:testCreateShardRepFactor s:x r:core_node3 
x:testCreateShardRepFactor_x_replica_n1] o.a.s.m.SolrMetricManager Closing 
metric reporters for 
registry=solr.collection.testCreateShardRepFactor.x.leader, tag=1922155456
   [junit4]   2> 2051133 WARN  
(zkCallback-2747-thread-2-processing-n:127.0.0.1:61347_solr) 
[n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2051134 INFO  (jetty-closer-2726-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@33ab3e9a{/solr,null,UNAVAILABLE}
   [junit4]   2> 2052643 WARN  
(zkCallback-2741-thread-2-processing-n:127.0.0.1:61346_solr) 
[n:127.0.0.1:61346_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2052644 INFO  (jetty-closer-2726-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1ff905b8{/solr,null,UNAVAILABLE}
   [junit4]   2> 2052645 ERROR 
(SUITE-CustomCollectionTest-seed#[9161079465C49241]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2052646 INFO  
(SUITE-CustomCollectionTest-seed#[9161079465C49241]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:61342 61342
   [junit4]   2> 2052660 INFO  (Thread-3753) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:61342 61342
   [junit4]   2> 2052831 WARN  (Thread-3753) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        9       /solr/clusterprops.json
   [junit4]   2>        9       /solr/aliases.json
   [junit4]   2>        5       /solr/collections/routeFieldColl/state.json
   [junit4]   2>        4       /solr/security.json
   [junit4]   2>        4       /solr/configs/conf
   [junit4]   2>        4       /solr/collections/implicitcoll/state.json
   [junit4]   2>        4       /solr/collections/withShardField/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        23      
/solr/collections/testCreateShardRepFactor/state.json
   [junit4]   2>        20      /solr/collections/withShardField/state.json
   [junit4]   2>        14      /solr/collections/routeFieldColl/state.json
   [junit4]   2>        12      /solr/collections/implicitcoll/state.json
   [junit4]   2>        9       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        25      /solr/collections
   [junit4]   2>        9       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_9161079465C49241-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=714, maxMBSortInHeap=7.436954241471874, 
sim=RandomSimilarity(queryNorm=false): {}, locale=fr, timezone=GB
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_131 
(64-bit)/cpus=3,threads=1,free=118496488,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestBinaryResponseWriter, 
TestComponentsName, AnalysisErrorHandlingTest, TestFastWriter, 
TestUseDocValuesAsStored2, TestLMJelinekMercerSimilarityFactory, 
TestMultiValuedNumericRangeQuery, ConfigSetsAPITest, TestApiFramework, 
TestExtendedDismaxParser, ForceLeaderTest, TestTlogReplica, 
TestSolrIndexConfig, HdfsDirectoryTest, TestUninvertingReader, 
HdfsThreadLeakTest, TestMissingGroups, HLLUtilTest, NoCacheHeaderTest, 
TestCloudPseudoReturnFields, TestClusterProperties, 
TestSolrCloudWithSecureImpersonation, RulesTest, 
TestEmbeddedSolrServerSchemaAPI, TestSmileRequest, TestAddFieldRealTimeGet, 
SolrMetricsIntegrationTest, TestFileDictionaryLookup, 
RecoveryAfterSoftCommitTest, HdfsChaosMonkeyNothingIsSafeTest, 
TestStressReorder, SliceStateTest, SystemInfoHandlerTest, 
HdfsCollectionsAPIDistributedZkTest, CoreAdminHandlerTest, 
OutOfBoxZkACLAndCredentialsProvidersTest, HighlighterMaxOffsetTest, 
TestNestedDocsSort, TestConfig, TestImpersonationWithHadoopAuth, TestFaceting, 
TestJsonFacets, IgnoreCommitOptimizeUpdateProcessorFactoryTest, 
DocumentBuilderTest, DistributedSpellCheckComponentTest, 
CollectionTooManyReplicasTest, TestHdfsBackupRestoreCore, TestRebalanceLeaders, 
TestInPlaceUpdatesDistrib, BigEndianAscendingWordDeserializerTest, 
DeleteShardTest, PKIAuthenticationIntegrationTest, TestStandardQParsers, 
DirectUpdateHandlerTest, TestDownShardTolerantSearch, 
DistribJoinFromCollectionTest, TestImplicitCoreProperties, TestLazyCores, 
TestCustomStream, TestSolrCoreParser, TestPseudoReturnFields, SolrInfoBeanTest, 
TestConfigsApi, TestFieldCacheReopen, HighlighterTest, TestGroupingSearch, 
SolrCoreTest, DistributedSuggestComponentTest, 
TestLegacyNumericRangeQueryBuilder, TestAnalyzeInfixSuggestions, 
ClusterStateUpdateTest, SolrGraphiteReporterTest, ReturnFieldsTest, 
JSONWriterTest, AliasIntegrationTest, HdfsRestartWhileUpdatingTest, 
TestFieldCollectionResource, TestPKIAuthenticationPlugin, 
AnalysisAfterCoreReloadTest, TestHashQParserPlugin, CollectionReloadTest, 
TestFieldCacheSortRandom, TestRequestForwarding, AnalyticsQueryTest, 
TestSchemaSimilarityResource, TestShortCircuitedRequests, TestNoOpRegenerator, 
TestHashPartitioner, JsonLoaderTest, ResponseLogComponentTest, 
TestCloudDeleteByQuery, TestConfigSetImmutable, TermsComponentTest, 
TestManagedResource, HttpSolrCallGetCoreTest, FullHLLTest, 
TestFilteredDocIdSet, HdfsDirectoryFactoryTest, SolrMetricManagerTest, 
FieldAnalysisRequestHandlerTest, TestReqParamsAPI, 
TriLevelCompositeIdRoutingTest, TestHdfsCloudBackupRestore, 
CloneFieldUpdateProcessorFactoryTest, TestUpdate, TestRandomDVFaceting, 
TestLocalFSCloudBackupRestore, TestPullReplica, 
ClassificationUpdateProcessorIntegrationTest, DistributedFacetPivotSmallTest, 
TestNumericTerms32, TestManagedSynonymGraphFilterFactory, 
TestMiniSolrCloudClusterSSL, InfoHandlerTest, TestFuzzyAnalyzedSuggestions, 
TestSolrCloudWithDelegationTokens, DeleteNodeTest, MetricUtilsTest, 
TestAtomicUpdateErrorCases, BooleanFieldTest, DistanceFunctionTest, 
TestSimpleTextCodec, MissingSegmentRecoveryTest, ChaosMonkeyNothingIsSafeTest, 
TestDFRSimilarityFactory, DistributedQueryComponentCustomSortTest, 
SortByFunctionTest, URLClassifyProcessorTest, CdcrBootstrapTest, 
TestMiniSolrCloudCluster, TestChildDocTransformer, TestXmlQParserPlugin, 
PrimUtilsTest, CdcrReplicationHandlerTest, 
TestTolerantUpdateProcessorRandomCloud, MultiThreadedOCPTest, 
TolerantUpdateProcessorTest, AtomicUpdatesTest, SolrXmlInZkTest, 
XsltUpdateRequestHandlerTest, TestLeaderElectionZkExpiry, TestPushWriter, 
TestSolrXml, TestClassNameShortening, SoftAutoCommitTest, 
TestQueryWrapperFilter, CircularListTest, LargeFieldTest, TestDocumentBuilder, 
DistribCursorPagingTest, TestBlobHandler, DirectoryFactoryTest, BitVectorTest, 
TestLRUCache, TestHighFrequencyDictionaryFactory, SimpleFacetsTest, 
PreAnalyzedUpdateProcessorTest, PrimitiveFieldTypeTest, TestStressRecovery, 
TestConfigSetsAPI, TestRecoveryHdfs, TestSolrCoreSnapshots, 
CdcrVersionReplicationTest, WrapperMergePolicyFactoryTest, 
TestSolrCLIRunExample, SolrSlf4jReporterTest, TestSerializedLuceneMatchVersion, 
ShardRoutingTest, TestDocSet, SuggesterWFSTTest, TestHttpShardHandlerFactory, 
StressHdfsTest, TestNumericRangeQuery64, HdfsRecoverLeaseTest, 
SharedFSAutoReplicaFailoverUtilsTest, PeerSyncTest, 
TestCloudJSONFacetJoinDomain, TestReplicationHandler, TestDistributedSearch, 
TermVectorComponentDistributedTest, TestStressVersions, HardAutoCommitTest, 
TestCoreContainer, TestSolr4Spatial, BadIndexSchemaTest, TestSort, 
BasicFunctionalityTest, ShowFileRequestHandlerTest, 
DistributedQueryElevationComponentTest, SuggesterTest, TestStressLucene, 
TestTrie, SpatialFilterTest, WordBreakSolrSpellCheckerTest, 
TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, 
DefaultValueUpdateProcessorTest, CacheHeaderTest, TestSurroundQueryParser, 
DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, 
DocumentAnalysisRequestHandlerTest, TestOmitPositions, 
XmlUpdateRequestHandlerTest, TestIndexingPerformance, MoreLikeThisHandlerTest, 
LoggingHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, 
TestCollationField, UpdateRequestProcessorFactoryTest, QueryParsingTest, 
TestAnalyzedSuggestions, PingRequestHandlerTest, HighlighterConfigTest, 
SOLR749Test, TestQuerySenderListener, UpdateParamsTest, TestQuerySenderNoQuery, 
CopyFieldTest, BadComponentTest, TestSolrDeletionPolicy2, MultiTermTest, 
TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, 
ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, 
TestPhraseSuggestions, TestCodecSupport, TestIBSimilarityFactory, 
TimeZoneUtilsTest, OpenExchangeRatesOrgProviderTest, DateMathParserTest, 
TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, 
ClusterStateTest, ZkNodePropsTest, DistributedMLTComponentTest, 
DistributedIntervalFacetingTest, CdcrRequestHandlerTest, 
ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConnectionManagerTest, 
CreateCollectionCleanupTest, CustomCollectionTest]
   [junit4] Completed [518/723 (3!)] on J0 in 116.99s, 4 tests, 3 errors <<< 
FAILURES!

[...truncated 43931 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to