Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/263/

10 tests failed.
FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries

Error Message:
Timeout while trying to assert number of documents @ target_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ 
target_collection
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:34D3E9493CAF1BB]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries(CdcrReplicationDistributedZkTest.java:563)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<128> but was:<71>
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
        ... 42 more


FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget

Error Message:
Timeout while trying to assert number of documents @ target_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ 
target_collection
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:8100755B3A37F519]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:595)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<50> but was:<20>
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
        ... 42 more


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:9582BB401C68904D]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk(CollectionsAPIDistributedZkTest.java:184)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore

Error Message:
{responseHeader={status=0,QTime=37097},failure={127.0.0.1:39865_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://127.0.0.1:39865/solr: Core with name 
'halfcollection_shard1_replica1' already 
exists.,127.0.0.1:34634_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://127.0.0.1:34634/solr: Error CREATEing SolrCore 
'halfcollection_shard2_replica1': Unable to create core 
[halfcollection_shard2_replica1] Caused by: Direct buffer memory}}

Stack Trace:
java.lang.AssertionError: 
{responseHeader={status=0,QTime=37097},failure={127.0.0.1:39865_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://127.0.0.1:39865/solr: Core with name 
'halfcollection_shard1_replica1' already 
exists.,127.0.0.1:34634_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://127.0.0.1:34634/solr: Error CREATEing SolrCore 
'halfcollection_shard2_replica1': Unable to create core 
[halfcollection_shard2_replica1] Caused by: Direct buffer memory}}
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:CDA44A7511F28DB8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore(CollectionsAPIDistributedZkTest.java:308)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCreationAndDeletion

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:13664611E17A63FD]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreationAndDeletion(CollectionsAPIDistributedZkTest.java:111)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.test

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:A936D81B44925DA4]:0)
        at 
org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1251)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:697)
        at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:122)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:BE28B245DB41094]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:165)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.addReplicaTest

Error Message:
Could not find collection : addReplicaColl

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : addReplicaColl
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:B2C2B0E764667B8D]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
        at 
org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:666)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:A936D81B44925DA4]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Expected to see collection awhollynewcollection_0 null Last available state: 
DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/12)={
   "replicationFactor":"3",   "shards":{     "shard1":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{}},     
"shard2":{       "range":"c0000000-ffffffff",       "state":"active",       
"replicas":{}},     "shard3":{       "range":"0-3fffffff",       
"state":"active",       "replicas":{}},     "shard4":{       
"range":"40000000-7fffffff",       "state":"active",       "replicas":{}}},   
"router":{"name":"compositeId"},   "maxShardsPerNode":"4",   
"autoAddReplicas":"false"}

Stack Trace:
java.lang.AssertionError: Expected to see collection awhollynewcollection_0
null
Last available state: 
DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/12)={
  "replicationFactor":"3",
  "shards":{
    "shard1":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{}},
    "shard2":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{}},
    "shard3":{
      "range":"0-3fffffff",
      "state":"active",
      "replicas":{}},
    "shard4":{
      "range":"40000000-7fffffff",
      "state":"active",
      "replicas":{}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"4",
  "autoAddReplicas":"false"}
        at 
__randomizedtesting.SeedInfo.seed([2162E7C1EA6E305C:69179375EC5D1FC9]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:496)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12130 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/init-core-data-001
   [junit4]   2> 1976387 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1976402 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /p_/s
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1976530 WARN  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1976554 WARN  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1976566 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 1976601 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_52990_hdfs____vdpkal/webapp
   [junit4]   2> 1977264 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52990
   [junit4]   2> 1977682 WARN  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1977683 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 1977692 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_44093_datanode____vme65t/webapp
   [junit4]   2> 1978195 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44093
   [junit4]   2> 1978307 WARN  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1978308 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 1978319 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_33457_datanode____.am4ckj/webapp
   [junit4]   2> 1978521 INFO  (IPC Server handler 2 on 38990) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-ee42715c-6336-4e1e-9d0f-053f2f1b9360 node 
DatanodeRegistration(127.0.0.1:58759, 
datanodeUuid=31179b6f-f069-4473-aef7-dc384947145e, infoPort=54079, 
infoSecurePort=0, ipcPort=37923, 
storageInfo=lv=-56;cid=testClusterID;nsid=199244216;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 1978521 INFO  (IPC Server handler 2 on 38990) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-32ca770d-7ff3-45ee-a2b2-e8eb4aeca15b node 
DatanodeRegistration(127.0.0.1:58759, 
datanodeUuid=31179b6f-f069-4473-aef7-dc384947145e, infoPort=54079, 
infoSecurePort=0, ipcPort=37923, 
storageInfo=lv=-56;cid=testClusterID;nsid=199244216;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 1 msecs
   [junit4]   2> 1978989 INFO  
(SUITE-HdfsWriteToMultipleCollectionsTest-seed#[2162E7C1EA6E305C]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33457
   [junit4]   2> 1979156 INFO  (IPC Server handler 6 on 38990) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-23b6ce4d-542d-457a-8368-a2839030a253 node 
DatanodeRegistration(127.0.0.1:58016, 
datanodeUuid=996e40cd-71ba-4f1d-ac9c-da0e7ec83b8b, infoPort=36848, 
infoSecurePort=0, ipcPort=60525, 
storageInfo=lv=-56;cid=testClusterID;nsid=199244216;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 4 msecs
   [junit4]   2> 1979156 INFO  (IPC Server handler 6 on 38990) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-5dc4ed00-9017-4bde-bcd1-1927e785dc97 node 
DatanodeRegistration(127.0.0.1:58016, 
datanodeUuid=996e40cd-71ba-4f1d-ac9c-da0e7ec83b8b, infoPort=36848, 
infoSecurePort=0, ipcPort=60525, 
storageInfo=lv=-56;cid=testClusterID;nsid=199244216;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 1979196 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1979196 INFO  (Thread-3906) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1979196 INFO  (Thread-3906) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1979296 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:35484
   [junit4]   2> 1979314 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1979316 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1979317 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1979318 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1979319 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1979320 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1979321 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1979321 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1979322 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1979323 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1979324 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1979394 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/control-001/cores/collection1
   [junit4]   2> 1979395 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1979396 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4bd09337{/p_/s,null,AVAILABLE}
   [junit4]   2> 1979396 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3b0f1121{HTTP/1.1,[http/1.1]}{127.0.0.1:59795}
   [junit4]   2> 1979396 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.Server Started @1982904ms
   [junit4]   2> 1979396 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:38990/hdfs__localhost_38990__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001_tempDir-002_control_data,
 hostContext=/p_/s, hostPort=59795, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/control-001/cores}
   [junit4]   2> 1979397 ERROR 
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1979397 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
6.5.0
   [junit4]   2> 1979397 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1979397 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1979397 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-01-22T02:27:34.849Z
   [junit4]   2> 1979412 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1979412 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/control-001/solr.xml
   [junit4]   2> 1979417 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1979418 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35484/solr
   [junit4]   2> 1979434 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:59795_p_%2Fs
   [junit4]   2> 1979435 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.Overseer Overseer 
(id=97324371453476868-127.0.0.1:59795_p_%2Fs-n_0000000000) starting
   [junit4]   2> 1979446 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59795_p_%2Fs
   [junit4]   2> 1979447 INFO  
(zkCallback-2055-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1979487 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/control-001/cores
   [junit4]   2> 1979488 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.CorePropertiesLocator Cores are: 
[collection1]
   [junit4]   2> 1979504 INFO  
(OverseerStateUpdate-97324371453476868-127.0.0.1:59795_p_%2Fs-n_0000000000) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 1979552 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 1979634 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1979695 WARN  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 1979700 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1979744 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 1979759 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:38990/solr_hdfs_home
   [junit4]   2> 1979759 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1979759 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:38990/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 1979759 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f0d00a8
   [junit4]   2> 1979760 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
   [junit4]   2> 1979801 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 1979801 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1979801 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1979829 WARN  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds 
and try again.
   [junit4]   2> 1984831 WARN  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds 
and try again.
   [junit4]   2> 1989983 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1989985 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 1990071 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 1990094 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 1990094 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1990095 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1990195 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1990197 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=11, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=2.5546875, 
floorSegmentMB=0.7119140625, forceMergeDeletesPctAllowed=1.9709547653785742, 
segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1990283 INFO  (IPC Server handler 3 on 38990) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58759 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-23b6ce4d-542d-457a-8368-a2839030a253:NORMAL:127.0.0.1:58016|RBW],
 
ReplicaUC[[DISK]DS-ee42715c-6336-4e1e-9d0f-053f2f1b9360:NORMAL:127.0.0.1:58759|FINALIZED]]}
 size 0
   [junit4]   2> 1990287 INFO  (IPC Server handler 4 on 38990) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58016 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-23b6ce4d-542d-457a-8368-a2839030a253:NORMAL:127.0.0.1:58016|RBW],
 
ReplicaUC[[DISK]DS-ee42715c-6336-4e1e-9d0f-053f2f1b9360:NORMAL:127.0.0.1:58759|FINALIZED]]}
 size 0
   [junit4]   2> 1990322 WARN  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1990373 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1990373 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1990373 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 1990412 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1990412 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1990421 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=21, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=90.771484375, 
floorSegmentMB=1.1962890625, forceMergeDeletesPctAllowed=0.35056576924969773, 
segmentsPerTier=15.0, maxCFSSegmentSizeMB=1.890625, noCFSRatio=0.0
   [junit4]   2> 1990453 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@2792af5e[collection1] main]
   [junit4]   2> 1990454 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1990455 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1990466 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1990468 INFO  
(searcherExecutor-4730-thread-1-processing-n:127.0.0.1:59795_p_%2Fs 
x:collection1 c:control_collection) [n:127.0.0.1:59795_p_%2Fs 
c:control_collection   x:collection1] o.a.s.c.SolrCore [collection1] Registered 
new searcher Searcher@2792af5e[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1990473 INFO  
(coreLoadExecutor-4729-thread-1-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs c:control_collection   x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1557189955079372800
   [junit4]   2> 1990513 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas 
found to continue.
   [junit4]   2> 1990513 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new 
leader - try and sync
   [junit4]   2> 1990513 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:59795/p_/s/collection1/
   [junit4]   2> 1990513 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync 
replicas to me
   [junit4]   2> 1990513 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:59795/p_/s/collection1/ has no replicas
   [junit4]   2> 1990541 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new 
leader: http://127.0.0.1:59795/p_/s/collection1/ shard1
   [junit4]   2> 1990692 INFO  
(coreZkRegister-4722-thread-1-processing-n:127.0.0.1:59795_p_%2Fs x:collection1 
c:control_collection) [n:127.0.0.1:59795_p_%2Fs c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery 
necessary
   [junit4]   2> 1990860 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1990860 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35484/solr ready
   [junit4]   2> 1990860 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1990860 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1990938 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001/cores/collection1
   [junit4]   2> 1990939 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001
   [junit4]   2> 1990939 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1990940 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5590f54f{/p_/s,null,AVAILABLE}
   [junit4]   2> 1990940 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@661be3eb{HTTP/1.1,[http/1.1]}{127.0.0.1:45604}
   [junit4]   2> 1990940 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.e.j.s.Server Started @1994448ms
   [junit4]   2> 1990940 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:38990/hdfs__localhost_38990__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/p_/s, hostPort=45604, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001/cores}
   [junit4]   2> 1990941 ERROR 
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1990942 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
6.5.0
   [junit4]   2> 1990942 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1990942 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1990942 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-01-22T02:27:46.394Z
   [junit4]   2> 1990956 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1990956 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001/solr.xml
   [junit4]   2> 1990962 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1990962 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35484/solr
   [junit4]   2> 1990969 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1990972 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45604_p_%2Fs
   [junit4]   2> 1990978 INFO  
(zkCallback-2055-thread-4-processing-n:127.0.0.1:59795_p_%2Fs) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1991013 INFO  
(zkCallback-2065-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1991031 INFO  (zkCallback-2059-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1991046 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001/cores
   [junit4]   2> 1991046 INFO  
(TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[2162E7C1EA6E305C]) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.CorePropertiesLocator Cores are: 
[collection1]
   [junit4]   2> 1991063 INFO  
(OverseerStateUpdate-97324371453476868-127.0.0.1:59795_p_%2Fs-n_0000000000) 
[n:127.0.0.1:59795_p_%2Fs    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 1991165 INFO  
(zkCallback-2065-thread-2-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1992074 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 1992101 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 1992298 WARN  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.s.IndexSchema 
[collection1] default search field in schema is text. WARNING: Deprecated, 
please use 'df' on request instead.
   [junit4]   2> 1992304 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1992331 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1992332 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:38990/solr_hdfs_home
   [junit4]   2> 1992335 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1992335 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.c.SolrCore 
[[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_2162E7C1EA6E305C-001/shard-1-001/cores/collection1],
 dataDir=[hdfs://localhost:38990/solr_hdfs_home/collection1/core_node1/data/]
   [junit4]   2> 1992335 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f0d00a8
   [junit4]   2> 1992336 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
   [junit4]   2> 1992401 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 1992401 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1992401 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1992474 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1992478 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/collection1/core_node1/data
   [junit4]   2> 1992532 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:38990/solr_hdfs_home/collection1/core_node1/data/index
   [junit4]   2> 1992539 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 1992539 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1992539 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 1992578 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1992579 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=11, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=2.5546875, 
floorSegmentMB=0.7119140625, forceMergeDeletesPctAllowed=1.9709547653785742, 
segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1992958 INFO  (IPC Server handler 8 on 38990) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58016 is 
added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-ee42715c-6336-4e1e-9d0f-053f2f1b9360:NORMAL:127.0.0.1:58759|RBW],
 
ReplicaUC[[DISK]DS-5dc4ed00-9017-4bde-bcd1-1927e785dc97:NORMAL:127.0.0.1:58016|FINALIZED]]}
 size 0
   [junit4]   2> 1992963 INFO  (IPC Server handler 5 on 38990) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58759 is 
added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-5dc4ed00-9017-4bde-bcd1-1927e785dc97:NORMAL:127.0.0.1:58016|FINALIZED],
 
ReplicaUC[[DISK]DS-32ca770d-7ff3-45ee-a2b2-e8eb4aeca15b:NORMAL:127.0.0.1:58759|FINALIZED]]}
 size 0
   [junit4]   2> 1992983 WARN  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1993018 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1993018 INFO  
(coreLoadExecutor-4740-thread-1-processing-n:127.0.0.1:45604_p_%2Fs) 
[n:127.0.0.1:45604_p_%2Fs c:collection1   x:collection1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1993018 INFO  (coreLoadExecutor-4740-thread-1-proce

[...truncated too long message...]

2       /solr/clusterprops.json
   [junit4]   2>        42      /solr/aliases.json
   [junit4]   2>        20      /solr/configs/conf1
   [junit4]   2>        12      /solr/security.json
   [junit4]   2>        8       /solr/collections/tmp_collection/state.json
   [junit4]   2>        3       
/solr/collections/source_collection/leaders/shard2/leader
   [junit4]   2>        3       
/solr/collections/source_collection/leaders/shard1/leader
   [junit4]   2>        3       
/solr/collections/target_collection/leaders/shard2/leader
   [junit4]   2>        3       
/solr/collections/target_collection/leaders/shard1/leader
   [junit4]   2>        2       
/solr/collections/tmp_collection/leaders/shard2/leader
   [junit4]   2>        2       
/solr/collections/tmp_collection/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        42      /solr/clusterstate.json
   [junit4]   2>        9       
/solr/collections/source_collection/cdcr/state/process
   [junit4]   2>        8       
/solr/collections/target_collection/cdcr/state/buffer
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2>        8       
/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2>        8       
/solr/collections/target_collection/cdcr/state/process
   [junit4]   2>        6       /solr/collections/source_collection/state.json
   [junit4]   2>        6       /solr/collections/target_collection/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/97324522890133530-127.0.0.1:40171_akg%2Fi-n_0000000005
   [junit4]   2>        2       
/solr/overseer_elect/election/97324522890133514-127.0.0.1:47851_akg%2Fi-n_0000000002
   [junit4]   2>        2       
/solr/overseer_elect/election/97324522890133557-127.0.0.1:52954_akg%2Fi-n_0000000009
   [junit4]   2>        2       
/solr/overseer_elect/election/97324522890133533-127.0.0.1:52954_akg%2Fi-n_0000000006
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        208     /solr/overseer/collection-queue-work
   [junit4]   2>        112     /solr/overseer/queue
   [junit4]   2>        42      /solr/collections
   [junit4]   2>        38      /solr/live_nodes
   [junit4]   2>        35      /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 4509494 INFO  
(SUITE-CdcrReplicationDistributedZkTest-seed#[2162E7C1EA6E305C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_2162E7C1EA6E305C-001
   [junit4]   2> Jan 22, 2017 3:09:44 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene62, 
sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=fi-FI, 
timezone=Africa/Algiers
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_102 (64-bit)/cpus=4,threads=1,free=173869776,total=530579456
   [junit4]   2> NOTE: All tests run in this JVM: [DeleteReplicaTest, 
ExitableDirectoryReaderTest, TestLeaderElectionZkExpiry, ConnectionManagerTest, 
TestWriterPerf, TestMiniSolrCloudClusterSSL, 
TermVectorComponentDistributedTest, RecoveryZkTest, CdcrUpdateLogTest, 
TestRequestForwarding, TestMacroExpander, TestAnalyzedSuggestions, 
TestCloudManagedSchema, CollectionsAPISolrJTest, TestHdfsUpdateLog, 
ForceLeaderTest, DirectUpdateHandlerTest, TestPKIAuthenticationPlugin, 
TestDefaultSearchFieldResource, TestJmxMonitoredMap, TestCollationField, 
VMParamsZkACLAndCredentialsProvidersTest, TestComplexPhraseQParserPlugin, 
HdfsChaosMonkeyNothingIsSafeTest, SolrIndexMetricsTest, PrimitiveFieldTypeTest, 
RequestHandlersTest, HighlighterMaxOffsetTest, LeaderElectionTest, 
SharedFSAutoReplicaFailoverTest, TestLMJelinekMercerSimilarityFactory, 
DistributedQueueTest, ResponseLogComponentTest, TestRawTransformer, 
AtomicUpdatesTest, TestFreeTextSuggestions, BJQParserTest, 
DistribCursorPagingTest, SparseHLLTest, QueryParsingTest, 
TestCollationFieldDocValues, TestManagedSchemaThreadSafety, 
PingRequestHandlerTest, PluginInfoTest, SegmentsInfoRequestHandlerTest, 
TestSolrJ, BooleanFieldTest, TestExclusionRuleCollectionAccess, 
TestExportWriter, TestJavabinTupleStreamParser, CdcrBootstrapTest, 
FieldAnalysisRequestHandlerTest, DeleteInactiveReplicaTest, BlockDirectoryTest, 
SuggestComponentTest, TestRecoveryHdfs, TestObjectReleaseTracker, 
TestFieldTypeResource, RulesTest, HttpSolrCallGetCoreTest, TestConfig, 
ClassificationUpdateProcessorTest, JvmMetricsTest, 
SpellPossibilityIteratorTest, RecoveryAfterSoftCommitTest, 
LukeRequestHandlerTest, TestSort, TestStressReorder, 
TestFieldCollectionResource, TestDFRSimilarityFactory, 
TestUseDocValuesAsStored, OverseerCollectionConfigSetProcessorTest, 
TestMergePolicyConfig, OverseerTest, TestClusterProperties, TestZkChroot, 
TestSolrCoreParser, FullSolrCloudDistribCmdsTest, SuggesterTSTTest, 
TestTestInjection, TestFilteredDocIdSet, TestLockTree, 
TestRandomRequestDistribution, TestXmlQParserPlugin, PrimUtilsTest, 
TestBinaryField, BadIndexSchemaTest, BigEndianAscendingWordSerializerTest, 
TestCoreDiscovery, TestConfigSetsAPIExclusivity, SuggesterWFSTTest, 
SmileWriterTest, TestReqParamsAPI, SolrCoreCheckLockOnStartupTest, 
MultiThreadedOCPTest, FieldMutatingUpdateProcessorTest, TestGroupingSearch, 
PreAnalyzedFieldTest, SolrGraphiteReporterTest, TestSchemaSimilarityResource, 
CleanupOldIndexTest, TestManagedStopFilterFactory, 
LeaderFailoverAfterPartitionTest, AssignTest, CollectionStateFormat2Test, 
SimpleFacetsTest, TestReloadAndDeleteDocs, ChaosMonkeySafeLeaderTest, 
BasicDistributedZk2Test, UnloadDistributedZkTest, 
CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, 
LeaderElectionIntegrationTest, ClusterStateUpdateTest, TestRandomFaceting, 
ZkSolrClientTest, TestRandomDVFaceting, AutoCommitTest, TestRecovery, 
TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestJoin, TestReload, 
HardAutoCommitTest, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, 
StatsComponentTest, PeerSyncTest, ConvertedLegacyTest, TestBadConfig, 
TestIndexSearcher, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, 
DistributedQueryElevationComponentTest, SuggesterFSTTest, 
TestFoldingMultitermQuery, SuggesterTest, TestTrie, NoCacheHeaderTest, 
SchemaVersionSpecificBehaviorTest, TestUpdate, TestWordDelimiterFilterFactory, 
DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, 
DistanceFunctionTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, 
DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, 
TestOmitPositions, XmlUpdateRequestHandlerTest, LoggingHandlerTest, 
SolrPluginUtilsTest, JSONWriterTest, MBeansHandlerTest, 
TestPHPSerializedResponseWriter, SOLR749Test, UpdateParamsTest, 
AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, 
SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, 
OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, 
TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestLuceneMatchVersion, 
TestPhraseSuggestions, TestCodecSupport, SynonymTokenizerTest, 
TestXIncludeConfig, EchoParamsTest, TestLMDirichletSimilarityFactory, 
TestBM25SimilarityFactory, TimeZoneUtilsTest, ResourceLoaderTest, 
ScriptEngineTest, OpenExchangeRatesOrgProviderTest, 
ChaosMonkeyNothingIsSafeTest, DistributedIntervalFacetingTest, 
BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest]
   [junit4] Completed [531/681 (4!)] on J2 in 1727.72s, 11 tests, 2 failures 
<<< FAILURES!

[...truncated 41333 lines...]
-ecj-javadoc-lint-src:
    [mkdir] Created dir: /tmp/ecj1321004003
 [ecj-lint] Compiling 810 source files to /tmp/ecj1321004003
 [ecj-lint] ----------
 [ecj-lint] 1. ERROR in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/core/src/java/org/apache/lucene/document/SortedSetDocValuesRangeQuery.java
 (at line 22)
 [ecj-lint]     import org.apache.lucene.index.DocValues;
 [ecj-lint]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.lucene.index.DocValues is never used
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 2. WARNING in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/core/src/java/org/apache/lucene/index/IndexWriter.java
 (at line 4308)
 [ecj-lint]     newReader = new SegmentReader(info, reader, liveDocs, 
info.info.maxDoc() - delCount);
 [ecj-lint]     
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'newReader' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 3. WARNING in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/core/src/java/org/apache/lucene/index/SegmentReader.java
 (at line 159)
 [ecj-lint]     return null;
 [ecj-lint]     ^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'dir' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 3 problems (1 error, 2 warnings)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:101:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build.xml:199:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:1992:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:2031:
 Compile failed; see the compiler error output for details.

Total time: 282 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to