Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/40/

4 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([6D29FDC01C68A451:537FE2CFEF8FE1F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.verifyReplicaStatus(AbstractDistribZkTestBase.java:234)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1271)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.store.hdfs.HdfsDirectoryTest

Error Message:
Captured an uncaught exception in thread: Thread[id=14245, name=Thread-8241, 
state=RUNNABLE, group=TGRP-HdfsDirectoryTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=14245, name=Thread-8241, state=RUNNABLE, 
group=TGRP-HdfsDirectoryTest]
Caused by: java.lang.IllegalStateException: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data1/current/BP-343369792-10.41.0.5-1460823718177/dncp_block_verification.log.curr
 is not yet opened.
        at __randomizedtesting.SeedInfo.seed([6D29FDC01C68A451]:0)
        at 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.RollingLogsImpl$1.append(RollingLogsImpl.java:54)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner$LogFileHandler.append(BlockPoolSliceScanner.java:819)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.updateScanStatus(BlockPoolSliceScanner.java:351)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyBlock(BlockPoolSliceScanner.java:451)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyFirstBlock(BlockPoolSliceScanner.java:523)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scan(BlockPoolSliceScanner.java:684)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scanBlockPoolSlice(BlockPoolSliceScanner.java:650)
        at 
org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:101)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:60595

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:60595
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:601)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:381)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:243)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:171)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:495)
        ... 47 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=29573, name=collection4, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=29573, name=collection4, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:35954: collection already exists: 
awholynewstresscollection_collection4_0
        at __randomizedtesting.SeedInfo.seed([6D29FDC01C68A451]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:404)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:357)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1192)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:962)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:898)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1616)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:970)




Build Log:
[...truncated 11838 lines...]
   [junit4] Suite: org.apache.solr.store.hdfs.HdfsDirectoryTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/init-core-data-001
   [junit4]   2> 2159647 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 2159678 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 2159684 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2159689 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 2159699 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_49066_hdfs____6z6u45/webapp
   [junit4]   2> 2159797 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log NO JSP 
Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2160488 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49066
   [junit4]   2> 2160728 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2160728 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 2160737 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_54235_datanode____29ma9o/webapp
   [junit4]   2> 2160815 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log NO JSP 
Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2161229 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54235
   [junit4]   2> 2161330 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2161331 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 2161340 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_39709_datanode____.pep873/webapp
   [junit4]   2> 2161491 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-d154090c-61c0-469a-837a-d6015240a53c node DatanodeRegistration(127.0.0.1, 
datanodeUuid=0364a30f-d270-49b6-9e9c-ee2894bfb0f1, infoPort=54235, 
ipcPort=59453, storageInfo=lv=-56;cid=testClusterID;nsid=673287137;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 2161491 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-b7ecc137-b94a-4ba3-8410-b04a90c94774 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=0364a30f-d270-49b6-9e9c-ee2894bfb0f1, infoPort=54235, 
ipcPort=59453, storageInfo=lv=-56;cid=testClusterID;nsid=673287137;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2161503 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log NO JSP 
Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2161799 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39709
   [junit4]   2> 2161956 INFO  (IPC Server handler 5 on 58514) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=461e626c-30ae-46ae-8970-8262095208ba, infoPort=39709, 
ipcPort=34165, storageInfo=lv=-56;cid=testClusterID;nsid=673287137;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 2161956 INFO  (IPC Server handler 5 on 58514) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff node DatanodeRegistration(127.0.0.1, 
datanodeUuid=461e626c-30ae-46ae-8970-8262095208ba, infoPort=39709, 
ipcPort=34165, storageInfo=lv=-56;cid=testClusterID;nsid=673287137;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2162262 INFO  
(TEST-HdfsDirectoryTest.testRandomAccessWrites-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testRandomAccessWrites
   [junit4]   1> Working on pass [0] contains [false]
   [junit4]   2> 2162465 INFO  (IPC Server handler 5 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW]]}
 size 465102
   [junit4]   2> 2162465 INFO  (IPC Server handler 1 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741825_1001 size 465102
   [junit4]   1> Working on pass [1] contains [false]
   [junit4]   2> 2167071 INFO  (IPC Server handler 0 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW]]}
 size 0
   [junit4]   2> 2167072 INFO  (IPC Server handler 3 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   1> Working on pass [2] contains [false]
   [junit4]   2> 2167436 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW]]}
 size 0
   [junit4]   2> 2167439 INFO  (IPC Server handler 4 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   1> Working on pass [3] contains [false]
   [junit4]   2> 2177920 INFO  (IPC Server handler 1 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   2> 2177920 INFO  (IPC Server handler 1 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   1> Working on pass [4] contains [false]
   [junit4]   2> 2178940 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW]]}
 size 0
   [junit4]   2> 2178948 INFO  (IPC Server handler 7 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW]]}
 size 0
   [junit4]   1> Working on pass [5] contains [false]
   [junit4]   2> 2183005 INFO  (IPC Server handler 6 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW]]}
 size 0
   [junit4]   2> 2183006 INFO  (IPC Server handler 7 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|FINALIZED]]}
 size 0
   [junit4]   1> Working on pass [6] contains [false]
   [junit4]   2> 2186398 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW]]}
 size 0
   [junit4]   2> 2186398 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741831_1007 size 6033306
   [junit4]   1> Working on pass [7] contains [false]
   [junit4]   2> 2193741 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|FINALIZED]]}
 size 0
   [junit4]   2> 2193742 INFO  (IPC Server handler 0 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741832_1008 size 807769
   [junit4]   1> Working on pass [8] contains [false]
   [junit4]   2> 2197153 INFO  (IPC Server handler 5 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW]]}
 size 0
   [junit4]   2> 2197156 INFO  (IPC Server handler 7 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   1> Working on pass [9] contains [false]
   [junit4]   2> 2197434 INFO  (IPC Server handler 1 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW]]}
 size 0
   [junit4]   2> 2197434 INFO  (IPC Server handler 4 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|FINALIZED]]}
 size 0
   [junit4]   2> 2199346 INFO  
(TEST-HdfsDirectoryTest.testRandomAccessWrites-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testRandomAccessWrites
   [junit4]   2> 2199393 INFO  
(TEST-HdfsDirectoryTest.testRename-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testRename
   [junit4]   2> 2199489 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW]]}
 size 0
   [junit4]   2> 2199490 INFO  (IPC Server handler 1 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|FINALIZED]]}
 size 0
   [junit4]   2> 2199512 INFO  (IPC Server handler 6 on 58514) [    ] 
BlockStateChange BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:48818 
127.0.0.1:55405 
   [junit4]   2> 2199513 INFO  
(TEST-HdfsDirectoryTest.testRename-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testRename
   [junit4]   2> 2199570 INFO  
(TEST-HdfsDirectoryTest.testWritingAndReadingAFile-seed#[6D29FDC01C68A451]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testWritingAndReadingAFile
   [junit4]   2> 2199688 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741836_1012{blockUCState=COMMITTED, primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-1591d3fa-eafe-4bc3-87b2-8cb3c6acadff:NORMAL:127.0.0.1:55405|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d154090c-61c0-469a-837a-d6015240a53c:NORMAL:127.0.0.1:48818|RBW]]}
 size 4
   [junit4]   2> 2199688 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741836_1012 size 4
   [junit4]   2> 2200109 INFO  (IPC Server handler 9 on 58514) [    ] 
BlockStateChange BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:48818 
127.0.0.1:55405 
   [junit4]   2> 2200110 INFO  
(TEST-HdfsDirectoryTest.testWritingAndReadingAFile-seed#[6D29FDC01C68A451]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testWritingAndReadingAFile
   [junit4]   2> 2200138 INFO  
(TEST-HdfsDirectoryTest.testEOF-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testEOF
   [junit4]   2> 2200460 INFO  (IPC Server handler 8 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55405 is 
added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   2> 2200468 INFO  (IPC Server handler 0 on 58514) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48818 is 
added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-b7ecc137-b94a-4ba3-8410-b04a90c94774:NORMAL:127.0.0.1:48818|RBW],
 
ReplicaUnderConstruction[[DISK]DS-d06c5bcd-7c3e-4fd9-9c70-48181cc2e716:NORMAL:127.0.0.1:55405|FINALIZED]]}
 size 0
   [junit4]   2> 2200500 INFO  
(TEST-HdfsDirectoryTest.testEOF-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testEOF
   [junit4]   2> 2200501 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 2200518 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Stopped 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 2200524 WARN  (554066667@qtp-1316213847-0 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39709) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false. Rechecking.
   [junit4]   2> 2200524 WARN  (554066667@qtp-1316213847-0 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39709) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false
   [junit4]   2> 2200538 WARN  (DataNode: 
[[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data3/,
 
[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data4/]]
  heartbeating to localhost/127.0.0.1:58514) [    ] o.a.h.h.s.d.DataNode 
BPOfferService for Block pool BP-343369792-10.41.0.5-1460823718177 (Datanode 
Uuid 461e626c-30ae-46ae-8970-8262095208ba) service to localhost/127.0.0.1:58514 
interrupted
   [junit4]   2> 2200538 WARN  (DataNode: 
[[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data3/,
 
[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data4/]]
  heartbeating to localhost/127.0.0.1:58514) [    ] o.a.h.h.s.d.DataNode Ending 
block pool service for: Block pool BP-343369792-10.41.0.5-1460823718177 
(Datanode Uuid 461e626c-30ae-46ae-8970-8262095208ba) service to 
localhost/127.0.0.1:58514
   [junit4]   2> 2200544 WARN  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 2200550 WARN  (DataNode: 
[[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data1/,
 
[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data2/]]
  heartbeating to localhost/127.0.0.1:58514) [    ] o.a.h.h.s.d.DataNode Ending 
block pool service for: Block pool BP-343369792-10.41.0.5-1460823718177 
(Datanode Uuid 0364a30f-d270-49b6-9e9c-ee2894bfb0f1) service to 
localhost/127.0.0.1:58514
   [junit4]   2> 2200552 WARN  (Thread-8241) [    ] 
o.a.h.h.s.d.BlockPoolSliceScanner RuntimeException during 
BlockPoolScanner.scan()
   [junit4]   2> java.lang.IllegalStateException: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data1/current/BP-343369792-10.41.0.5-1460823718177/dncp_block_verification.log.curr
 is not yet opened.
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.RollingLogsImpl$1.append(RollingLogsImpl.java:54)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner$LogFileHandler.append(BlockPoolSliceScanner.java:819)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.updateScanStatus(BlockPoolSliceScanner.java:351)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyBlock(BlockPoolSliceScanner.java:451)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyFirstBlock(BlockPoolSliceScanner.java:523)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scan(BlockPoolSliceScanner.java:684)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scanBlockPoolSlice(BlockPoolSliceScanner.java:650)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:101)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Apr 16, 2016 12:22:39 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[Thread-8241,5,TGRP-HdfsDirectoryTest]
   [junit4]   2> java.lang.IllegalStateException: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data1/current/BP-343369792-10.41.0.5-1460823718177/dncp_block_verification.log.curr
 is not yet opened.
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([6D29FDC01C68A451]:0)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.RollingLogsImpl$1.append(RollingLogsImpl.java:54)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner$LogFileHandler.append(BlockPoolSliceScanner.java:819)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.updateScanStatus(BlockPoolSliceScanner.java:351)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyBlock(BlockPoolSliceScanner.java:451)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyFirstBlock(BlockPoolSliceScanner.java:523)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scan(BlockPoolSliceScanner.java:684)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scanBlockPoolSlice(BlockPoolSliceScanner.java:650)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:101)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2200585 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Stopped 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 2200597 WARN  (981596650@qtp-1665797956-1 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54235) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false. Rechecking.
   [junit4]   2> 2200597 WARN  (981596650@qtp-1665797956-1 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54235) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false
   [junit4]   2> 2200706 WARN  
(org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@2e98b70e)
 [    ] o.a.h.h.s.b.DecommissionManager Monitor interrupted: 
java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 2200722 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] o.m.log Stopped 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 2200722 WARN  (1498840169@qtp-1687881667-1 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49066) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false. Rechecking.
   [junit4]   2> 2200723 WARN  (1498840169@qtp-1687881667-1 - Acceptor0 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49066) [    ] 
o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false
   [junit4]   2> 2200894 ERROR 
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
   [junit4]   2> java.lang.reflect.InvocationTargetException
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2>        at 
com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2>        at 
org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2>        at 
org.apache.solr.store.hdfs.HdfsDirectoryTest.afterClass(HdfsDirectoryTest.java:66)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2>        ... 54 more
   [junit4]   2> 2200896 INFO  
(SUITE-HdfsDirectoryTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Apr 16, 2016 4:22:39 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene60, 
sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=ar-TN, 
timezone=America/Grand_Turk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=236149672,total=492830720
   [junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, 
BigEndianAscendingWordSerializerTest, SchemaVersionSpecificBehaviorTest, 
BlockCacheTest, TestConfigReload, TestSerializedLuceneMatchVersion, 
TestSystemIdResolver, TestWordDelimiterFilterFactory, ZkSolrClientTest, 
OpenExchangeRatesOrgProviderTest, ShardSplitTest, 
DistributedIntervalFacetingTest, TestConfigSetImmutable, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, CollectionReloadTest, 
ClusterStateUpdateTest, UniqFieldsUpdateProcessorFactoryTest, 
SimplePostToolTest, SpellPossibilityIteratorTest, TestRestoreCore, 
CoreMergeIndexesAdminHandlerTest, ZkControllerTest, DirectSolrSpellCheckerTest, 
ZkCLITest, AnalysisErrorHandlingTest, TestMiniSolrCloudClusterBase, 
MigrateRouteKeyTest, CSVRequestHandlerTest, TestClassicSimilarityFactory, 
NotRequiredUniqueKeyTest, HdfsChaosMonkeySafeLeaderTest, 
ChaosMonkeySafeLeaderTest, TestOrdValues, TestSchemaManager, 
TestQuerySenderListener, CdcrReplicationHandlerTest, TestSmileRequest, 
DistributedFacetPivotSmallTest, TestDistributedGrouping, 
WordBreakSolrSpellCheckerTest, FastVectorHighlighterTest, 
TestSolrConfigHandlerConcurrent, TestExactStatsCache, TestFiltering, 
TestAuthenticationFramework, TermsComponentTest, TestQuerySenderNoQuery, 
DistanceUnitsTest, OverseerStatusTest, SparseHLLTest, 
TestPartialUpdateDeduplication, MultiTermTest, TestStressVersions, 
HdfsDirectoryFactoryTest, TestComplexPhraseQParserPlugin, RemoteQueryErrorTest, 
TestLMJelinekMercerSimilarityFactory, TlogReplayBufferedWhileIndexingTest, 
TestPerFieldSimilarityClassic, TestEmbeddedSolrServerConstructors, 
TestInitParams, TestNamedUpdateProcessors, HdfsDirectoryTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsDirectoryTest 
-Dtests.seed=6D29FDC01C68A451 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=ar-TN -Dtests.timezone=America/Grand_Turk -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | HdfsDirectoryTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=14245, name=Thread-8241, state=RUNNABLE, 
group=TGRP-HdfsDirectoryTest]
   [junit4]    > Caused by: java.lang.IllegalStateException: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.store.hdfs.HdfsDirectoryTest_6D29FDC01C68A451-001/tempDir-001/hdfsBaseDir/data/data1/current/BP-343369792-10.41.0.5-1460823718177/dncp_block_verification.log.curr
 is not yet opened.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([6D29FDC01C68A451]:0)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.RollingLogsImpl$1.append(RollingLogsImpl.java:54)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner$LogFileHandler.append(BlockPoolSliceScanner.java:819)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.updateScanStatus(BlockPoolSliceScanner.java:351)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyBlock(BlockPoolSliceScanner.java:451)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.verifyFirstBlock(BlockPoolSliceScanner.java:523)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scan(BlockPoolSliceScanner.java:684)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner.scanBlockPoolSlice(BlockPoolSliceScanner.java:650)
   [junit4]    >        at 
org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:101)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed [211/587 (1!)] on J1 in 51.12s, 4 tests, 1 error <<< 
FAILURES!

[...truncated 211 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/init-core-data-001
   [junit4]   2> 2080587 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 2080587 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[6D29FDC01C68A451]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 2080590 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2080590 INFO  (Thread-6931) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2080590 INFO  (Thread-6931) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2080693 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:60836
   [junit4]   2> 2080693 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2080702 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2080725 INFO  (zkCallback-1541-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6875b061 
name:ZooKeeperConnection Watcher:127.0.0.1:60836 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2080725 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2080725 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2080725 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2080735 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2080745 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2080757 INFO  (zkCallback-1542-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7e060b0b 
name:ZooKeeperConnection Watcher:127.0.0.1:60836/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2080761 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2080761 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2080761 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 2080768 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 2080769 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 2080770 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 2080771 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 2080771 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2080773 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 2080773 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 2080775 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2080776 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2080777 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 2080778 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2080780 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 2080780 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2080782 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 2080782 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 2080785 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2080785 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2080786 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2080786 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2080788 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2080788 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2080790 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2080790 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2080792 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 2080792 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2080802 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2080804 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2080809 INFO  (zkCallback-1543-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@697c045e 
name:ZooKeeperConnection Watcher:127.0.0.1:60836 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2080809 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2080809 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2080809 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2080812 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2080813 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2080820 INFO  (zkCallback-1544-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6e5af73 name:ZooKeeperConnection 
Watcher:127.0.0.1:60836/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2080825 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2080825 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2080825 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 2080825 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 2080838 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 2080839 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 2080839 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf2/enumsConfig.xml
   [junit4]   2> 2080840 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 2080840 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2080841 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2080841 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 2080842 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 2080849 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 2080849 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 2080850 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 2080850 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 2080851 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 2080851 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 2080852 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2080852 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2080853 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 2080853 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 2080861 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 2080861 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 2080863 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 2080863 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 2081136 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores/collection1
   [junit4]   2> 2081137 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 2081139 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@214f88a0{/,null,AVAILABLE}
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7dab91b6{HTTP/1.1,[http/1.1]}{127.0.0.1:39528}
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.e.j.s.Server Started @2088126ms
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/tempDir-001/control/data,
 hostContext=/, hostPort=39528, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores}
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001'
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 2081140 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2081143 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2081153 INFO  (zkCallback-1545-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4d2726ea 
name:ZooKeeperConnection Watcher:127.0.0.1:60836/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2081153 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2081153 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2081155 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 2081155 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/solr.xml
   [junit4]   2> 2081159 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores
   [junit4]   2> 2081159 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 461437162
   [junit4]   2> 2081159 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001]
   [junit4]   2> 2081159 WARN  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/lib
   [junit4]   2> 2081159 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2081160 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2081161 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2081161 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2081161 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60836/solr
   [junit4]   2> 2081161 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2081161 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2081162 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2081162 INFO  (zkCallback-1548-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@225ebb8 name:ZooKeeperConnection 
Watcher:127.0.0.1:60836 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2081163 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2081163 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2081164 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.ZkController Added new OnReconnect listener 
org.apache.solr.cloud.ZkController$$Lambda$16/933838597@9c59634
   [junit4]   2> 2081164 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2081166 INFO  
(zkCallback-1549-thread-1-processing-n:127.0.0.1:39528_) [n:127.0.0.1:39528_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5c17b295 
name:ZooKeeperConnection Watcher:127.0.0.1:60836/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2081166 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2081167 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2081168 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2081169 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 2081170 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2081171 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2081171 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2081172 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2081173 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2081173 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2081174 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 2081174 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 2081180 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2081181 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 2081185 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2081185 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/95736537992200198-127.0.0.1:39528_-n_0000000000
   [junit4]   2> 2081186 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:39528_
   [junit4]   2> 2081186 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 2081186 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.Overseer Overseer 
(id=95736537992200198-127.0.0.1:39528_-n_0000000000) starting
   [junit4]   2> 2081188 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 2081196 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2081197 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2081197 INFO  
(OverseerCollectionConfigSetProcessor-95736537992200198-127.0.0.1:39528_-n_0000000000)
 [n:127.0.0.1:39528_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 2081199 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39528_
   [junit4]   2> 2081200 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:39528_
   [junit4]   2> 2081202 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 2081202 INFO  
(zkCallback-1549-thread-1-processing-n:127.0.0.1:39528_) [n:127.0.0.1:39528_    
] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [0])
   [junit4]   2> 2081205 INFO  
(zkCallback-1549-thread-1-processing-n:127.0.0.1:39528_) [n:127.0.0.1:39528_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2081210 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 2081210 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2081210 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores
   [junit4]   2> 2081211 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 2081211 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CorePropertiesLocator Found core collection1 
in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores/collection1
   [junit4]   2> 2081211 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 2081253 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 2081254 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6D29FDC01C68A451]) 
[n:127.0.0.1:39528_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 2081255 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 2081255 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 2081297 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39528";,
   [junit4]   2>   "node_name":"127.0.0.1:39528_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2081297 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 2081304 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39528";,
   [junit4]   2>   "node_name":"127.0.0.1:39528_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2081308 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 2081313 INFO  
(OverseerStateUpdate-95736537992200198-127.0.0.1:39528_-n_0000000000) 
[n:127.0.0.1:39528_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 2081333 INFO  
(zkCallback-1549-thread-1-processing-n:127.0.0.1:39528_) [n:127.0.0.1:39528_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 2082304 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2082304 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 2082304 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 2082304 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 2082305 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 2082305 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6D29FDC01C68A451-001/control-001/cores/collection1'
   [junit4]   2> 2082305 INFO  
(coreLoadExecutor-4347-thread-1-processing-n:127.0.0.1:39528_) 
[n:127.0.0.1:39528_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx

[...truncated too long message...]

junit4]   2>    at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2>        ... 54 more
   [junit4]   2> 5920134 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[6D29FDC01C68A451]-worker) [    
] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Apr 16, 2016 5:24:38 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): 
{other_tl1=PostingsFormat(name=Memory doPackFST= false), 
range_facet_l_dv=BlockTreeOrds(blocksize=128), 
_version_=PostingsFormat(name=Memory doPackFST= false), 
multiDefault=PostingsFormat(name=Memory doPackFST= true), 
a_t=PostingsFormat(name=Memory doPackFST= false), 
intDefault=PostingsFormat(name=Memory doPackFST= false), 
a_i1=PostingsFormat(name=Memory doPackFST= false), 
id=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=Memory 
doPackFST= false), text=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
range_facet_l=PostingsFormat(name=Memory doPackFST= false), 
timestamp=PostingsFormat(name=Memory doPackFST= false)}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), 
range_facet_i_dv=DocValuesFormat(name=Lucene54), 
timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=539, 
maxMBSortInHeap=4.863911445567977, sim=ClassicSimilarity, locale=lv-LV, 
timezone=America/Menominee
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=115093408,total=496500736
   [junit4]   2> NOTE: All tests run in this JVM: [TestManagedResource, 
TestZkChroot, TestSolrQueryParserDefaultOperatorResource, 
TestUseDocValuesAsStored, TestSuggestSpellingConverter, TestStressUserVersions, 
DistributedSuggestComponentTest, ParsingFieldUpdateProcessorsTest, 
TestMissingGroups, TestFieldCollectionResource, TestPerFieldSimilarity, 
TestReversedWildcardFilterFactory, RuleEngineTest, TestIndexSearcher, 
TestSizeLimitedDistributedMap, DistributedFacetPivotLongTailTest, 
EnumFieldTest, TestCloudManagedSchema, SolrCloudExampleTest, SearchHandlerTest, 
SliceStateTest, DirectoryFactoryTest, TestStressRecovery, TestRawTransformer, 
TestElisionMultitermQuery, HdfsRecoveryZkTest, TestSearcherReuse, 
HdfsWriteToMultipleCollectionsTest, TestScoreJoinQPNoScore, TestSQLHandler, 
TestLRUStatsCache, TestJmxIntegration, 
AddSchemaFieldsUpdateProcessorFactoryTest, TestJmxMonitoredMap, 
RequestLoggingTest, TestSha256AuthenticationProvider, 
TestConfigSetsAPIZkFailure, BasicDistributedZk2Test, CheckHdfsIndexTest, 
QueryParsingTest, TestReRankQParserPlugin, ClusterStateTest, 
TestCollationField, TestExpandComponent, TestSearchPerf, 
TestDefaultSearchFieldResource, DeleteLastCustomShardedReplicaTest, 
TestHashQParserPlugin, TestIndexingPerformance, RankQueryTest, 
StatsComponentTest, TriLevelCompositeIdRoutingTest, 
TestTolerantUpdateProcessorCloud, HighlighterConfigTest, CleanupOldIndexTest, 
SuggesterTSTTest, TestPostingsSolrHighlighter, DirectSolrConnectionTest, 
ShowFileRequestHandlerTest, TestDFISimilarityFactory, 
TestImplicitCoreProperties, BaseCdcrDistributedZkTest, SuggesterTest, 
TestSolrIndexConfig, NoCacheHeaderTest, JavabinLoaderTest, 
LeaderInitiatedRecoveryOnCommitTest, TestJsonFacets, 
TestDistributedMissingSort, TestTestInjection, 
FieldMutatingUpdateProcessorTest, AnalyticsQueryTest, 
TestPerFieldSimilarityWithDefaultOverride, TestCharFilters, 
TermVectorComponentDistributedTest, ForceLeaderTest, CurrencyFieldXmlFileTest, 
DistribJoinFromCollectionTest, CdcrRequestHandlerTest, TestSolr4Spatial2, 
TestSweetSpotSimilarityFactory, TestWriterPerf, 
SharedFSAutoReplicaFailoverTest, CloudMLTQParserTest, 
CoreAdminCreateDiscoverTest, TestUtils, ZkStateReaderTest, BadIndexSchemaTest, 
RegexBoostProcessorTest, TestXIncludeConfig, RecoveryZkTest, 
TestSchemaSimilarityResource, QueryResultKeyTest, TestTolerantSearch, 
BasicDistributedZkTest, UnloadDistributedZkTest, 
CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, 
OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, 
FullSolrCloudDistribCmdsTest, TestRandomFaceting, LeaderElectionTest, 
TestRandomDVFaceting, AutoCommitTest, TestRecovery, TestRealTimeGet, 
TestStressReorder, TestJoin, TestReload, TestRangeQuery, SimpleFacetsTest, 
TestGroupingSearch, BasicFunctionalityTest, DirectUpdateHandlerTest, 
HighlighterTest, CurrencyFieldOpenExchangeTest, TestCoreDiscovery, 
AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, SuggesterFSTTest, 
SolrRequestParserTest, DocValuesTest, XsltUpdateRequestHandlerTest, 
TestSurroundQueryParser, LukeRequestHandlerTest, RequestHandlersTest, 
TestValueSourceCache, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, 
TestArbitraryIndexDir, UpdateRequestProcessorFactoryTest, 
TestCSVResponseWriter, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, 
TestBinaryResponseWriter, AlternateDirectoryTest, SolrIndexConfigTest, 
SampleTest, TestDocSet, NumericFieldsTest, TestConfig, OutputWriterTest, 
ExternalFileFieldSortTest, TestPhraseSuggestions, SynonymTokenizerTest, 
EchoParamsTest, TestDFRSimilarityFactory, TestIBSimilarityFactory, 
TestFastWriter, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, 
AliasIntegrationTest, CollectionTooManyReplicasTest, 
ConcurrentDeleteAndCreateCollectionTest, ConnectionManagerTest, 
CustomCollectionTest, DistribDocExpirationUpdateProcessorTest, 
DistributedQueueTest, DistributedVersionInfoTest, 
LeaderFailoverAfterPartitionTest, MultiThreadedOCPTest, SSLMigrationTest, 
SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, 
TestCloudDeleteByQuery, TestCloudPivotFacet, TestCollectionAPI, 
TestDistribDocBasedVersion, TestDownShardTolerantSearch, 
TestLeaderElectionZkExpiry, TestLeaderInitiatedRecoveryThread, 
TestRandomRequestDistribution, TestShortCircuitedRequests, 
HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [479/587 (4!)] on J2 in 464.15s, 1 test, 1 error <<< 
FAILURES!

[...truncated 391 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:529:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1457:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1014:
 There were test failures: 587 suites (10 ignored), 2366 tests, 1 suite-level 
error, 2 errors, 1 failure, 31 ignored (16 assumptions) [seed: 6D29FDC01C68A451]

Total time: 313 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to