Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.5/4/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:51865: Could not load collection from ZK: 
halfcollectionblocker

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:51865: Could not load collection from ZK: 
halfcollectionblocker
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:400)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:516)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [HdfsTransactionLog]
        at __randomizedtesting.SeedInfo.seed([65ED4E6690CA05AE]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:228)
        at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.update.DirectUpdateHandlerTest.testExpungeDeletes

Error Message:
expected:<5> but was:<4>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<4>
        at 
__randomizedtesting.SeedInfo.seed([65ED4E6690CA05AE:49940AE3E573CD0B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.update.DirectUpdateHandlerTest.testExpungeDeletes(DirectUpdateHandlerTest.java:299)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11295 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/init-core-data-001
   [junit4]   2> 665111 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 665111 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 665512 WARN  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your 
platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 665966 WARN  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 666086 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via 
org.mortbay.log.Slf4jLog
   [junit4]   2> 666093 WARN  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 666151 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 666188 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_45424_hdfs____ndof7j/webapp
   [junit4]   2> 666318 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 666979 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45424
   [junit4]   2> 667585 WARN  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 667590 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 667599 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_41083_datanode____.5pug7f/webapp
   [junit4]   2> 667707 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 667945 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41083
   [junit4]   2> 668059 WARN  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 668060 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 668069 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_45659_datanode____z1fkww/webapp
   [junit4]   2> 668168 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 668469 INFO  
(SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45659
   [junit4]   2> 668773 INFO  (IPC Server handler 7 on 42039) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-f7d9e805-10ce-4707-93b3-79fcf72f75aa node DatanodeRegistration(127.0.0.1, 
datanodeUuid=f55062c8-206b-4206-906a-d1dab3ad64dc, infoPort=45659, 
ipcPort=60229, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 668773 INFO  (IPC Server handler 7 on 42039) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-3713a927-1132-4473-b54e-1b9bd55f75e1 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=f55062c8-206b-4206-906a-d1dab3ad64dc, infoPort=45659, 
ipcPort=60229, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 668776 INFO  (IPC Server handler 5 on 42039) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-b8904166-079e-4896-b468-93232dbc15d0 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=0459d0c8-44a0-4204-ac7d-c27b6691a05e, infoPort=41083, 
ipcPort=57341, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 2 msecs
   [junit4]   2> 668777 INFO  (IPC Server handler 5 on 42039) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-962b23fe-4150-4195-9bc3-7ec495b4eb62 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=0459d0c8-44a0-4204-ac7d-c27b6691a05e, infoPort=41083, 
ipcPort=57341, storageInfo=lv=-56;cid=testClusterID;nsid=1856959388;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 669081 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 669082 INFO  (Thread-2230) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 669082 INFO  (Thread-2230) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 669182 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37869
   [junit4]   2> 669182 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669182 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669189 INFO  (zkCallback-662-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3f98d12f 
name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669189 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669189 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669189 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 669191 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669192 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669194 INFO  (zkCallback-663-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7104284e 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669194 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669194 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669194 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 669196 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 669197 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 669197 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 669198 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 669198 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 669200 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 669200 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 669201 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 669201 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 669202 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 669202 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 669203 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 669203 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 669204 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 669204 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 669205 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 669205 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 669206 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 669206 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 669207 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 669207 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 669208 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 669208 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 669208 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 669209 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 669210 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1545574b72a0001, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 669261 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1
   [junit4]   2> 669262 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3d76e4bb{/,null,AVAILABLE}
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@39276db6{HTTP/1.1}{127.0.0.1:58104}
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.Server Started @671250ms
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores,
 
solr.data.dir=hdfs://localhost:42039/hdfs__localhost_42039__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.5_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001_tempDir-002_control_data,
 hostPort=58104}
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001'
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 669264 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 669265 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669265 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669266 INFO  (zkCallback-664-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@526b638c 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669266 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669267 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669267 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 669267 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/solr.xml
   [junit4]   2> 669277 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores
   [junit4]   2> 669278 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 60570546
   [junit4]   2> 669278 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001]
   [junit4]   2> 669278 WARN  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/lib
   [junit4]   2> 669278 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37869/solr
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 669279 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 669280 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 669281 INFO  (zkCallback-667-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@769b5d63 
name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669281 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 669281 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 669282 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.ZkController Added new OnReconnect listener 
org.apache.solr.cloud.ZkController$6@27d4653f
   [junit4]   2> 669282 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 669284 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13e9dc27 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 669284 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 669286 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 669289 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 669292 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 669293 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 669293 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 669294 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 669295 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 669295 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 669296 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 669296 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:58104_
   [junit4]   2> 669296 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:58104_
   [junit4]   2> 669297 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 669297 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 669298 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 669298 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/95795451859173380-127.0.0.1:58104_-n_0000000000
   [junit4]   2> 669298 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:58104_
   [junit4]   2> 669298 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 669299 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer Overseer 
(id=95795451859173380-127.0.0.1:58104_-n_0000000000) starting
   [junit4]   2> 669300 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 669302 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 669302 INFO  
(OverseerCollectionConfigSetProcessor-95795451859173380-127.0.0.1:58104_-n_0000000000)
 [n:127.0.0.1:58104_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 669303 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 669303 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 669314 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 669314 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 669314 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores
   [junit4]   2> 669315 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{collection=control_collection, dataDir=data/, loadOnStartup=true, 
coreNodeName=, schema=schema.xml, configSetProperties=configsetprops.json, 
name=collection1, shard=, transient=false, config=solrconfig.xml}
   [junit4]   2> 669315 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Found core collection1 
in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1
   [junit4]   2> 669315 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 669316 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 669316 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 669317 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection control_collection not visible yet, but flagging it so a watch is 
registered when it becomes visible
   [junit4]   2> 669317 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader addZkWatch [control_collection]
   [junit4]   2> 669318 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"} current state version: 0
   [junit4]   2> 669318 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2
   [junit4]   2> 669318 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"}
   [junit4]   2> 669318 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 669318 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:58104_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 669318 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 669319 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 669319 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 669320 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 670319 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 670319 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1'
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 670320 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 670322 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 670327 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 670336 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 670375 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 670389 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 670540 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 670541 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 670542 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 670544 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 670556 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2
   [junit4]   2> 670556 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 670556 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 670562 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:42039/solr_hdfs_home
   [junit4]   2> 670562 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 670562 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 670562 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a3ce4
   [junit4]   2> 670562 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 670594 WARN  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds 
and try again.
   [junit4]   2> 675756 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 675757 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 675773 WARN  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 675774 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 675782 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 675782 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 675782 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 675795 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 675795 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 675795 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 676062 INFO  (IPC Server handler 8 on 42039) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39729 is 
added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-962b23fe-4150-4195-9bc3-7ec495b4eb62:NORMAL:127.0.0.1:39729|RBW],
 
ReplicaUnderConstruction[[DISK]DS-3713a927-1132-4473-b54e-1b9bd55f75e1:NORMAL:127.0.0.1:40379|RBW]]}
 size 71
   [junit4]   2> 676063 INFO  (IPC Server handler 0 on 42039) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40379 is 
added to blk_1073741825_1001 size 71
   [junit4]   2> 676472 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ae3cb74); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 676472 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 676474 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58104_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 676478 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 676478 WARN  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 676480 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676481 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676482 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676483 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 676486 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/ping,/admin/mbeans,/admin/logging,standard,/schema,/admin/segments,/admin/file,/get,/admin/threads,/dump,/admin/plugins,/update/json,/admin/system,/config,/update/csv,/update,/admin/properties,/update/json/docs,/admin/luke,/replication
   [junit4]   2> 676487 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 676490 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 676490 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
tlogDfsReplication=2
   [junit4]   2> 676508 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 676508 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 676509 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=40, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=20.3798828125, 
floorSegmentMB=1.7177734375, forceMergeDeletesPctAllowed=8.77114800030406, 
segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.26048406662050977
   [junit4]   2> 676565 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:42039/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ae3cb74); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 676565 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 676565 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening Searcher@34991081[collection1] main
   [junit4]   2> 676565 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 676566 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 676566 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 676566 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 676566 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 676566 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 676567 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 676567 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 676567 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 676568 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 676570 INFO  
(searcherExecutor-2252-thread-1-processing-s:shard1 r:core_node1 
c:control_collection n:127.0.0.1:58104_ x:collection1) [n:127.0.0.1:58104_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@34991081[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version 
buckets from index
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1532727237595365376
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 
1532727237595365376
   [junit4]   2> 676570 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 676571 INFO  
(coreLoadExecutor-2251-thread-1-processing-n:127.0.0.1:58104_) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 676571 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController Register replica - core:collection1 
address:http://127.0.0.1:58104 collection:control_collection shard:shard1
   [junit4]   2> 676572 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 676575 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/95795451859173380-core_node1-n_0000000000
   [junit4]   2> 676575 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 
and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 676576 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 676577 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58104/collection1/
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SyncStrategy http://127.0.0.1:58104/collection1/ has no replicas
   [junit4]   2> 676579 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 676580 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/control_collection/leaders/shard1/leader after winning as 
/collections/control_collection/leader_elect/shard1/election/95795451859173380-core_node1-n_0000000000
   [junit4]   2> 676582 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 676583 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:58104/collection1/ shard1
   [junit4]   2> 676683 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 676684 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController We are http://127.0.0.1:58104/collection1/ and leader is 
http://127.0.0.1:58104/collection1/
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController No LogReplay needed for core=collection1 
baseURL=http://127.0.0.1:58104
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController publishing state=active
   [junit4]   2> 676685 INFO  (coreZkRegister-2245-thread-1-processing-s:shard1 
r:core_node1 c:control_collection n:127.0.0.1:58104_ x:collection1) 
[n:127.0.0.1:58104_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 676690 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"} current state version: 3
   [junit4]   2> 676690 INFO  
(OverseerStateUpdate-95795451859173380-127.0.0.1:58104_-n_0000000000) 
[n:127.0.0.1:58104_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:58104_",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:58104"}
   [junit4]   2> 676792 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 676821 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676821 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676823 INFO  (zkCallback-670-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@66359e2f 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676823 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676823 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676824 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 676826 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 676883 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores/collection1
   [junit4]   2> 676883 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001
   [junit4]   2> 676884 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 676890 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6f653c16{/,null,AVAILABLE}
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@76f5a4c4{HTTP/1.1}{127.0.0.1:38297}
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.e.j.s.Server Started @678877ms
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=38297, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores,
 
solr.data.dir=hdfs://localhost:42039/hdfs__localhost_42039__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.5_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml}
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001'
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 676891 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 676892 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676892 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676893 INFO  (zkCallback-671-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3f9bf9cb 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676894 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676894 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676895 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 676895 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/solr.xml
   [junit4]   2> 676905 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/cores
   [junit4]   2> 676905 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 582200905
   [junit4]   2> 676905 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001]
   [junit4]   2> 676905 WARN  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_65ED4E6690CA05AE-001/shard-1-001/lib
   [junit4]   2> 676905 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37869/solr
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 676906 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 676909 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 676913 INFO  (zkCallback-674-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@781db53a 
name:ZooKeeperConnection Watcher:127.0.0.1:37869 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676913 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 676913 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 676914 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.ZkController Added new OnReconnect listener 
org.apache.solr.cloud.ZkController$6@6e2a3ac2
   [junit4]   2> 676917 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 676923 INFO  
(zkCallback-675-thread-1-processing-n:127.0.0.1:38297_) [n:127.0.0.1:38297_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2cfbad8c 
name:ZooKeeperConnection Watcher:127.0.0.1:37869/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 676923 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 676927 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 677930 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38297_
   [junit4]   2> 677930 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:38297_
   [junit4]   2> 677931 INFO  
(zkCallback-675-thread-1-processing-n:127.0.0.1:38297_) [n:127.0.0.1:38297_    
] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [1])
   [junit4]   2> 677931 INFO  
(zkCallback-668-thread-1-processing-n:127.0.0.1:58104_) [n:127.0.0.1:58104_    
] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [1])
   [junit4]   2> 677931 INFO  (zkCallback-670-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [1])
   [junit4]   2> 677933 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 677933 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/95795451859173384-127.0.0.1:38297_-n_0000000001
   [junit4]   2> 677933 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/95795451859173380-127.0.0.1:58104_-n_0000000000 to 
know if I could be the leader
   [junit4]   2> 677966 INFO  
(TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[65ED4E6690CA05AE]) 
[n:127.0.0.1:38297_    ] o.a.s.c.CoreContainer Security conf doesn't exist.

[...truncated too long message...]

p/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2465c40e),segFN=segments_i,generation=18}
   [junit4]   2>        
commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2465c40e),segFN=segments_j,generation=19}
   [junit4]   2> 2834329 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.c.SolrDeletionPolicy newest commit generation = 19
   [junit4]   2> 2834330 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.s.SolrIndexSearcher Opening Searcher@3fbd4681[collection1] main
   [junit4]   2> 2834331 INFO  (searcherExecutor-10700-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@3fbd4681[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_a(5.5.0):c2)
 Uninverting(_b(5.5.0):c1)))}
   [junit4]   2> 2834332 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2834332 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null 
params={}{commit=} 0 15
   [junit4]   2> 2834333 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={wt=xml&q=id:ZZZ} hits=1 status=0 QTime=0
   [junit4]   2> 2834334 INFO  
(TEST-DirectUpdateHandlerTest.testDeleteRollback-seed#[65ED4E6690CA05AE]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testDeleteRollback
   [junit4]   2> 2834334 INFO  
(SUITE-DirectUpdateHandlerTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2834334 INFO  
(SUITE-DirectUpdateHandlerTest-seed#[65ED4E6690CA05AE]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=2104271494
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5f931286
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.u.DirectUpdateHandler2 closing 
DirectUpdateHandler2{commits=2,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=1,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 
0 - closing IndexWriter
   [junit4]   2> 2834334 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with 
IndexWriterCloser
   [junit4]   2> 2834335 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockFSDirectoryFactory - 
2 directories currently being tracked
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 2834343 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001/index
   [junit4]   2> 2834346 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001;done=false>>]
   [junit4]   2> 2834346 INFO  (coreCloseExecutor-10704-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001/init-core-data-001
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build/solr-core/test/J2/temp/solr.update.DirectUpdateHandlerTest_65ED4E6690CA05AE-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): 
{id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))},
 docValues:{}, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, 
locale=lv-LV, timezone=Eire
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.7.0_80 (64-bit)/cpus=4,threads=1,free=96008288,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [ConfigSetsAPITest, 
TestMiniSolrCloudCluster, HardAutoCommitTest, XmlUpdateRequestHandlerTest, 
TestChildDocTransformer, TestZkChroot, TestMaxScoreQueryParser, 
TestBulkSchemaAPI, BlockDirectoryTest, SolrTestCaseJ4Test, 
TestPerFieldSimilarity, TestRequestStatusCollectionAPI, PrimitiveFieldTypeTest, 
TestCollationField, TestCollapseQParserPlugin, SpatialHeatmapFacetsTest, 
RecoveryAfterSoftCommitTest, TestDefaultSearchFieldResource, 
LeaderInitiatedRecoveryOnShardRestartTest, TestIndexSearcher, 
SuggesterWFSTTest, HttpPartitionTest, CircularListTest, 
StatelessScriptUpdateProcessorFactoryTest, TestJmxIntegration, 
TestCoreDiscovery, SolrCoreCheckLockOnStartupTest, CustomCollectionTest, 
TestXIncludeConfig, TestTrackingShardHandlerFactory, DateMathParserTest, 
DistributedQueueTest, TestSolrDeletionPolicy1, RegexBoostProcessorTest, 
TestSearchPerf, ZkStateReaderTest, HdfsChaosMonkeySafeLeaderTest, 
TestUniqueKeyFieldResource, TestGroupingSearch, TestSchemaResource, 
DeleteReplicaTest, TestSweetSpotSimilarityFactory, TestCharFilters, 
CurrencyFieldXmlFileTest, TestWriterPerf, HdfsSyncSliceTest, 
DataDrivenBlockJoinTest, TestFieldCollectionResource, 
HdfsWriteToMultipleCollectionsTest, SearchHandlerTest, UnloadDistributedZkTest, 
TestDistribIDF, HdfsLockFactoryTest, TestNamedUpdateProcessors, 
TestAnalyzeInfixSuggestions, NoCacheHeaderTest, TestJmxMonitoredMap, 
TestInfoStreamLogging, TestJettySolrRunner, TestSolr4Spatial2, 
ShowFileRequestHandlerTest, TestDistributedMissingSort, BitVectorTest, 
FullSolrCloudDistribCmdsTest, CoreAdminHandlerTest, 
HdfsBasicDistributedZk2Test, PluginInfoTest, TestCloudSchemaless, 
TestExclusionRuleCollectionAccess, TestIndexingPerformance, TestReload, 
SegmentsInfoRequestHandlerTest, RequestHandlersTest, AtomicUpdatesTest, 
SaslZkACLProviderTest, LukeRequestHandlerTest, RestartWhileUpdatingTest, 
CursorMarkTest, CoreMergeIndexesAdminHandlerTest, TestMiniSolrCloudClusterSSL, 
TestStressLiveNodes, RulesTest, TestFieldSortValues, 
TestClassicSimilarityFactory, TestTrieFacet, 
TestDistributedStatsComponentCardinality, TestBulkSchemaConcurrent, 
DistribCursorPagingTest, DistributedFacetPivotSmallTest, 
OutOfBoxZkACLAndCredentialsProvidersTest, TestLRUStatsCache, 
TermVectorComponentDistributedTest, TestTolerantSearch, 
BasicDistributedZk2Test, OverseerTest, RecoveryZkTest, ZkSolrClientTest, 
AutoCommitTest, TestDistributedGrouping, TestHashPartitioner, TestJoin, 
SolrCoreTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, 
BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, 
DirectUpdateHandlerTest]
   [junit4] Completed [327/572 (3!)] on J2 in 14.12s, 7 tests, 1 failure <<< 
FAILURES!

[...truncated 791 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:757: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:694: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/solr/common-build.xml:534:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/lucene/common-build.xml:1477:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.5/lucene/common-build.xml:1033:
 There were test failures: 572 suites (7 ignored), 2290 tests, 1 suite-level 
error, 1 error, 1 failure, 34 ignored (18 assumptions) [seed: 65ED4E6690CA05AE]

Total time: 176 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to