[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 102 - Still Failing

[Apache Jenkins Server]

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/102/

2 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test

Error Message:
document count mismatch.  control=9806 sum(shards)=9810 cloudClient=9810

Stack Trace:
java.lang.AssertionError: document count mismatch.  control=9806 
sum(shards)=9810 cloudClient=9810
        at 
__randomizedtesting.SeedInfo.seed([846E908F1F1D281B:C3AAF55B1E145E3]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1323)
        at 
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:228)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=206595, name=collection5, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=206595, name=collection5, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:58594/gitn/n: collection already exists: 
awholynewstresscollection_collection5_3
        at __randomizedtesting.SeedInfo.seed([846E908F1F1D281B]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:403)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:356)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1228)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:998)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:934)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987)




Build Log:
[...truncated 12663 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/init-core-data-001
   [junit4]   2> 4060684 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 4060684 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_ur/y
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4060731 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4060738 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4060740 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 4060749 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_44105_hdfs____fz6asg/webapp
   [junit4]   2> 4061050 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44105
   [junit4]   2> 4061140 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4061141 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 4061153 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_37490_datanode____r5ymz2/webapp
   [junit4]   2> 4061568 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37490
   [junit4]   2> 4061648 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4061648 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 4061657 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_55557_datanode____.su54ma/webapp
   [junit4]   2> 4061702 INFO  (IPC Server handler 3 on 41362) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-bcb75f09-45bf-4282-8c10-82091af374ee node 
DatanodeRegistration(127.0.0.1:44537, 
datanodeUuid=08231ddd-1312-4df7-a24b-6339432c6f63, infoPort=58362, 
infoSecurePort=0, ipcPort=33447, 
storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 4061703 INFO  (IPC Server handler 3 on 41362) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-217c13fb-bda2-4aaa-adc2-878d3ebdedf5 node 
DatanodeRegistration(127.0.0.1:44537, 
datanodeUuid=08231ddd-1312-4df7-a24b-6339432c6f63, infoPort=58362, 
infoSecurePort=0, ipcPort=33447, 
storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 1 msecs
   [junit4]   2> 4062052 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55557
   [junit4]   2> 4062131 INFO  (IPC Server handler 2 on 41362) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-cf252536-d004-484c-b21a-14ea4e56d740 node 
DatanodeRegistration(127.0.0.1:56172, 
datanodeUuid=4a22ecca-fa6e-406a-9393-d319c0faa40e, infoPort=56408, 
infoSecurePort=0, ipcPort=38987, 
storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 4062131 INFO  (IPC Server handler 2 on 41362) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-f2d8fec2-a1aa-4ea3-b8ea-e430289b3126 node 
DatanodeRegistration(127.0.0.1:56172, 
datanodeUuid=4a22ecca-fa6e-406a-9393-d319c0faa40e, infoPort=56408, 
infoSecurePort=0, ipcPort=38987, 
storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 4062213 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4062213 INFO  (Thread-65688) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4062213 INFO  (Thread-65688) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 4062313 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:34604
   [junit4]   2> 4062313 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062313 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062316 INFO  (zkCallback-29608-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@40dbe2a2 
name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062316 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062316 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062316 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4062320 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062320 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062321 INFO  (zkCallback-29609-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@22684b6c 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062321 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062321 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062321 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4062322 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4062323 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4062324 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4062325 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 4062325 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4062326 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 4062326 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4062327 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4062327 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4062328 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 4062328 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4062329 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 4062329 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4062330 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 4062330 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4062331 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4062331 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4062332 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4062332 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4062333 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4062333 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4062334 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4062334 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4062334 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 4062335 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4062400 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1
   [junit4]   2> 4062401 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 4062402 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@8f55469{/_ur/y,null,AVAILABLE}
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@6eadff4{HTTP/1.1,[http/1.1]}{127.0.0.1:38122}
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.Server Started @4066260ms
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:41362/hdfs__localhost_41362__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001_tempDir-002_control_data,
 hostContext=/_ur/y, hostPort=38122, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores}
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001'
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4062403 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4062404 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062404 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062405 INFO  (zkCallback-29610-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@238704a2 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062405 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062406 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062406 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 4062406 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/solr.xml
   [junit4]   2> 4062410 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores
   [junit4]   2> 4062410 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 241842919
   [junit4]   2> 4062410 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001]
   [junit4]   2> 4062410 WARN  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/lib
   [junit4]   2> 4062411 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4062411 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34604/solr
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062412 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062413 INFO  (zkCallback-29613-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@24b432a4 
name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062413 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062414 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062414 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$31/1456695046@23a20e6c
   [junit4]   2> 4062415 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 4062415 INFO  
(zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@32e7fbeb 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062415 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 4062416 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4062417 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 4062419 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 4062420 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 4062421 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 4062422 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4062423 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4062423 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 4062424 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4062424 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4062425 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 4062425 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 4062426 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4062427 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 4062427 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4062428 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.LeaderElector Joined leadership 
election with path: 
/overseer_elect/election/96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000
   [junit4]   2> 4062428 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerElectionContext I am going to 
be the leader 127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062428 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 4062429 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Overseer 
(id=96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) starting
   [junit4]   2> 4062430 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 4062433 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4062433 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Starting to work on the main 
queue
   [junit4]   2> 4062433 INFO  
(OverseerCollectionConfigSetProcessor-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000)
 [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 4062433 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062434 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062434 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 4062435 INFO  
(zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4062442 INFO  
(zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 4062452 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 4062452 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 4062452 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores
   [junit4]   2> 4062453 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 4062453 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Found core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1
   [junit4]   2> 4062453 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions
   [junit4]   2> 4062454 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4062454 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 4062454 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 4062454 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 4062454 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection control_collection not visible yet, but 
flagging it so a watch is registered when it becomes visible
   [junit4]   2> 4062455 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y";,
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 4062455 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y";,
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4062455 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 4062455 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 4062456 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4062456 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 4062456 INFO  
(zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4063456 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4063456 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4063456 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4063456 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 4063457 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4063457 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1'
   [junit4]   2> 4063457 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4063457 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4063460 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.Config 
loaded config solrconfig.xml with version 0 
   [junit4]   2> 4063465 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4063467 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
   [junit4]   2> 4063479 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4063482 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4063612 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4063613 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4063613 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4063635 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4063661 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 4063661 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 4063661 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4063661 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:41362/solr_hdfs_home
   [junit4]   2> 4063662 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication 
disabled
   [junit4]   2> 4063662 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 4063662 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@207b145c
   [junit4]   2> 4063662 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4063789 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4063790 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4063806 WARN  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 4063806 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4063812 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] 
with direct memory allocation set to [true]
   [junit4]   2> 4063812 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, 
slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 4063812 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS 
BlockCache
   [junit4]   2> 4063823 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 4063823 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4063824 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@690664ab
   [junit4]   2> 4063887 INFO  (IPC Server handler 1 on 41362) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44537 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-cf252536-d004-484c-b21a-14ea4e56d740:NORMAL:127.0.0.1:56172|RBW],
 
ReplicaUC[[DISK]DS-bcb75f09-45bf-4282-8c10-82091af374ee:NORMAL:127.0.0.1:44537|FINALIZED]]}
 size 0
   [junit4]   2> 4063888 INFO  (IPC Server handler 2 on 41362) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56172 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-cf252536-d004-484c-b21a-14ea4e56d740:NORMAL:127.0.0.1:56172|RBW],
 
ReplicaUC[[DISK]DS-bcb75f09-45bf-4282-8c10-82091af374ee:NORMAL:127.0.0.1:44537|FINALIZED]]}
 size 0
   [junit4]   2> 4063891 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26503395); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4063891 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4063892 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:38122__ur%2Fy 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 4063894 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 4063895 WARN  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler 
{type = requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 4063896 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063897 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063897 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063898 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063900 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/dump,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 4063900 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4063900 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 4063900 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 4063900 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: 
tlogDfsReplication=2
   [junit4]   2> 4063906 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 
15000ms; 
   [junit4]   2> 4063907 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4063907 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=10, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=94.88671875, 
floorSegmentMB=0.82421875, forceMergeDeletesPctAllowed=17.85003723179897, 
segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 4063917 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: 
num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26503395); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4063917 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4063917 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@50fb330[collection1] 
main]
   [junit4]   2> 4063918 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 4063918 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4063918 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based 
storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4063919 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO 
with znodeBase: /configs/conf1
   [junit4]   2> 4063919 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 4063919 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4063919 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 4063919 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4063920 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 4063920 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4063922 INFO  
(searcherExecutor-14369-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@50fb330[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4063922 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 4063923 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
65536 version buckets from index
   [junit4]   2> 4063923 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed 
version bucket highest value from index
   [junit4]   2> 4063923 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1538227861207384064
   [junit4]   2> 4063925 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with 
highest version 1538227861207384064
   [junit4]   2> 4063925 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 4063926 INFO  
(coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 4063928 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController Register replica - core:collection1 
address:http://127.0.0.1:38122/_ur/y collection:control_collection shard:shard1
   [junit4]   2> 4063928 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4063930 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/96139241213460484-core_node1-n_0000000000
   [junit4]   2> 4063930 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process 
for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 4063931 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to 
continue.
   [junit4]   2> 4063931 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try 
and sync
   [junit4]   2> 4063931 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:38122/_ur/y/collection1/
   [junit4]   2> 4063931 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 4063931 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 4063931 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:38122/_ur/y/collection1/ 
has no replicas
   [junit4]   2> 4063932 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 4063933 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader 
registration node /collections/control_collection/leaders/shard1/leader after 
winning as 
/collections/control_collection/leader_elect/shard1/election/96139241213460484-core_node1-n_0000000000
   [junit4]   2> 4063934 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:38122/_ur/y/collection1/ shard1
   [junit4]   2> 4063934 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 4063955 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.s.i.CloudSolrClient Final constructed zkHost string: 
127.0.0.1:34604/solr
   [junit4]   2> 4063956 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4063956 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4063956 INFO  (zkCallback-29618-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6d2ac458 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4063957 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4063957 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4063957 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4063957 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 4063957 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4063958 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 4064017 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores/collection1
   [junit4]   2> 4064017 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001
   [junit4]   2> 4064018 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 4064019 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@12372532{/_ur/y,null,AVAILABLE}
   [junit4]   2> 4064020 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@8d8bfb5{HTTP/1.1,[http/1.1]}{127.0.0.1:35908}
   [junit4]   2> 4064021 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.e.j.s.Server Started @4067878ms
   [junit4]   2> 4064021 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:41362/hdfs__localhost_41362__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/_ur/y, hostPort=35908, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores}
   [junit4]   2> 4064021 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 4064021 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001'
   [junit4]   2> 4064022 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4064022 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4064022 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4064023 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4064023 INFO  (zkCallback-29619-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3652a6ef 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064023 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4064024 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4064025 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 4064025 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/solr.xml
   [junit4]   2> 4064028 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores
   [junit4]   2> 4064028 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 214033527
   [junit4]   2> 4064028 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001]
   [junit4]   2> 4064029 WARN  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/lib
   [junit4]   2> 4064029 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34604/solr
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4064030 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4064031 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4064032 INFO  (zkCallback-29622-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@214ba213 
name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064032 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4064032 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4064033 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$31/1456695046@692aa909
   [junit4]   2> 4064033 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 4064034 INFO  
(zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@11050654 
name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064034 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 4064035 INFO  
(zkCallback-29614-thread-2-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064035 INFO  (zkCallback-29618-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 4064039 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4064040 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 4064040 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 4064041 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4064041 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.LeaderElector Joined leadership 
election with path: 
/overseer_elect/election/96139241213460488-127.0.0.1:35908__ur%2Fy-n_0000000001
   [junit4]   2> 4064042 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000 
to know if I could be the leader
   [junit4]   2> 4064042 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:35908__ur%2Fy as DOWN
   [junit4]   2> 4064043 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35908__ur%2Fy"} current state 
version: 2
   [junit4]   2> 4064043 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.NodeMutator DownNode state invoked 
for node: 127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4064084 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController We are 
http://127.0.0.1:38122/_ur/y/collection1/ and leader is 
http://127.0.0.1:38122/_ur/y/collection1/
   [junit4]   2> 4064084 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 
baseURL=http://127.0.0.1:38122/_ur/y
   [junit4]   2> 4064085 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 4064085 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 4064085 INFO  
(coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading 
it from system property
   [junit4]   2> 4064086 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   
"dataDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y";,
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   
"ulogDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/tlog"}
 current state version: 2
   [junit4]   2> 4064087 INFO  
(OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=4 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   
"dataDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y";,
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   
"ulogDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/tlog"}
   [junit4]   2> 4064189 INFO  (zkCallback-29618-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 4064189 INFO  
(zkCallback-29614-thread-2-processing-n:127.0.0.1:38122__ur%2Fy) 
[n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064189 INFO  
(zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4065043 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4065044 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4065044 INFO  (zkCallback-29618-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [1])
   [junit4]   2> 4065044 INFO  
(zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4065045 INFO  
(zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) 
[n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper

[...truncated too long message...]

odAccessorImpl.invoke0(Native Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
   [junit4]   2>        ... 54 more
   [junit4]   2> 4959295 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[846E908F1F1D281B]-worker) [    
] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jun 26, 2016 7:28:19 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 34 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): 
{other_tl1=BlockTreeOrds(blocksize=128), 
range_facet_l_dv=Lucene50(blocksize=128), 
_version_=BlockTreeOrds(blocksize=128), multiDefault=FST50, a_t=FST50, 
intDefault=BlockTreeOrds(blocksize=128), a_i1=FST50, 
id=Lucene50(blocksize=128), range_facet_i_dv=FST50, 
text=Lucene50(blocksize=128), range_facet_l=FST50, timestamp=FST50}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), 
range_facet_i_dv=DocValuesFormat(name=Memory), 
timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=317, 
maxMBSortInHeap=6.749882700199259, 
sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=zh-HK, timezone=MET
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=76119152,total=469237760
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemaManager, 
TestCloudBackupRestore, HdfsChaosMonkeySafeLeaderTest, 
CdcrVersionReplicationTest, DeleteStatusTest, 
TestHighFrequencyDictionaryFactory, TestBadConfig, RAMDirectoryFactoryTest, 
TestSortingResponseWriter, TestArbitraryIndexDir, TestConfig, 
TestPivotHelperCode, TestRecoveryHdfs, CloudExitableDirectoryReaderTest, 
DocExpirationUpdateProcessorFactoryTest, LeaderInitiatedRecoveryOnCommitTest, 
PreAnalyzedFieldTest, JsonLoaderTest, TestRangeQuery, SyncSliceTest, 
MergeStrategyTest, SolrRequestParserTest, PrimUtilsTest, 
DistributedFacetPivotSmallAdvancedTest, TestFunctionQuery, 
TestIBSimilarityFactory, IndexSchemaTest, TestDistribDocBasedVersion, 
BasicDistributedZkTest, ResourceLoaderTest, CollectionTooManyReplicasTest, 
DefaultValueUpdateProcessorTest, CurrencyFieldOpenExchangeTest, 
TestRebalanceLeaders, TestSubQueryTransformerCrossCore, CopyFieldTest, 
TestSizeLimitedDistributedMap, TestSolrFieldCacheMBean, TestScoreJoinQPScore, 
TestCSVLoader, BigEndianAscendingWordDeserializerTest, PolyFieldTest, 
DistributedExpandComponentTest, TestFaceting, AnalysisAfterCoreReloadTest, 
TestStressLiveNodes, TestAtomicUpdateErrorCases, OutputWriterTest, 
ReplicationFactorTest, TestSchemaVersionResource, TestFastOutputStream, 
DateFieldTest, ForceLeaderTest, TestLazyCores, 
ConcurrentDeleteAndCreateCollectionTest, TestDistributedSearch, 
HdfsRecoverLeaseTest, XsltUpdateRequestHandlerTest, EnumFieldTest, 
CreateCollectionCleanupTest, BlockJoinFacetSimpleTest, 
TestNonDefinedSimilarityFactory, CheckHdfsIndexTest, TestRemoteStreaming, 
PathHierarchyTokenizerFactoryTest, TestLMDirichletSimilarityFactory, 
TestLeaderElectionZkExpiry, SimpleMLTQParserTest, TestMiniSolrCloudClusterSSL, 
BlobRepositoryCloudTest, TestRealTimeGet, TestFilteredDocIdSet, 
DistributedQueryComponentCustomSortTest, TestCollationFieldDocValues, 
TestPseudoReturnFields, TestAnalyzedSuggestions, FileBasedSpellCheckerTest, 
TestAddFieldRealTimeGet, AlternateDirectoryTest, TestCustomDocTransformer, 
TestDynamicFieldCollectionResource, DeleteLastCustomShardedReplicaTest, 
HdfsBasicDistributedZk2Test, ExternalFileFieldSortTest, HLLUtilTest, 
PingRequestHandlerTest, TestSimpleQParserPlugin, AtomicUpdatesTest, 
TestReplicationHandler, TestDynamicLoading, TestStressLucene, 
TestSchemaNameResource, BasicAuthIntegrationTest, TestConfigSetsAPIExclusivity, 
SuggestComponentTest, TestRTimerTree, TestRandomFaceting, TestFieldResource, 
AsyncCallRequestStatusResponseTest, TestJoin, TestDocTermOrds, 
UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, 
ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, 
LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, 
ShardRoutingCustomTest, TestHashPartitioner, 
DistributedSpellCheckComponentTest, TestStressReorder, TestReload, 
TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, TestSolr4Spatial, 
StatsComponentTest, ConvertedLegacyTest, TestSort, DirectUpdateHandlerTest, 
SoftAutoCommitTest, TestExtendedDismaxParser, CoreAdminHandlerTest, 
NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, 
QueryEqualityTest, TestSolrDeletionPolicy1, TestSurroundQueryParser, 
DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, 
DocumentAnalysisRequestHandlerTest, TermsComponentTest, TestValueSourceCache, 
MoreLikeThisHandlerTest, FastVectorHighlighterTest, RegexBoostProcessorTest, 
TestJmxIntegration, JSONWriterTest, MBeansHandlerTest, 
TestPHPSerializedResponseWriter, TestComponentsName, HighlighterConfigTest, 
SOLR749Test, TestQuerySenderListener, ResponseLogComponentTest, 
BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, TestDocSet, 
TestBinaryField, MinimalSchemaTest, TestElisionMultitermQuery, 
TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, DirectSolrConnectionTest, 
TestLuceneMatchVersion, TestPhraseSuggestions, SynonymTokenizerTest, 
TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, 
TestFastWriter, URLClassifyProcessorTest, PluginInfoTest, TestSolrJ, 
TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, 
SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, 
DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, 
DistributedIntervalFacetingTest, BaseCdcrDistributedZkTest, 
CdcrReplicationDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, 
HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [489/617 (2!)] on J0 in 733.14s, 1 test, 1 error <<< 
FAILURES!

[...truncated 405 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:530:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1427:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984:
 There were test failures: 617 suites (10 ignored), 2597 tests, 1 error, 1 
failure, 32 ignored (17 assumptions) [seed: 846E908F1F1D281B]

Total time: 291 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org