Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/3/
3 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Error from server at http://127.0.0.1:47701: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000212 Stack Trace: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47701: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000212 at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1547) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1602) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:338) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:175) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest Error Message: ObjectTracker found 2 object(s) that were not released!!! [HdfsTransactionLog, HdfsTransactionLog] Stack Trace: java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [HdfsTransactionLog, HdfsTransactionLog] at __randomizedtesting.SeedInfo.seed([C90E1172AEA8FFC5]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup Error Message: Failed to create backup Stack Trace: java.lang.AssertionError: Failed to create backup at __randomizedtesting.SeedInfo.seed([C90E1172AEA8FFC5:8885311789160C8A]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.handler.CheckBackupStatus.fetchStatus(CheckBackupStatus.java:50) at org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup(TestReplicationHandlerBackup.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 11157 lines...] [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/init-core-data-001 [junit4] 2> 308907 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) [junit4] 2> 308907 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / [junit4] 2> 310530 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [junit4] 1> Formatting using clusterid: testClusterID [junit4] 2> 312383 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties [junit4] 2> 312645 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog [junit4] 2> 312653 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 312862 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 312941 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_37675_hdfs____.21n5pi/webapp [junit4] 2> 313138 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 314062 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37675 [junit4] 2> 315609 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 315624 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 315634 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40359_datanode____2gjz42/webapp [junit4] 2> 315951 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 316345 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40359 [junit4] 2> 316897 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 316899 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 316914 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41306_datanode____.knha9p/webapp [junit4] 2> 317113 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 317901 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[C90E1172AEA8FFC5]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41306 [junit4] 2> 318978 INFO (IPC Server handler 5 on 49077) [ ] BlockStateChange BLOCK* processReport: from storage DS-d333543c-9aaf-463d-b8ce-1267ca08958c node DatanodeRegistration(127.0.0.1, datanodeUuid=7770c481-f315-4d20-a575-cd4c458a0307, infoPort=41306, ipcPort=49312, storageInfo=lv=-56;cid=testClusterID;nsid=155639811;c=0), blocks: 0, hasStaleStorages: true, processing time: 8 msecs [junit4] 2> 318978 INFO (IPC Server handler 6 on 49077) [ ] BlockStateChange BLOCK* processReport: from storage DS-58f0594a-5e1f-4f44-b17c-95432095646a node DatanodeRegistration(127.0.0.1, datanodeUuid=31fdf2d8-bbe9-421f-af30-6f0e8c6efb19, infoPort=40359, ipcPort=38566, storageInfo=lv=-56;cid=testClusterID;nsid=155639811;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs [junit4] 2> 318988 INFO (IPC Server handler 5 on 49077) [ ] BlockStateChange BLOCK* processReport: from storage DS-989f0054-169f-4442-8766-99b1111879c6 node DatanodeRegistration(127.0.0.1, datanodeUuid=7770c481-f315-4d20-a575-cd4c458a0307, infoPort=41306, ipcPort=49312, storageInfo=lv=-56;cid=testClusterID;nsid=155639811;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 318992 INFO (IPC Server handler 6 on 49077) [ ] BlockStateChange BLOCK* processReport: from storage DS-0ec274c0-0306-41b3-be93-1cea7e250d40 node DatanodeRegistration(127.0.0.1, datanodeUuid=31fdf2d8-bbe9-421f-af30-6f0e8c6efb19, infoPort=40359, ipcPort=38566, storageInfo=lv=-56;cid=testClusterID;nsid=155639811;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 320379 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 320388 INFO (Thread-547) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 320388 INFO (Thread-547) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 320484 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkTestServer start zk server on port:48750 [junit4] 2> 320485 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320485 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320507 INFO (zkCallback-245-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@577a24a0 name:ZooKeeperConnection Watcher:127.0.0.1:48750 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320516 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320517 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320517 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 320529 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320536 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320548 INFO (zkCallback-246-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@654ff30e name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320549 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320549 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320549 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 320550 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 320551 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 320551 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 320552 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 320552 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 320553 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 320553 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 320564 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 320564 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 320566 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 320566 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 320567 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 320567 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 320568 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 320568 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 320569 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 320569 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 320570 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 320570 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 320571 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 320571 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 320572 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 320572 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 320573 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 320573 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 320574 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x153d3729fa70001, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 320796 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores/collection1 [junit4] 2> 320797 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 320798 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e0b4f62{/,null,AVAILABLE} [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.ServerConnector Started ServerConnector@718fff8b{HTTP/1.1,[http/1.1]}{127.0.0.1:32872} [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.Server Started @326927ms [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:49077/hdfs__localhost_49077__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001_tempDir-002_control_data, hostContext=/, hostPort=32872, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores} [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93 [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001' [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 320799 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320808 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320832 INFO (zkCallback-247-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@610eedf0 name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320833 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320833 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320841 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 320841 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/solr.xml [junit4] 2> 320853 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores [junit4] 2> 320853 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer New CoreContainer 731343467 [junit4] 2> 320853 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001] [junit4] 2> 320853 WARN (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/lib [junit4] 2> 320854 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48750/solr [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 320855 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320864 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320880 INFO (zkCallback-250-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@c73cdb5 name:ZooKeeperConnection Watcher:127.0.0.1:48750 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320880 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320881 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320888 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x153d3729fa70003, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 320889 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320908 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76570c6b name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320909 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320916 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 320937 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 320945 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 320946 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 320947 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 320948 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 320949 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 320949 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 320950 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 320950 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 320951 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) [junit4] 2> 320951 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 320952 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 320953 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 320953 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95652506363166724-127.0.0.1:32872_-n_0000000000 [junit4] 2> 320953 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32872_ [junit4] 2> 320953 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 320954 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer Overseer (id=95652506363166724-127.0.0.1:32872_-n_0000000000) starting [junit4] 2> 320954 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 320957 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 320961 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 320985 INFO (OverseerCollectionConfigSetProcessor-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations [junit4] 2> 320989 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32872_ [junit4] 2> 320989 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:32872_ [junit4] 2> 321005 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 321008 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1]) [junit4] 2> 321009 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1) [junit4] 2> 321026 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 321026 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 321027 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores [junit4] 2> 321027 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 321027 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores/collection1 [junit4] 2> 321039 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions [junit4] 2> 321045 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 321045 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 321047 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 321053 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:32872";, [junit4] 2> "node_name":"127.0.0.1:32872_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 321053 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:32872";, [junit4] 2> "node_name":"127.0.0.1:32872_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 321053 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 321053 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 321054 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 321065 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0 [junit4] 2> 321065 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:32872_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 322048 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 322048 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection] [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores/collection1' [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 322049 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 322050 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 322088 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 322091 WARN (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 322092 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0 [junit4] 2> 322105 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml [junit4] 2> 322128 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 322226 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 322227 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 322227 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 322229 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 322238 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0 [junit4] 2> 322238 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 322239 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory [junit4] 2> 322268 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:49077/solr_hdfs_home [junit4] 2> 322268 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled [junit4] 2> 322276 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/control-001/cores/collection1], dataDir=[hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/] [junit4] 2> 322276 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@64d775b2 [junit4] 2> 322277 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 322357 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 322373 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index/ [junit4] 2> 322417 WARN (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index... [junit4] 2> 322417 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 322428 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true] [junit4] 2> 322428 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes [junit4] 2> 322428 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache [junit4] 2> 324538 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled [junit4] 2> 324538 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 324538 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=66.3974609375, floorSegmentMB=0.6328125, forceMergeDeletesPctAllowed=25.974173521530467, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 325289 INFO (IPC Server handler 6 on 49077) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45145 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0ec274c0-0306-41b3-be93-1cea7e250d40:NORMAL:127.0.0.1:48039|RBW], ReplicaUnderConstruction[[DISK]DS-989f0054-169f-4442-8766-99b1111879c6:NORMAL:127.0.0.1:45145|FINALIZED]]} size 0 [junit4] 2> 325309 INFO (IPC Server handler 7 on 49077) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48039 is added to blk_1073741825_1001 size 71 [junit4] 2> 325347 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3b45e04); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 325347 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 325366 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 325367 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 325367 WARN (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 325376 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 325377 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 325378 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 325378 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 325381 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file [junit4] 2> 325381 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 325407 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog [junit4] 2> 325407 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2 [junit4] 2> 325423 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/ [junit4] 2> 325461 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; [junit4] 2> 325461 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 325477 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=294325788, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1] [junit4] 2> 325616 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:49077/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3b45e04); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 325616 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 325616 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@44f98176[collection1] main] [junit4] 2> 325616 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection] [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 325617 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 325619 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 325620 INFO (searcherExecutor-578-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@44f98176[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1530440107288428544 [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1530440107288428544 [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 325621 INFO (coreLoadExecutor-577-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 325624 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:32872 collection:control_collection shard:shard1 [junit4] 2> 325625 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 325627 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95652506363166724-core_node1-n_0000000000 [junit4] 2> 325627 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000 [junit4] 2> 325628 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 325628 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 325628 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32872/collection1/ [junit4] 2> 325628 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 325628 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 325628 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:32872/collection1/ has no replicas [junit4] 2> 325629 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 325629 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 325630 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95652506363166724-core_node1-n_0000000000 [junit4] 2> 325633 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32872/collection1/ shard1 [junit4] 2> 325633 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:32872";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 2 [junit4] 2> 325748 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 325897 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:32872/collection1/ and leader is http://127.0.0.1:32872/collection1/ [junit4] 2> 325897 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32872 [junit4] 2> 325897 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 325897 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 325897 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 325909 INFO (coreZkRegister-571-thread-1-processing-n:127.0.0.1:32872_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32872_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1) [junit4] 2> 325937 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:32872";, [junit4] 2> "node_name":"127.0.0.1:32872_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 3 [junit4] 2> 325941 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:32872";, [junit4] 2> "node_name":"127.0.0.1:32872_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 326049 INFO (zkCallback-251-thread-1-processing-n:127.0.0.1:32872_) [n:127.0.0.1:32872_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 326113 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 326125 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 326144 INFO (zkCallback-253-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@316dcb41 name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 326145 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 326145 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 326145 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 326157 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 326157 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 326157 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2 [junit4] 2> 326157 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 326172 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 326192 INFO (zkCallback-254-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f365965 name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 326192 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 326193 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 326220 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"create", [junit4] 2> "name":"collection1", [junit4] 2> "numShards":"5", [junit4] 2> "stateFormat":"2"} current state version: 4 [junit4] 2> 326221 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 326400 INFO (OverseerStateUpdate-95652506363166724-127.0.0.1:32872_-n_0000000000) [n:127.0.0.1:32872_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json [junit4] 2> 326464 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/cores/collection1 [junit4] 2> 326464 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001 [junit4] 2> 326465 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 326468 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a9746fc{/,null,AVAILABLE} [junit4] 2> 326469 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.ServerConnector Started ServerConnector@39417cee{HTTP/1.1,[http/1.1]}{127.0.0.1:43640} [junit4] 2> 326469 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.Server Started @332598ms [junit4] 2> 326470 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:49077/hdfs__localhost_49077__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=43640, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/cores} [junit4] 2> 326470 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93 [junit4] 2> 326470 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001' [junit4] 2> 326470 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 326470 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 326471 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 326488 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 326528 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50b54ab name:ZooKeeperConnection Watcher:127.0.0.1:48750/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 326532 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 326533 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 326564 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 326575 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/solr.xml [junit4] 2> 326579 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/cores [junit4] 2> 326580 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer New CoreContainer 665840227 [junit4] 2> 326580 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001] [junit4] 2> 326580 WARN (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_C90E1172AEA8FFC5-001/shard-1-001/lib [junit4] 2> 326580 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 326581 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 326582 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 326582 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 326582 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48750/solr [junit4] 2> 326582 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 326582 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 326584 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 326589 INFO (zkCallback-258-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@196c5545 name:ZooKeeperConnection Watcher:127.0.0.1:48750 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 326589 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 326590 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 326604 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[C90E1172AEA8FFC5]) [n:127.0.0.1:43640_ ] o.a.s.c.c.ConnectionManager Waiti [...truncated too long message...] dds=15,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0} [junit4] 2> 6188387 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState [junit4] 2> 6188387 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter [junit4] 2> 6188387 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser [junit4] 2> 6188390 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request. [junit4] 2> 6188390 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked [junit4] 2> 6188390 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data/index;done=false>>] [junit4] 2> 6188390 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data/index [junit4] 2> 6188391 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data;done=false>>] [junit4] 2> 6188391 INFO (coreCloseExecutor-11212-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001/solr-instance-002/./collection1/data [junit4] 2> 6188391 INFO (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[C90E1172AEA8FFC5]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c318c5f{/solr,null,UNAVAILABLE} [junit4] 2> 6188398 INFO (SUITE-TestReplicationHandlerBackup-seed#[C90E1172AEA8FFC5]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandlerBackup_C90E1172AEA8FFC5-001 [junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=ar-BH, timezone=Jamaica [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=298829760,total=529006592 [junit4] 2> NOTE: All tests run in this JVM: [ConnectionManagerTest, SliceStateTest, TestSolrIndexConfig, TestExceedMaxTermLength, TestSweetSpotSimilarityFactory, HdfsTlogReplayBufferedWhileIndexingTest, TestSolrQueryParser, DirectUpdateHandlerOptimizeTest, SuggesterWFSTTest, DistribJoinFromCollectionTest, TestOverriddenPrefixQueryForCustomFieldType, TestFieldTypeCollectionResource, BadCopyFieldTest, TestBulkSchemaConcurrent, ClusterStateTest, MultiThreadedOCPTest, TestIndexingPerformance, CleanupOldIndexTest, TestStressRecovery, HighlighterMaxOffsetTest, TestLeaderInitiatedRecoveryThread, BlockDirectoryTest, TestRequestStatusCollectionAPI, FieldMutatingUpdateProcessorTest, XmlUpdateRequestHandlerTest, TestJmxMonitoredMap, TestSortByMinMaxFunction, TestPostingsSolrHighlighter, OverseerTaskQueueTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestFilteredDocIdSet, BlockJoinFacetRandomTest, TestReload, TestLRUStatsCache, CurrencyFieldXmlFileTest, DocValuesMissingTest, DocExpirationUpdateProcessorFactoryTest, TestExtendedDismaxParser, ZkStateWriterTest, SecurityConfHandlerTest, TestSolrDeletionPolicy1, SparseHLLTest, RequestHandlersTest, TestSolrCloudWithKerberosAlt, TestCollectionAPI, TestSha256AuthenticationProvider, HdfsNNFailoverTest, AssignTest, TestConfigSets, SimpleFacetsTest, LeaderInitiatedRecoveryOnCommitTest, TestSchemaManager, TestCloudDeleteByQuery, DirectSolrConnectionTest, DocValuesMultiTest, HdfsRestartWhileUpdatingTest, TestStressReorder, FieldAnalysisRequestHandlerTest, TestReqParamsAPI, SampleTest, TestIndexSearcher, StressHdfsTest, NoCacheHeaderTest, ForceLeaderTest, DateMathParserTest, TestAddFieldRealTimeGet, TestAuthorizationFramework, TestReloadAndDeleteDocs, UpdateParamsTest, TestReversedWildcardFilterFactory, OverseerTest, MergeStrategyTest, AnalyticsMergeStrategyTest, BinaryUpdateRequestHandlerTest, TestRestManager, TestFuzzyAnalyzedSuggestions, TestSolrJ, VMParamsZkACLAndCredentialsProvidersTest, TestSolrConfigHandlerCloud, TestUniqueKeyFieldResource, PreAnalyzedUpdateProcessorTest, BaseCdcrDistributedZkTest, TestGroupingSearch, LeaderElectionTest, TestSolrDynamicMBean, UnloadDistributedZkTest, TestJsonFacets, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, ScriptEngineTest, TestStressUserVersions, HighlighterConfigTest, TestSmileRequest, CdcrUpdateLogTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, TestRandomFaceting, TestZkChroot, AutoCommitTest, TestFaceting, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, HardAutoCommitTest, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, DirectUpdateHandlerTest, ShowFileRequestHandlerTest, SolrIndexSplitterTest, TestCoreDiscovery, SuggesterFSTTest, CoreAdminHandlerTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, TestTrie, TestCSVLoader, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestWordDelimiterFilterFactory, QueryEqualityTest, TestRemoteStreaming, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, TestQueryTypes, TestOmitPositions, DocumentBuilderTest, TermVectorComponentTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestJmxIntegration, ReturnFieldsTest, TestCSVResponseWriter, QueryParsingTest, TestPHPSerializedResponseWriter, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestSolrDeletionPolicy2, TestDocSet, TestBinaryField, TestSearchPerf, TestElisionMultitermQuery, OutputWriterTest, ExternalFileFieldSortTest, SpellPossibilityIteratorTest, TestCharFilters, TestXIncludeConfig, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, TestUtils, TestDocumentBuilder, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, CursorPagingTest, DistributedIntervalFacetingTest, CdcrReplicationDistributedZkTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, SolrXmlInZkTest, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestRequestForwarding, TlogReplayBufferedWhileIndexingTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsRecoveryZkTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, TestClusterStateMutator, ZkStateReaderTest, RulesTest, TestReplicationHandlerBackup] [junit4] Completed [484/579 (3!)] on J2 in 5.12s, 2 tests, 1 failure <<< FAILURES! [...truncated 299 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 1 suite-level error, 1 error, 1 failure, 31 ignored (16 assumptions) [seed: C90E1172AEA8FFC5] Total time: 290 minutes 35 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
