Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/836/

3 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([AA04CF969E3D1668:C21ACC7A7CAD4C26]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([AA04CF969E3D1668:2250F04C30C17B90]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:227)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:108)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR

Error Message:
Captured an uncaught exception in thread: Thread[id=19115, 
name=coreZkRegister-2842-thread-1, state=RUNNABLE, 
group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=19115, name=coreZkRegister-2842-thread-1, 
state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([AA04CF969E3D1668]:0)
        at 
org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
        at 
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
        at 
org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
        at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
        at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
        at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9991 lines...]
   [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/init-core-data-001
   [junit4]   2> 257203 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 257287 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 257335 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 257337 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 257376 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_45897_hdfs____569527/webapp
   [junit4]   2> 257577 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 257818 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45897
   [junit4]   2> 257960 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 257961 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 257975 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_46300_datanode____.xr60h4/webapp
   [junit4]   2> 258097 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 258299 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46300
   [junit4]   2> 258434 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 258435 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 258453 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_49206_datanode____sxilq2/webapp
   [junit4]   2> 258500 INFO  (IPC Server handler 4 on 46921) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-b5b9bd9b-cf1c-43b1-abdd-e141582fee2f node DatanodeRegistration(127.0.0.1, 
datanodeUuid=6af1b9e8-fb77-4dcf-baee-bd8760414e49, infoPort=46300, 
ipcPort=41404, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 258500 INFO  (IPC Server handler 4 on 46921) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-26168be7-fbbf-434c-9e30-746c43226fda node DatanodeRegistration(127.0.0.1, 
datanodeUuid=6af1b9e8-fb77-4dcf-baee-bd8760414e49, infoPort=46300, 
ipcPort=41404, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 258575 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 258777 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49206
   [junit4]   2> 258862 INFO  (IPC Server handler 8 on 46921) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-34cb8d2a-e316-4898-8334-32a445227e96 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=5035c9c7-319b-4c9a-b4bd-19b917299aaf, infoPort=49206, 
ipcPort=55199, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 258862 INFO  (IPC Server handler 8 on 46921) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-3be7ebf7-800b-426d-b9b8-064409480f3f node DatanodeRegistration(127.0.0.1, 
datanodeUuid=5035c9c7-319b-4c9a-b4bd-19b917299aaf, infoPort=49206, 
ipcPort=55199, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 258953 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 258953 INFO  (Thread-1893) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 258953 INFO  (Thread-1893) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 259053 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:41204
   [junit4]   2> 259053 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 259054 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 259062 INFO  (zkCallback-187-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e37eaab 
name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 259062 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 259062 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 259062 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 259067 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 259067 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 259069 INFO  (zkCallback-188-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@e6c4851 name:ZooKeeperConnection 
Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 259069 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 259069 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 259069 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 259072 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 259073 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 259074 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 259076 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 259076 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 259079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 259079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 259081 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 259081 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 259082 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 259083 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 259084 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 259084 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 259085 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 259086 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 259087 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 259087 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 259089 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 259089 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 259091 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 259091 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 259093 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 259093 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 259095 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 259095 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 259384 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1
   [junit4]   2> 259386 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 259388 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@785564fd{/,null,AVAILABLE}
   [junit4]   2> 259388 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@2dc54231{HTTP/1.1}{127.0.0.1:32889}
   [junit4]   2> 259388 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.Server Started @262385ms
   [junit4]   2> 259388 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=32889, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores}
   [junit4]   2> 259389 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 259389 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/'
   [junit4]   2> 259389 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 259389 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 259403 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 259404 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 259406 INFO  (zkCallback-189-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@15819602 
name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 259406 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 259406 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 259408 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 259408 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/solr.xml
   [junit4]   2> 259414 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores
   [junit4]   2> 259414 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1231525329
   [junit4]   2> 259414 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/]
   [junit4]   2> 259414 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/lib
   [junit4]   2> 259414 WARN  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/lib).
   [junit4]   2> 259421 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 259422 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 259423 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 259423 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 259423 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41204/solr
   [junit4]   2> 259423 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 259423 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 259424 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 259435 INFO  (zkCallback-191-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@38828034 
name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 259436 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 259436 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 259438 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 259440 INFO  
(zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@39651718 
name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 259440 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 259442 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 259443 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 259446 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 259448 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 259452 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 259453 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 259455 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 259456 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 259457 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 259458 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:32889_
   [junit4]   2> 259458 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:32889_
   [junit4]   2> 259460 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 259461 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 259462 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 259462 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/94772972084461572-127.0.0.1:32889_-n_0000000000
   [junit4]   2> 259462 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:32889_
   [junit4]   2> 259463 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 259464 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer Overseer 
(id=94772972084461572-127.0.0.1:32889_-n_0000000000) starting
   [junit4]   2> 259465 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 259470 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 259471 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 259471 INFO  
(OverseerCollectionConfigSetProcessor-94772972084461572-127.0.0.1:32889_-n_0000000000)
 [n:127.0.0.1:32889_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 259472 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 259487 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 259487 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 259488 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores
   [junit4]   2> 259488 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 259488 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/
   [junit4]   2> 259489 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 259490 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 259490 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) 
[n:127.0.0.1:32889_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 259491 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 259491 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 259493 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 259494 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:32889";,
   [junit4]   2>   "node_name":"127.0.0.1:32889_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 259495 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:32889";,
   [junit4]   2>   "node_name":"127.0.0.1:32889_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 259495 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 259496 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 259499 INFO  
(zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 260494 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 260494 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 260494 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 260494 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 260495 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 260495 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/'
   [junit4]   2> 260495 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 260495 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 260510 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 260515 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 260518 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 260526 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.Config Loaded 
SolrConfig: solrconfig.xml
   [junit4]   2> 260527 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 260531 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 261267 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 261274 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 261275 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 261289 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 261292 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 261305 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 261306 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 261306 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 261306 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 261307 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 261307 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 261308 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 261308 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 261308 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 261309 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:46921/solr_hdfs_home
   [junit4]   2> 261309 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 261309 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 261309 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@211ff1d3
   [junit4]   2> 261309 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 261325 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 261331 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 261346 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 261346 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 261354 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 261354 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 261355 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 261368 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 261368 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 261369 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=5, maxMergeAtOnceExplicit=8, maxMergedSegmentMB=77.9404296875, 
floorSegmentMB=1.2353515625, forceMergeDeletesPctAllowed=20.134495863785705, 
segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.6400632919989094
   [junit4]   2> 261428 INFO  (IPC Server handler 8 on 46921) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36983 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-26168be7-fbbf-434c-9e30-746c43226fda:NORMAL:127.0.0.1:41125|RBW],
 
ReplicaUnderConstruction[[DISK]DS-3be7ebf7-800b-426d-b9b8-064409480f3f:NORMAL:127.0.0.1:36983|FINALIZED]]}
 size 0
   [junit4]   2> 261430 INFO  (IPC Server handler 3 on 46921) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41125 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-3be7ebf7-800b-426d-b9b8-064409480f3f:NORMAL:127.0.0.1:36983|FINALIZED],
 
ReplicaUnderConstruction[[DISK]DS-b5b9bd9b-cf1c-43b1-abdd-e141582fee2f:NORMAL:127.0.0.1:41125|FINALIZED]]}
 size 0
   [junit4]   2> 261434 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b79cb73b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bae7ae); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 261434 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 261443 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 261447 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 261448 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 261448 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 261449 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 261451 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 261451 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 261452 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 261457 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 261457 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 261458 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 261458 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 261470 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 261470 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 261472 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=41, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=53.806640625, 
floorSegmentMB=1.662109375, forceMergeDeletesPctAllowed=9.796561528239746, 
segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.24180929010922886
   [junit4]   2> 261487 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b79cb73b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bae7ae); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 261487 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 261488 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening Searcher@56deabfe[collection1] main
   [junit4]   2> 261488 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 261489 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 261489 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 261489 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 261489 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 261489 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 261490 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 261490 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 261490 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 261490 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 261492 INFO  
(searcherExecutor-539-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@56deabfe[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 261505 WARN  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality information for 
hdfs://localhost:49471/solr3 due to exception: java.net.ConnectException: Call 
From lucene1-us-west/10.41.0.5 to localhost:49471 failed on connection 
exception: java.net.ConnectException: Connection refused; For more details see: 
 http://wiki.apache.org/hadoop/ConnectionRefused
   [junit4]   2> 261505 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 261505 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version 
buckets from index
   [junit4]   2> 261505 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 261506 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1516367556027351040
   [junit4]   2> 261506 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 
1516367556027351040
   [junit4]   2> 261506 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 261507 INFO  
(coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) 
[n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 261513 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:32889 
collection:control_collection shard:shard1
   [junit4]   2> 261514 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 261518 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94772972084461572-core_node1-n_0000000000
   [junit4]   2> 261518 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:32889/collection1/
   [junit4]   2> 261521 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:32889/collection1/ has no replicas
   [junit4]   2> 261521 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:32889/collection1/ shard1
   [junit4]   2> 261522 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 261523 INFO  
(zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 261527 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 261530 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:32889";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 261633 INFO  
(zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 261682 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:32889/collection1/ and leader is 
http://127.0.0.1:32889/collection1/
   [junit4]   2> 261682 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32889
   [junit4]   2> 261682 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 261682 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 261682 INFO  
(coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 261684 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:32889";,
   [junit4]   2>   "node_name":"127.0.0.1:32889_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 261685 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:32889";,
   [junit4]   2>   "node_name":"127.0.0.1:32889_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 261691 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 261691 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 261694 INFO  (zkCallback-194-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3b4572 name:ZooKeeperConnection 
Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 261695 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 261695 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 261695 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 261700 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 261700 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 261700 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 261701 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 261704 INFO  (zkCallback-195-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@14384141 
name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 261704 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 261704 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 261709 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 261709 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
collection1
   [junit4]   2> 261712 INFO  
(zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 261717 INFO  (zkCallback-194-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 261815 INFO  
(OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) 
[n:127.0.0.1:32889_    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/collection1/state.json
   [junit4]   2> 262039 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores/collection1
   [junit4]   2> 262040 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001
   [junit4]   2> 262040 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 262042 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@624688e{/,null,AVAILABLE}
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7b1f2cea{HTTP/1.1}{127.0.0.1:49300}
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.e.j.s.Server Started @265040ms
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, 
hostContext=/, hostPort=49300, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores}
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/'
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 262043 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 262058 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 262059 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 262061 INFO  (zkCallback-196-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@a12073a name:ZooKeeperConnection 
Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 262061 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 262061 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 262063 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 262063 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/solr.xml
   [junit4]   2> 262068 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores
   [junit4]   2> 262068 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1596567787
   [junit4]   2> 262068 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/]
   [junit4]   2> 262069 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/lib
   [junit4]   2> 262069 WARN  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/lib).
   [junit4]   2> 262077 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 262078 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41204/solr
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 262079 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 262081 INFO  (zkCallback-198-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@18f7ccb4 
name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
 

[...truncated too long message...]

3
   [junit4]   2>        5       
/solr/collections/collection1/leader_elect/shard12/election/94773090430156855-node51_core51-n_0000000004
   [junit4]   2>        4       
/solr/collections/collection1/leader_elect/shard11/election/94773090430156875-node71_core71-n_0000000004
   [junit4]   2>        4       
/solr/collections/collection1/leader_elect/shard2/election/94773090430156869-node65_core65-n_0000000004
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard2/election/94773090430156873-node69_core142-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard3/election/94773090430156876-node72_core145-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard5/election/94773090430156867-node63_core136-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard1/election/94773090430156875-node71_core144-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard2/election/94773090430156834-node30_core30-n_0000000005
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard6/election/94773090430156874-node70_core143-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard7/election/94773090430156855-node51_core124-n_0000000010
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard12/election/94773090430156868-node64_core137-n_0000000009
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard10/election/94773090430156835-node31_core104-n_0000000010
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard9/election/94773090430156826-node22_core168-n_0000000012
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard11/election/94773090430156847-node43_core116-n_0000000007
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard6/election/94773090430156845-node41_core41-n_0000000001
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard3/election/94773090430156817-node13_core13-n_0000000005
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard9/election/94773090430156865-node61_core61-n_0000000003
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard8/election/94773090430156869-node65_core138-n_0000000009
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard9/election/94773090430156831-node27_core100-n_0000000010
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard12/election/94773090430156867-node63_core63-n_0000000003
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard11/election/94773090430156863-node59_core132-n_0000000010
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard8/election/94773090430156834-node30_core103-n_0000000010
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard4/election/94773090430156857-node53_core53-n_0000000002
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/94773090430156821-node17_core17-n_0000000005
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard4/election/94773090430156808-node4_core77-n_0000000011
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard8/election/94773090430156816-node12_core85-n_0000000011
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard12/election/94773090430156830-node26_core172-n_0000000012
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard3/election/94773090430156840-node36_core109-n_0000000007
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard11/election/94773090430156828-node24_core170-n_0000000012
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard4/election/94773090430156872-node68_core141-n_0000000010
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        75      /solr/live_nodes
   [junit4]   2>        75      /solr/collections
   [junit4]   2> 
   [junit4]   2> 2105770 INFO  
(TEST-OverseerTest.testShardAssignmentBigger-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testShardAssignmentBigger
   [junit4]   2> 2105770 INFO  
(TEST-OverseerTest.testShardAssignmentBigger-seed#[AA04CF969E3D1668]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94773090430156803-127.0.0.1:53254_solr-n_0000000000) closing
   [junit4]   2> 2105770 INFO  
(OverseerStateUpdate-94773090430156803-127.0.0.1:53254_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53254_solr
   [junit4]   2> 2105770 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 2108771 INFO  
(SUITE-OverseerTest-seed#[AA04CF969E3D1668]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTest_AA04CF969E3D1668-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {}, 
docValues:{}, sim=ClassicSimilarity, locale=es_PY, timezone=Asia/Jakarta
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=252094488,total=509083648
   [junit4]   2> NOTE: All tests run in this JVM: [TestPhraseSuggestions, 
DataDrivenBlockJoinTest, TestComponentsName, TestExceedMaxTermLength, 
DistributedQueryComponentOptimizationTest, ParsingFieldUpdateProcessorsTest, 
FileBasedSpellCheckerTest, SpellingQueryConverterTest, 
HdfsBasicDistributedZk2Test, TestRawResponseWriter, TestSolr4Spatial, 
TestLazyCores, SOLR749Test, TestSolrConfigHandlerConcurrent, 
TestTrackingShardHandlerFactory, DistributedFacetPivotLargeTest, 
TestInitQParser, TestReplicationHandler, HttpPartitionTest, 
TestHighlightDedupGrouping, TestArbitraryIndexDir, ZkStateWriterTest, 
PrimUtilsTest, TestFunctionQuery, TestHdfsUpdateLog, PingRequestHandlerTest, 
TestPivotHelperCode, DistributedVersionInfoTest, AssignTest, TestRecoveryHdfs, 
SmileWriterTest, TestDocSet, TestCloudManagedSchemaConcurrent, 
TestSimpleTrackingShardHandler, BufferStoreTest, TestFilteredDocIdSet, 
DateRangeFieldTest, OutOfBoxZkACLAndCredentialsProvidersTest, 
DistributedMLTComponentTest, DistribJoinFromCollectionTest, TestSolrXml, 
UUIDUpdateProcessorFallbackTest, CurrencyFieldOpenExchangeTest, SparseHLLTest, 
ReturnFieldsTest, VersionInfoTest, CursorPagingTest, TestValueSourceCache, 
DateMathParserTest, TestRealTimeGet, DistributedQueryElevationComponentTest, 
TestNoOpRegenerator, CoreMergeIndexesAdminHandlerTest, TestPseudoReturnFields, 
StandardRequestHandlerTest, CollectionStateFormat2Test, TestInitParams, 
LeaderInitiatedRecoveryOnShardRestartTest, TestLuceneMatchVersion, 
SolrXmlInZkTest, TestDynamicFieldResource, QueryEqualityTest, TestRestManager, 
TestCollationFieldDocValues, TestSolrJ, TestIBSimilarityFactory, TestFaceting, 
TestBadConfig, DistributedSuggestComponentTest, 
TestHighFrequencyDictionaryFactory, TestDistributedMissingSort, 
TestMergePolicyConfig, RankQueryTest, HdfsChaosMonkeySafeLeaderTest, 
CacheHeaderTest, TestRTimerTree, TestSolrDynamicMBean, OutputWriterTest, 
EchoParamsTest, HdfsThreadLeakTest, TimeZoneUtilsTest, PolyFieldTest, 
TestExpandComponent, HdfsChaosMonkeyNothingIsSafeTest, 
TestConfigSetsAPIZkFailure, AnalysisAfterCoreReloadTest, 
DocumentAnalysisRequestHandlerTest, AnalysisErrorHandlingTest, 
SegmentsInfoRequestHandlerTest, EnumFieldTest, OverseerTest]
   [junit4] Completed [255/553] on J0 in 98.97s, 12 tests, 1 failure, 1 skipped 
<<< FAILURES!

[...truncated 946 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987:
 There were test failures: 553 suites (8 ignored), 2176 tests, 1 error, 2 
failures, 31 ignored (18 assumptions) [seed: AA04CF969E3D1668]

Total time: 182 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to