Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/809/

1 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=29478, name=collection1, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=29478, name=collection1, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:38328/s/f: Could not find collection : 
awholynewstresscollection_collection1_0
        at __randomizedtesting.SeedInfo.seed([241AE4706039BEC7]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 11116 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/init-core-data-001
   [junit4]   2> 4149138 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 4149138 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4149138 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /s/f
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4149289 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4149320 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4149323 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 4149361 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_40802_hdfs____v5bduw/webapp
   [junit4]   2> 4149628 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4150146 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40802
   [junit4]   2> 4150404 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4150405 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 4150418 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_43012_datanode____.u97rmv/webapp
   [junit4]   2> 4150521 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4150898 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43012
   [junit4]   2> 4151134 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4151136 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 4151162 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_44043_datanode____2e9hue/webapp
   [junit4]   2> 4151288 INFO  (IPC Server handler 3 on 33434) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-8d322c11-d9c3-49b6-90e5-ce2f118206cc node DatanodeRegistration(127.0.0.1, 
datanodeUuid=6d755c6c-d964-4e51-853e-7d828b2feb14, infoPort=43012, 
ipcPort=55698, storageInfo=lv=-56;cid=testClusterID;nsid=56478738;c=0), blocks: 
0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 4151288 INFO  (IPC Server handler 3 on 33434) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-7dc6e992-e371-499f-aae4-04ec1a37d022 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=6d755c6c-d964-4e51-853e-7d828b2feb14, infoPort=43012, 
ipcPort=55698, storageInfo=lv=-56;cid=testClusterID;nsid=56478738;c=0), blocks: 
0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4151416 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4151882 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[241AE4706039BEC7]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44043
   [junit4]   2> 4152065 INFO  (IPC Server handler 4 on 33434) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-592acdc8-bd8d-4279-91dc-33a6a3bf6150 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=ff46fe8e-f687-487b-9979-020d2afe57d6, infoPort=44043, 
ipcPort=48455, storageInfo=lv=-56;cid=testClusterID;nsid=56478738;c=0), blocks: 
0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 4152066 INFO  (IPC Server handler 4 on 33434) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-0642726b-f67e-49fe-9755-83fb89b101fe node DatanodeRegistration(127.0.0.1, 
datanodeUuid=ff46fe8e-f687-487b-9979-020d2afe57d6, infoPort=44043, 
ipcPort=48455, storageInfo=lv=-56;cid=testClusterID;nsid=56478738;c=0), blocks: 
0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4152198 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4152210 INFO  (Thread-12943) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4152210 INFO  (Thread-12943) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 4152310 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:59546
   [junit4]   2> 4152310 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4152311 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4152313 INFO  (zkCallback-2678-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@e7a64e2 name:ZooKeeperConnection 
Watcher:127.0.0.1:59546 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 4152313 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4152313 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4152314 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4152317 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4152318 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4152319 INFO  (zkCallback-2679-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@11b99c38 
name:ZooKeeperConnection Watcher:127.0.0.1:59546/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4152319 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4152319 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4152320 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4152321 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4152323 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4152324 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4152326 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 4152326 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4152342 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 4152342 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4152343 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4152344 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4152345 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 4152345 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4152346 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 4152346 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4152347 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 4152347 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4152349 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4152349 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4152350 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4152350 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4152351 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4152352 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4152353 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4152353 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4152354 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 4152354 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4152735 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1
   [junit4]   2> 4152737 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4152763 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@57a7a7c3{/s/f,null,AVAILABLE}
   [junit4]   2> 4152763 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@35340663{HTTP/1.1}{127.0.0.1:49061}
   [junit4]   2> 4152763 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.Server Started @4156664ms
   [junit4]   2> 4152763 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:33434/hdfs__localhost_33434__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001_tempDir-002_control_data,
 hostContext=/s/f, hostPort=49061, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores}
   [junit4]   2> 4152763 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 4152764 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/'
   [junit4]   2> 4152782 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4152783 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4152784 INFO  (zkCallback-2680-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5f07dea4 
name:ZooKeeperConnection Watcher:127.0.0.1:59546/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4152784 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4152785 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4152786 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 4152786 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/solr.xml
   [junit4]   2> 4152791 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores
   [junit4]   2> 4152791 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 836039881
   [junit4]   2> 4152791 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/]
   [junit4]   2> 4152791 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/lib
   [junit4]   2> 4152791 WARN  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/lib).
   [junit4]   2> 4152800 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4152801 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4152801 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4152801 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4152802 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59546/solr
   [junit4]   2> 4152802 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4152802 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4152802 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4152803 INFO  (zkCallback-2682-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@62ea1eda 
name:ZooKeeperConnection Watcher:127.0.0.1:59546 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4152803 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4152804 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4152809 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 4152809 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2b8c8138 
name:ZooKeeperConnection Watcher:127.0.0.1:59546/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4152809 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 4152810 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4152812 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 4152815 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 4152817 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 4152819 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 4152822 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4152823 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4152824 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 4152826 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4152826 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49061_s%2Ff
   [junit4]   2> 4152827 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:49061_s%2Ff
   [junit4]   2> 4152828 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4152829 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 4152830 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4152831 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000
   [junit4]   2> 4152831 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:49061_s%2Ff
   [junit4]   2> 4152831 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 4152832 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer Overseer 
(id=94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) starting
   [junit4]   2> 4152834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 4152839 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4152840 INFO  
(OverseerCollectionConfigSetProcessor-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000)
 [n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 4152840 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer Starting to work on the main 
queue
   [junit4]   2> 4152840 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4152869 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 4152869 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 4152870 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores
   [junit4]   2> 4152871 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 4152871 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1/
   [junit4]   2> 4152871 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 4152878 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4152878 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 4152886 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 4152887 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 4152887 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49061/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:49061_s%2Ff",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 4152888 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49061/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:49061_s%2Ff",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4152888 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4152888 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 4152888 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 4152890 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4153888 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4153888 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4153889 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4153889 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 4153890 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 4153890 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1/'
   [junit4]   2> 4153913 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] o.a.s.c.Config 
loaded config solrconfig.xml with version 0 
   [junit4]   2> 4153920 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4153924 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 4153941 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] o.a.s.c.Config 
Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4153952 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 4153957 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4154125 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4154131 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4154132 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4154140 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4154142 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4154144 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 4154144 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 4154144 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 4154145 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 4154145 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 4154145 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 4154146 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 4154146 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 4154146 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4154147 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:33434/solr_hdfs_home
   [junit4]   2> 4154147 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication 
disabled
   [junit4]   2> 4154147 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 4154147 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11359bb7
   [junit4]   2> 4154148 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4154190 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will 
wait 5 seconds and try again.
   [junit4]   2> 4159194 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data for 
locality metrics.
   [junit4]   2> 4159195 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4159195 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4159205 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:33434/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 4159205 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4159228 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data/index 
for locality metrics.
   [junit4]   2> 4159229 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4159229 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=14, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 4159289 INFO  (IPC Server handler 3 on 33434) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56564 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-592acdc8-bd8d-4279-91dc-33a6a3bf6150:NORMAL:127.0.0.1:59648|RBW],
 
ReplicaUnderConstruction[[DISK]DS-8d322c11-d9c3-49b6-90e5-ce2f118206cc:NORMAL:127.0.0.1:56564|RBW]]}
 size 0
   [junit4]   2> 4159293 INFO  (IPC Server handler 2 on 33434) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59648 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-8d322c11-d9c3-49b6-90e5-ce2f118206cc:NORMAL:127.0.0.1:56564|RBW],
 
ReplicaUnderConstruction[[DISK]DS-0642726b-f67e-49fe-9755-83fb89b101fe:NORMAL:127.0.0.1:59648|FINALIZED]]}
 size 0
   [junit4]   2> 4159298 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b60b9ee8 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59bc9913; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4159298 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 4159300 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:33434/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4159303 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4159304 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4159305 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 4159305 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 4159314 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4159316 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4159316 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4159317 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4159321 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 4159322 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4159322 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 4159323 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
tlogDfsReplication=2
   [junit4]   2> 4159334 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 4159334 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 4159350 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 4159357 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b60b9ee8 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59bc9913; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4159357 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 4159358 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@12c5b077[collection1] 
main
   [junit4]   2> 4159358 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection 
configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based 
storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO 
with znodeBase: /configs/conf1
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4159359 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 4159360 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4159360 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 4159360 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4159361 INFO  
(searcherExecutor-8371-thread-1-processing-n:127.0.0.1:49061_s%2Ff 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@12c5b077[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4159366 WARN  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality 
information for hdfs://localhost:50533/solr3 due to exception: 
java.net.ConnectException: Call From lucene1-us-west/10.41.0.5 to 
localhost:50533 failed on connection exception: java.net.ConnectException: 
Connection refused; For more details see:  
http://wiki.apache.org/hadoop/ConnectionRefused
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
256 version buckets from index
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed 
version bucket highest value from index
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1513829747876954112
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with 
highest version 1513829747876954112
   [junit4]   2> 4159366 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 4159367 INFO  
(coreLoadExecutor-8370-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 4159368 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:49061/s/f 
collection:control_collection shard:shard1
   [junit4]   2> 4159369 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4159373 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94614358774317060-core_node1-n_0000000000
   [junit4]   2> 4159374 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 4159375 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 4159375 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 4159375 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:49061/s/f/collection1/
   [junit4]   2> 4159376 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 4159376 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 4159376 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:49061/s/f/collection1/ has no replicas
   [junit4]   2> 4159376 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49061/s/f/collection1/ shard1
   [junit4]   2> 4159377 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4159379 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 4159381 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 4159383 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:49061/s/f";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 4159390 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4159394 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4159394 INFO  (zkCallback-2685-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3573fff name:ZooKeeperConnection 
Watcher:127.0.0.1:59546/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 4159394 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4159394 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4159394 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4159396 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 4159485 INFO  (zkCallback-2685-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 4159485 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4159535 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:49061/s/f/collection1/ and leader is 
http://127.0.0.1:49061/s/f/collection1/
   [junit4]   2> 4159535 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49061/s/f
   [junit4]   2> 4159535 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 4159535 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 4159535 INFO  
(coreZkRegister-8364-thread-1-processing-n:127.0.0.1:49061_s%2Ff x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49061_s%2Ff 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 4159537 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49061/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:49061_s%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 4159537 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49061/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:49061_s%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4159640 INFO  (zkCallback-2685-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 4159640 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4159737 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores/collection1
   [junit4]   2> 4159737 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001
   [junit4]   2> 4159738 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4159757 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5d11429{/s/f,null,AVAILABLE}
   [junit4]   2> 4159757 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@72fccd84{HTTP/1.1}{127.0.0.1:60286}
   [junit4]   2> 4159758 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.e.j.s.Server Started @4163658ms
   [junit4]   2> 4159758 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:33434/hdfs__localhost_33434__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/s/f, hostPort=60286, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores}
   [junit4]   2> 4159758 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 4159758 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/'
   [junit4]   2> 4159775 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4159793 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4159807 INFO  (zkCallback-2686-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@182e5d5a 
name:ZooKeeperConnection Watcher:127.0.0.1:59546/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4159807 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4159807 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4159808 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 4159808 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/solr.xml
   [junit4]   2> 4159817 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores
   [junit4]   2> 4159817 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1985720179
   [junit4]   2> 4159817 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/]
   [junit4]   2> 4159817 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/lib
   [junit4]   2> 4159817 WARN  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/lib).
   [junit4]   2> 4159832 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4159833 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4159834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4159834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4159834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59546/solr
   [junit4]   2> 4159834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4159834 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4159849 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4159857 INFO  (zkCallback-2688-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@10323830 
name:ZooKeeperConnection Watcher:127.0.0.1:59546 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4159857 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4159857 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4159880 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 4159893 INFO  
(zkCallback-2689-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@d06a388 name:ZooKeeperConnection 
Watcher:127.0.0.1:59546/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 4159894 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 4159898 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4160902 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60286_s%2Ff
   [junit4]   2> 4160902 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:60286_s%2Ff
   [junit4]   2> 4160903 INFO  (zkCallback-2685-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 4160903 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A live node change: 
WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has 
occurred - updating... (live nodes size: 1)
   [junit4]   2> 4160903 INFO  
(zkCallback-2689-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ZkStateReader A live node change: 
WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has 
occurred - updating... (live nodes size: 1)
   [junit4]   2> 4160904 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4160904 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/94614358774317064-127.0.0.1:60286_s%2Ff-n_0000000001
   [junit4]   2> 4160905 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000 
to know if I could be the leader
   [junit4]   2> 4160919 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 4160919 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 4160920 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores
   [junit4]   2> 4160920 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores/collection1,
 collection=collection1, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 4160920 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_241AE4706039BEC7-001/shard-1-001/cores/collection1/
   [junit4]   2> 4160921 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 4160928 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 4160928 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 4160930 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 4160930 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[241AE4706039BEC7]) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 4160931 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60286/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:60286_s%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 4160931 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 4160932 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60286/s/f";,
   [junit4]   2>   "node_name":"127.0.0.1:60286_s%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4160932 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: collection1
   [junit4]   2> 4160932 INFO  
(OverseerStateUpdate-94614358774317060-127.0.0.1:49061_s%2Ff-n_0000000000) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard2
   [junit4]   2> 4161034 INFO  
(zkCallback-2689-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4161034 INFO  
(zkCallback-2683-thread-1-processing-n:127.0.0.1:49061_s%2Ff) 
[n:127.0.0.1:49061_s%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: 
WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 
has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4161034 INFO  (zkCallback-2685-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 2)
   [junit4]   2> 4161932 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4161932 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:collection1
   [junit4]   2> 4161932 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 4161933 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.c.ZkStateReader 
Load collection config from:/collections/collection1
   [junit4]   2> 4161933 INFO  
(coreLoadExecutor-8381-thread-1-processing-n:127.0.0.1:60286_s%2Ff) 
[n:127.0.0.1:60286_s%2Ff c:collection1   x:collection1] o.a.s.c.c.ZkStateReader 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 4161933 INFO  (coreLoadExecutor-8381-thread-1-proces

[...truncated too long message...]

n2_0_shard3_replica2) [n:127.0.0.1:48841_ 
c:awholynewstresscollection_collection2_0 s:shard3 r:core_node12 
x:awholynewstresscollection_collection2_0_shard3_replica2] o.a.s.c.ZkController 
publishing state=recovering
   [junit4]   2> 52938955 ERROR 
(OverseerCollectionConfigSetProcessor-94614184706310148-127.0.0.1:44952_-n_0000000000)
 [n:127.0.0.1:44952_    ] o.a.s.c.OverseerTaskProcessor 
   [junit4]   2> org.apache.zookeeper.KeeperException$ConnectionLossException: 
KeeperErrorCode = ConnectionLoss for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:355)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:172)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 52933675 ERROR 
(RecoveryThread-awholynewstresscollection_collection1_0_shard4_replica4) 
[n:127.0.0.1:58499_ c:awholynewstresscollection_collection1_0 s:shard4 
r:core_node19 x:awholynewstresscollection_collection1_0_shard4_replica4] 
o.a.s.c.RecoveryStrategy Recovery failed - trying again... (0)
   [junit4]   2> 52931925 INFO  
(RecoveryThread-awholynewstresscollection_collection1_0_shard3_replica4) 
[n:127.0.0.1:41558_ c:awholynewstresscollection_collection1_0 s:shard3 
r:core_node14 x:awholynewstresscollection_collection1_0_shard3_replica4] 
o.a.s.c.RecoveryStrategy Publishing state of core 
awholynewstresscollection_collection1_0_shard3_replica4 as recovering, leader 
is 
http://127.0.0.1:50810/awholynewstresscollection_collection1_0_shard3_replica2/ 
and I am 
http://127.0.0.1:41558/awholynewstresscollection_collection1_0_shard3_replica4/
   [junit4]   2> 54158316 INFO  
(RecoveryThread-awholynewstresscollection_collection1_0_shard3_replica4) 
[n:127.0.0.1:41558_ c:awholynewstresscollection_collection1_0 s:shard3 
r:core_node14 x:awholynewstresscollection_collection1_0_shard3_replica4] 
o.a.s.c.ZkController publishing state=recovering
   [junit4]   2> NOTE: test params are: codec=Lucene53, sim=ClassicSimilarity, 
locale=fr_LU, timezone=America/Glace_Bay
   [junit4]   2> 52897781 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
   [junit4]   2> java.nio.channels.CancelledKeyException
   [junit4]   2>        at 
sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2>        at 
sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 52896613 INFO  
(RecoveryThread-awholynewstresscollection_collection2_0_shard4_replica4) 
[n:127.0.0.1:50810_ c:awholynewstresscollection_collection2_0 s:shard4 
r:core_node15 x:awholynewstresscollection_collection2_0_shard4_replica4] 
o.a.s.c.ZkController publishing state=recovering
   [junit4]   2> 52896613 INFO  
(RecoveryThread-awholynewstresscollection_collection3_0_shard2_replica4) 
[n:127.0.0.1:50810_ c:awholynewstresscollection_collection3_0 s:shard2 
r:core_node4 x:awholynewstresscollection_collection3_0_shard2_replica4] 
o.a.s.c.RecoveryStrategy Wait 2.0 seconds before trying to recover again (1)
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=305,free=19400112,total=506462208
   [junit4]   2> 52861922 WARN  
(RecoveryThread-awholynewstresscollection_collection5_0_shard2_replica2) 
[n:127.0.0.1:50810_ c:awholynewstresscollection_collection5_0 s:shard2 
r:core_node14 x:awholynewstresscollection_collection5_0_shard2_replica2] 
o.a.s.c.ZkController Unable to read 
/collections/awholynewstresscollection_collection5_0/leader_initiated_recovery/shard2/core_node14
 due to: org.apache.zookeeper.KeeperException$ConnectionLossException: 
KeeperErrorCode = ConnectionLoss for 
/collections/awholynewstresscollection_collection5_0/leader_initiated_recovery/shard2/core_node14
   [junit4]   2> NOTE: All tests run in this JVM: [TestQueryTypes, 
SpellCheckCollatorTest, BasicFunctionalityTest, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, OverseerStatusTest, 
TestSolrQueryParserResource, TestWordDelimiterFilterFactory, 
TriLevelCompositeIdRoutingTest, DOMUtilTest, TestRequestStatusCollectionAPI, 
TestObjectReleaseTracker, DistribDocExpirationUpdateProcessorTest, 
TestBM25SimilarityFactory, TestHashPartitioner, StressHdfsTest, 
TestQuerySenderNoQuery, TestPartialUpdateDeduplication, 
TermVectorComponentTest, TestReloadAndDeleteDocs, URLClassifyProcessorTest, 
TestCrossCoreJoin, DocExpirationUpdateProcessorFactoryTest, 
DistributedTermsComponentTest, TestQuerySenderListener, TestCoreContainer, 
TestCryptoKeys, TestManagedSchema, TestMacros, TestBlendedInfixSuggestions, 
TermsComponentTest, MergeStrategyTest, TestFastOutputStream, 
DistributedQueueTest, TestCopyFieldCollectionResource, ZkControllerTest, 
MBeansHandlerTest, ShardSplitTest, PreAnalyzedFieldTest, 
ClusterStateUpdateTest, DistanceUnitsTest, SimpleMLTQParserTest, 
NumericFieldsTest, RulesTest, TestTrie, ShardRoutingCustomTest, 
SoftAutoCommitTest, TestFileDictionaryLookup, SpellCheckComponentTest, 
TestReqParamsAPI, DistributedExpandComponentTest, TestFiltering, 
DateRangeFieldTest, ChaosMonkeyNothingIsSafeTest, SolrPluginUtilsTest, 
ChaosMonkeySafeLeaderTest, SpatialRPTFieldTypeTest, SolrIndexConfigTest, 
SpellPossibilityIteratorTest, DistributedFacetPivotWhiteBoxTest, 
UpdateRequestProcessorFactoryTest, DirectSolrSpellCheckerTest, 
TestRebalanceLeaders, TestJmxMonitoredMap, 
UniqFieldsUpdateProcessorFactoryTest, TestMiniSolrCloudCluster, 
TestLMJelinekMercerSimilarityFactory, TestDynamicLoading, SpatialFilterTest, 
TestCustomSort, TestRuleBasedAuthorizationPlugin, 
TestRemoveLastDynamicCopyField, TestSortByMinMaxFunction, MultiTermTest, 
ConvertedLegacyTest, BitVectorTest, ChangedSchemaMergeTest, TestLFUCache, 
VMParamsZkACLAndCredentialsProvidersTest, SolrCmdDistributorTest, 
TestAnalyzeInfixSuggestions, SchemaVersionSpecificBehaviorTest, 
SolrIndexSplitterTest, LoggingHandlerTest, TestManagedSchemaFieldTypeResource, 
TestReplicationHandlerBackup, BadCopyFieldTest, CoreAdminRequestStatusTest, 
WordBreakSolrSpellCheckerTest, PreAnalyzedUpdateProcessorTest, 
CollectionsAPIDistributedZkTest]
   [junit4]   2> 52850737 ERROR 
(RecoveryThread-awholynewstresscollection_collection1_0_shard6_replica1) 
[n:127.0.0.1:58499_ c:awholynewstresscollection_collection1_0 s:shard6 
r:core_node6 x:awholynewstresscollection_collection1_0_shard6_replica1] 
o.a.s.c.RecoveryStrategy Recovery failed - trying again... (0)
   [junit4] ERROR   0.00s J1 | CollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([241AE4706039BEC7]:0)
   [junit4]    >        at java.util.Arrays.copyOf(Arrays.java:3332)
   [junit4]    >        at 
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)
   [junit4]    >        at 
java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)
   [junit4]    >        at 
java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)
   [junit4]    >        at 
java.lang.StringBuilder.append(StringBuilder.java:136)
   [junit4]    >        at 
java.lang.StringBuilder.append(StringBuilder.java:131)
   [junit4] Completed [546/546] on J1 in 52842.44s, 1 test, 1 error <<< 
FAILURES!

[...truncated 2 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151001_064626_632.sysout
   [junit4] >>> JVM J1: stdout (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid19138.hprof
 ...
   [junit4] Heap dump file created [709855210 bytes in 24.777 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 11 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987:
 There were test failures: 546 suites (8 ignored), 2145 tests, 1 suite-level 
error, 1 error, 29 ignored (17 assumptions) [seed: 241AE4706039BEC7]

Total time: 1020 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to