Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/643/

1 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.AsyncCallRequestStatusResponseTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.AsyncCallRequestStatusResponseTest:     1) 
Thread[id=10045, 
name=OverseerHdfsCoreFailoverThread-97215309130235910-127.0.0.1:37421_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.AsyncCallRequestStatusResponseTest: 
   1) Thread[id=10045, 
name=OverseerHdfsCoreFailoverThread-97215309130235910-127.0.0.1:37421_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([EEB85D2319B1BB38]:0)




Build Log:
[...truncated 12239 lines...]
   [junit4] Suite: org.apache.solr.cloud.AsyncCallRequestStatusResponseTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/init-core-data-001
   [junit4]   2> 1074440 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1074440 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001
   [junit4]   2> 1074441 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1074441 INFO  (Thread-2837) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1074441 INFO  (Thread-2837) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1074541 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.ZkTestServer start zk server on port:53864
   [junit4]   2> 1074549 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1074550 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1074551 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1b7d929d{/solr,null,AVAILABLE}
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@7d2b0764{SSL,[ssl, 
http/1.1]}{127.0.0.1:52510}
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.Server Started @1078641ms
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=52510}
   [junit4]   2> 1074553 ERROR (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
6.4.0
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1074553 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-01-02T20:11:35.775Z
   [junit4]   2> 1074555 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@53c6a850{/solr,null,AVAILABLE}
   [junit4]   2> 1074556 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@32d06e95{SSL,[ssl, 
http/1.1]}{127.0.0.1:37421}
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.Server Started @1078646ms
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37421}
   [junit4]   2> 1074559 ERROR (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
6.4.0
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1074559 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-01-02T20:11:35.781Z
   [junit4]   2> 1074561 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1074561 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53864/solr
   [junit4]   2> 1074563 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1074564 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15960ceff700003, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1074573 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1074578 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53864/solr
   [junit4]   2> 1074579 INFO  (jetty-launcher-1424-thread-1) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:52510_solr
   [junit4]   2> 1074580 INFO  (jetty-launcher-1424-thread-1) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.Overseer Overseer 
(id=97215309130235908-127.0.0.1:52510_solr-n_0000000000) starting
   [junit4]   2> 1074602 INFO  (jetty-launcher-1424-thread-1) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:52510_solr
   [junit4]   2> 1074606 INFO  
(zkCallback-1431-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1074607 INFO  (jetty-launcher-1424-thread-2) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1074609 INFO  (jetty-launcher-1424-thread-2) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37421_solr
   [junit4]   2> 1074610 INFO  
(zkCallback-1431-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1074621 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1074647 INFO  (jetty-launcher-1424-thread-2) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node2/.
   [junit4]   2> 1074710 INFO  (jetty-launcher-1424-thread-1) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node1/.
   [junit4]   2> 1075254 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1075254 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53864/solr ready
   [junit4]   2> 1075268 INFO  
(TEST-AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse-seed#[EEB85D2319B1BB38])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testAsyncCallStatusResponse
   [junit4]   2> 1075333 INFO  (qtp1203986780-9981) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
async=3473d7b2-f78a-47fc-9348-87a827f02325&replicationFactor=1&collection.configName=conf&name=asynccall&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1075334 INFO  (qtp1203986780-9981) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={async=3473d7b2-f78a-47fc-9348-87a827f02325&replicationFactor=1&collection.configName=conf&name=asynccall&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 1075344 INFO  
(OverseerThreadFactory-4858-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
asynccall
   [junit4]   2> 1075480 INFO  (qtp1203986780-9967) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={async=3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599&qt=/admin/cores&collection.configName=conf&newCollection=true&name=asynccall_shard2_replica1&action=CREATE&numShards=2&collection=asynccall&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2
   [junit4]   2> 1075482 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr    ] o.a.s.h.a.CoreAdminOperation core create command 
async=3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599&qt=/admin/cores&collection.configName=conf&newCollection=true&name=asynccall_shard2_replica1&action=CREATE&numShards=2&collection=asynccall&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1075569 INFO  (qtp1967697770-9972) [n:127.0.0.1:52510_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={async=3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766&qt=/admin/cores&collection.configName=conf&newCollection=true&name=asynccall_shard1_replica1&action=CREATE&numShards=2&collection=asynccall&shard=shard1&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1075571 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr    ] o.a.s.h.a.CoreAdminOperation core create command 
async=3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766&qt=/admin/cores&collection.configName=conf&newCollection=true&name=asynccall_shard1_replica1&action=CREATE&numShards=2&collection=asynccall&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1075573 INFO  (qtp1203986780-9977) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CoreAdminOperation Checking request status for : 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599
   [junit4]   2> 1075573 INFO  (qtp1203986780-9977) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1075677 INFO  (zkCallback-1441-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1075677 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1075677 INFO  
(zkCallback-1431-thread-4-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076528 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1076534 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.s.IndexSchema [asynccall_shard2_replica1] Schema name=minimal
   [junit4]   2> 1076537 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1076538 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'asynccall_shard2_replica1' using 
configuration from collection asynccall
   [junit4]   2> 1076538 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.SolrCore [[asynccall_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node2/asynccall_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node2/./asynccall_shard2_replica1/data/]
   [junit4]   2> 1076553 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1076553 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1076553 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1076554 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1076554 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@55a8b3f2[asynccall_shard2_replica1] 
main]
   [junit4]   2> 1076555 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1076555 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1076555 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1076555 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1555444948299415552
   [junit4]   2> 1076556 INFO  
(searcherExecutor-4863-thread-1-processing-x:asynccall_shard2_replica1 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE 
n:127.0.0.1:37421_solr s:shard2 c:asynccall) [n:127.0.0.1:37421_solr 
c:asynccall s:shard2  x:asynccall_shard2_replica1] o.a.s.c.SolrCore 
[asynccall_shard2_replica1] Registered new searcher 
Searcher@55a8b3f2[asynccall_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1076561 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1076561 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1076561 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:37421/solr/asynccall_shard2_replica1/
   [junit4]   2> 1076561 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1076561 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.SyncStrategy https://127.0.0.1:37421/solr/asynccall_shard2_replica1/ 
has no replicas
   [junit4]   2> 1076563 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:37421/solr/asynccall_shard2_replica1/ shard2
   [junit4]   2> 1076575 INFO  (qtp1203986780-9978) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CoreAdminOperation Checking request status for : 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599
   [junit4]   2> 1076575 INFO  (qtp1203986780-9978) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1076582 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1076588 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.s.IndexSchema [asynccall_shard1_replica1] Schema name=minimal
   [junit4]   2> 1076590 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1076590 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'asynccall_shard1_replica1' using 
configuration from collection asynccall
   [junit4]   2> 1076590 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.SolrCore [[asynccall_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node1/asynccall_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.AsyncCallRequestStatusResponseTest_EEB85D2319B1BB38-001/tempDir-001/node1/./asynccall_shard1_replica1/data/]
   [junit4]   2> 1076597 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1076597 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1076597 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1076597 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1076598 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@3d832abb[asynccall_shard1_replica1] 
main]
   [junit4]   2> 1076598 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1076598 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1076598 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1076599 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1555444948345552896
   [junit4]   2> 1076600 INFO  
(searcherExecutor-4868-thread-1-processing-x:asynccall_shard1_replica1 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE 
n:127.0.0.1:52510_solr s:shard1 c:asynccall) [n:127.0.0.1:52510_solr 
c:asynccall s:shard1  x:asynccall_shard1_replica1] o.a.s.c.SolrCore 
[asynccall_shard1_replica1] Registered new searcher 
Searcher@3d832abb[asynccall_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1076603 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1076603 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1076603 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:52510/solr/asynccall_shard1_replica1/
   [junit4]   2> 1076603 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1076603 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.SyncStrategy https://127.0.0.1:52510/solr/asynccall_shard1_replica1/ 
has no replicas
   [junit4]   2> 1076605 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:52510/solr/asynccall_shard1_replica1/ shard1
   [junit4]   2> 1076707 INFO  (zkCallback-1441-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076707 INFO  
(zkCallback-1431-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076707 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076715 INFO  
(parallelCoreAdminExecutor-4859-thread-1-processing-n:127.0.0.1:37421_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599 CREATE) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2  x:asynccall_shard2_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1076756 INFO  
(parallelCoreAdminExecutor-4861-thread-1-processing-n:127.0.0.1:52510_solr 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766 CREATE) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1  x:asynccall_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1076861 INFO  
(zkCallback-1431-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076861 INFO  (zkCallback-1441-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076861 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [2])
   [junit4]   2> 1076864 INFO  (qtp1203986780-9984) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with 
params 
requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1076865 INFO  (qtp1203986780-9984) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 1077577 INFO  (qtp1203986780-9979) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CoreAdminOperation Checking request status for : 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599
   [junit4]   2> 1077578 INFO  (qtp1203986780-9979) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=3473d7b2-f78a-47fc-9348-87a827f0232521764144088328599&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1077580 INFO  (qtp1967697770-9972) [n:127.0.0.1:52510_solr    
] o.a.s.h.a.CoreAdminOperation Checking request status for : 
3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766
   [junit4]   2> 1077580 INFO  (qtp1967697770-9972) [n:127.0.0.1:52510_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=3473d7b2-f78a-47fc-9348-87a827f0232521764144088533766&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1077582 INFO  
(OverseerThreadFactory-4858-thread-1-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1077867 INFO  (qtp1203986780-9981) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with 
params 
requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1077868 INFO  (qtp1203986780-9981) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1077870 INFO  (qtp1203986780-9967) [n:127.0.0.1:37421_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with 
params 
requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1077870 INFO  (qtp1203986780-9967) [n:127.0.0.1:37421_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=3473d7b2-f78a-47fc-9348-87a827f02325&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1077871 INFO  
(TEST-AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse-seed#[EEB85D2319B1BB38])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testAsyncCallStatusResponse
   [junit4]   2> 1077873 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@32d06e95{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1077874 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@7d2b0764{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1077874 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1911750964
   [junit4]   2> 1077875 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=130414940
   [junit4]   2> 1077877 INFO  (coreCloseExecutor-4873-thread-1) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2 r:core_node1 
x:asynccall_shard2_replica1] o.a.s.c.SolrCore [asynccall_shard2_replica1]  
CLOSING SolrCore org.apache.solr.core.SolrCore@5de0d855
   [junit4]   2> 1077877 INFO  (coreCloseExecutor-4874-thread-1) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1 r:core_node2 
x:asynccall_shard1_replica1] o.a.s.c.SolrCore [asynccall_shard1_replica1]  
CLOSING SolrCore org.apache.solr.core.SolrCore@568e563f
   [junit4]   2> 1077878 INFO  (coreCloseExecutor-4873-thread-1) 
[n:127.0.0.1:37421_solr c:asynccall s:shard2 r:core_node1 
x:asynccall_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters 
for: solr.core.asynccall.shard2.replica1
   [junit4]   2> 1077878 INFO  (coreCloseExecutor-4874-thread-1) 
[n:127.0.0.1:52510_solr c:asynccall s:shard1 r:core_node2 
x:asynccall_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters 
for: solr.core.asynccall.shard1.replica1
   [junit4]   2> 1077882 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=97215309130235908-127.0.0.1:52510_solr-n_0000000000) closing
   [junit4]   2> 1077882 INFO  
(OverseerStateUpdate-97215309130235908-127.0.0.1:52510_solr-n_0000000000) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:52510_solr
   [junit4]   2> 1077883 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:37421_solr
   [junit4]   2> 1077883 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.Overseer Overseer 
(id=97215309130235910-127.0.0.1:37421_solr-n_0000000001) starting
   [junit4]   2> 1077885 INFO  
(zkCallback-1436-thread-2-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 1077885 WARN  
(zkCallback-1431-thread-4-processing-n:127.0.0.1:52510_solr) 
[n:127.0.0.1:52510_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1077886 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1077888 INFO  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/asynccall/state.json] for collection [asynccall] has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 1077888 INFO  (jetty-launcher-1424-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1b7d929d{/solr,null,UNAVAILABLE}
   [junit4]   2> 1077889 WARN  
(zkCallback-1436-thread-1-processing-n:127.0.0.1:37421_solr) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1077889 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1077889 INFO  (jetty-launcher-1424-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@53c6a850{/solr,null,UNAVAILABLE}
   [junit4]   2> 1077890 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53864 53864
   [junit4]   2> 1077978 INFO  (Thread-2837) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:53864 53864
   [junit4]   2> 1077978 WARN  (Thread-2837) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2>        2       /solr/security.json
   [junit4]   2>        2       /solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2>        3       /solr/collections/asynccall/state.json
   [junit4]   2>        3       /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        15      /solr/overseer/queue
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2>        3       /solr/overseer/queue-work
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1077979 INFO  
(SUITE-AsyncCallRequestStatusResponseTest-seed#[EEB85D2319B1BB38]-worker) [    
] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jan 02, 2017 8:11:39 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 6 leaked 
thread(s).
   [junit4]   2> 1079389 WARN  
(OverseerStateUpdate-97215309130235910-127.0.0.1:37421_solr-n_0000000001) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting 
Overseer work queue loop
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer/queue-work/qn-0000000009
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:245)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:242)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:242)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.removeFirst(DistributedQueue.java:411)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.poll(DistributedQueue.java:182)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:156)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1079390 INFO  
(OverseerStateUpdate-97215309130235910-127.0.0.1:37421_solr-n_0000000001) 
[n:127.0.0.1:37421_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:37421_solr
   [junit4]   2> 1079888 WARN  
(OverseerCollectionConfigSetProcessor-97215309130235910-127.0.0.1:37421_solr-n_0000000001)
 [n:127.0.0.1:37421_solr    ] o.a.s.c.OverseerTaskProcessor Overseer cannot 
talk to ZK
   [junit4]   2> Jan 02, 2017 8:11:59 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.AsyncCallRequestStatusResponseTest: 
   [junit4]   2>    1) Thread[id=10045, 
name=OverseerHdfsCoreFailoverThread-97215309130235910-127.0.0.1:37421_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jan 02, 2017 8:11:59 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=10045, 
name=OverseerHdfsCoreFailoverThread-97215309130235910-127.0.0.1:37421_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2> Jan 02, 2017 8:11:59 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, 
docValues:{}, maxPointsInLeafNode=1198, maxMBSortInHeap=7.4061850253575106, 
sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=es-PY, 
timezone=Africa/Bangui
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_102 (64-bit)/cpus=4,threads=1,free=261980256,total=533725184
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, 
TestClusterProperties, LoggingHandlerTest, ClusterStateUpdateTest, 
BooleanFieldTest, ZkCLITest, SmileWriterTest, LeaderElectionContextKeyTest, 
TestTrie, MultiThreadedOCPTest, TestConfigSetProperties, 
TestFieldCollectionResource, TestFiltering, SmileWriterTest, 
TestLegacyFieldCache, TestTolerantUpdateProcessorRandomCloud, 
TestSolrCoreSnapshots, DocumentBuilderTest, SpatialFilterTest, 
CSVRequestHandlerTest, TestHashPartitioner, SegmentsInfoRequestHandlerTest, 
HighlighterMaxOffsetTest, TestExactSharedStatsCache, 
VMParamsZkACLAndCredentialsProvidersTest, TestNamedUpdateProcessors, 
HdfsChaosMonkeyNothingIsSafeTest, CloneFieldUpdateProcessorFactoryTest, 
VersionInfoTest, TestFieldTypeResource, CursorMarkTest, 
TestFieldCacheSortRandom, DistributedFacetPivotLongTailTest, 
TestDefaultSearchFieldResource, TestCollapseQParserPlugin, TestStressVersions, 
TestQuerySenderListener, TestFieldCacheReopen, TestElisionMultitermQuery, 
RecoveryAfterSoftCommitTest, HdfsRestartWhileUpdatingTest, 
ShufflingReplicaListTransformerTest, TestSolr4Spatial2, CdcrUpdateLogTest, 
TestUninvertingReader, TestSchemaSimilarityResource, TermsComponentTest, 
BlockDirectoryTest, ChaosMonkeySafeLeaderTest, 
ClassificationUpdateProcessorFactoryTest, URLClassifyProcessorTest, 
DistributedIntervalFacetingTest, TestSearchPerf, ZkStateWriterTest, 
TestAuthenticationFramework, TestSuggestSpellingConverter, 
TestSolrDynamicMBean, CollectionReloadTest, TestManagedResource, 
TestLeaderElectionZkExpiry, ParsingFieldUpdateProcessorsTest, 
IndexSchemaRuntimeFieldTest, SampleTest, DistributedMLTComponentTest, 
TestBM25SimilarityFactory, SortByFunctionTest, HdfsNNFailoverTest, 
TestReRankQParserPlugin, CdcrReplicationHandlerTest, TestSQLHandlerNonCloud, 
HdfsLockFactoryTest, DeleteNodeTest, DistributedTermsComponentTest, 
TestLuceneMatchVersion, TestUseDocValuesAsStored2, DirectSolrConnectionTest, 
SuggesterFSTTest, TestSystemIdResolver, TestInfoStreamLogging, 
HdfsTlogReplayBufferedWhileIndexingTest, CollectionsAPIDistributedZkTest, 
TestExportWriter, TestQueryTypes, TestScoreJoinQPScore, TestRequestForwarding, 
CopyFieldTest, SearchHandlerTest, TestPivotHelperCode, 
TestAnalyzeInfixSuggestions, TestJavabinTupleStreamParser, 
TestConfigSetsAPIExclusivity, SolrMetricReporterTest, TestSurroundQueryParser, 
RulesTest, StressHdfsTest, TestSweetSpotSimilarityFactory, 
CoreAdminCreateDiscoverTest, IndexSchemaTest, TermVectorComponentTest, 
SoftAutoCommitTest, ShardRoutingCustomTest, 
LeaderInitiatedRecoveryOnCommitTest, SpellCheckCollatorTest, 
TestBackupRepositoryFactory, TestCustomStream, SharedFSAutoReplicaFailoverTest, 
BasicFunctionalityTest, JsonLoaderTest, ExplicitHLLTest, JvmMetricsTest, 
TestFreeTextSuggestions, BasicDistributedZk2Test, SyncSliceTest, 
OpenCloseCoreStressTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler, 
DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, 
TestReload, SpellCheckComponentTest, TestGroupingSearch, 
QueryElevationComponentTest, TestSort, DirectUpdateHandlerTest, 
HighlighterTest, ShowFileRequestHandlerTest, TestExtendedDismaxParser, 
TestFoldingMultitermQuery, DocValuesTest, DocValuesMultiTest, 
TestSolrDeletionPolicy1, DebugComponentTest, LukeRequestHandlerTest, 
TestQueryUtils, DirectSolrSpellCheckerTest, TestOmitPositions, 
MoreLikeThisHandlerTest, TestSolrQueryParser, ReturnFieldsTest, JSONWriterTest, 
QueryParsingTest, BinaryUpdateRequestHandlerTest, 
TestPartialUpdateDeduplication, HighlighterConfigTest, UpdateParamsTest, 
AlternateDirectoryTest, TestSolrIndexConfig, ResponseLogComponentTest, 
SolrIndexConfigTest, TestStressRecovery, TestTolerantSearch, 
TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ConnectionReuseTest, 
AssignTest, AsyncCallRequestStatusResponseTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=AsyncCallRequestStatusResponseTest -Dtests.seed=EEB85D2319B1BB38 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-PY 
-Dtests.timezone=Africa/Bangui -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | AsyncCallRequestStatusResponseTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.AsyncCallRequestStatusResponseTest: 
   [junit4]    >    1) Thread[id=10045, 
name=OverseerHdfsCoreFailoverThread-97215309130235910-127.0.0.1:37421_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([EEB85D2319B1BB38]:0)
   [junit4] Completed [475/675 (1!)] on J1 in 23.65s, 1 test, 1 error <<< 
FAILURES!

[...truncated 63087 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to