Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/305/
Java: 64bit/jdk-9 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=18563, name=Thread-3858, 
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=18563, name=Thread-3858, state=RUNNABLE, 
group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: 
Error from server at http://127.0.0.1:50341/fdp/collection2_shard4_replica_n19: 
java.io.FileNotFoundException: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-5-001/cores/collection2_shard4_replica_n19/data/tlog/tlog.0000000000000000000
 (Too many open files)
        at __randomizedtesting.SeedInfo.seed([A0FB4B59955FACA8]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:549)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:633)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:50341/fdp/collection2_shard4_replica_n19: 
java.io.FileNotFoundException: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-5-001/cores/collection2_shard4_replica_n19/data/tlog/tlog.0000000000000000000
 (Too many open files)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:526)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12777 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/init-core-data-001
   [junit4]   2> 1658681 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[A0FB4B59955FACA8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1658682 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[A0FB4B59955FACA8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776";)
 w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1658682 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[A0FB4B59955FACA8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1658682 INFO  
(SUITE-FullSolrCloudDistribCmdsTest-seed#[A0FB4B59955FACA8]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /fdp/
   [junit4]   2> 1658687 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1658687 INFO  (Thread-3787) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1658687 INFO  (Thread-3787) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1658691 ERROR (Thread-3787) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1658794 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:50306
   [junit4]   2> 1658823 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1658830 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1658857 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1658863 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1658866 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1658875 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1658878 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1658881 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1658894 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1658916 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1658924 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1658929 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly 
asked otherwise
   [junit4]   2> 1659512 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer 
CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE 
RESOURCE LEAK!!!  instance=847644121
   [junit4]   2> 1659512 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer 
CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE 
RESOURCE LEAK!!!  instance=501860838
   [junit4]   2> 1659512 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer 
CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE 
RESOURCE LEAK!!!  instance=492178562
   [junit4]   2> 1659512 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer 
CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE 
RESOURCE LEAK!!!  instance=313675857
   [junit4]   2> 1659903 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1659907 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4f4942d5{/fdp,null,AVAILABLE}
   [junit4]   2> 1659911 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@67a0b69b{HTTP/1.1,[http/1.1]}{127.0.0.1:50309}
   [junit4]   2> 1659911 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1661805ms
   [junit4]   2> 1659911 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/control/data,
 hostPort=50309, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/control-001/cores}
   [junit4]   2> 1659911 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1659912 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1659912 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1659912 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1659912 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:40:51.564378Z
   [junit4]   2> 1659915 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1659916 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/control-001/solr.xml
   [junit4]   2> 1659919 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1659919 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1659920 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1659926 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50306/solr
   [junit4]   2> 1660126 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1660127 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50309_fdp
   [junit4]   2> 1660128 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer 
(id=98993625520013316-127.0.0.1:50309_fdp-n_0000000000) starting
   [junit4]   2> 1660142 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50309_fdp
   [junit4]   2> 1660149 INFO  
(OverseerStateUpdate-98993625520013316-127.0.0.1:50309_fdp-n_0000000000) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1660216 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1660244 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1660244 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1660255 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/control-001/cores
   [junit4]   2> 1660292 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1660293 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50306/solr ready
   [junit4]   2> 1660305 INFO  (qtp1402578947-18187) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50309_fdp&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1660313 INFO  (OverseerThreadFactory-7785-thread-1) [    ] 
o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1660434 INFO  (qtp1402578947-18188) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1660434 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1660544 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1661462 INFO  (qtp1402578947-18188) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1661499 INFO  (qtp1402578947-18188) [    ] o.a.s.s.IndexSchema 
[control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1661594 INFO  (qtp1402578947-18188) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1661637 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' 
using configuration from collection control_collection, trusted=true
   [junit4]   2> 1661638 INFO  (qtp1402578947-18188) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.control_collection.shard1.replica_n1' (registry 
'solr.core.control_collection.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1661638 INFO  (qtp1402578947-18188) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1661638 INFO  (qtp1402578947-18188) [    ] o.a.s.c.SolrCore 
[[control_collection_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/control-001/cores/control_collection_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1661641 INFO  (qtp1402578947-18188) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=44.7080078125, 
floorSegmentMB=0.4990234375, forceMergeDeletesPctAllowed=27.3280515232123, 
segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1661654 WARN  (qtp1402578947-18188) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1661721 INFO  (qtp1402578947-18188) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1661721 INFO  (qtp1402578947-18188) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1661723 INFO  (qtp1402578947-18188) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1661723 INFO  (qtp1402578947-18188) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1661725 INFO  (qtp1402578947-18188) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=36.7373046875, 
floorSegmentMB=1.1181640625, forceMergeDeletesPctAllowed=22.236436396975687, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.65960882987068
   [junit4]   2> 1661726 INFO  (qtp1402578947-18188) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2054f99d[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1661727 INFO  (qtp1402578947-18188) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1661728 INFO  (qtp1402578947-18188) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1661728 INFO  (qtp1402578947-18188) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1661729 INFO  (qtp1402578947-18188) [    ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1583898011506835456
   [junit4]   2> 1661730 INFO  (searcherExecutor-7788-thread-1) [    ] 
o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher 
Searcher@2054f99d[control_collection_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:50309/fdp/control_collection_shard1_replica_n1/
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:50309/fdp/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1661736 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1661741 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:50309/fdp/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1661867 INFO  (zkCallback-3560-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1661923 INFO  (qtp1402578947-18188) [    ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1661927 INFO  (qtp1402578947-18188) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1493
   [junit4]   2> 1661931 INFO  (qtp1402578947-18187) [    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1662053 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1662328 INFO  
(OverseerCollectionConfigSetProcessor-98993625520013316-127.0.0.1:50309_fdp-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1662942 INFO  (qtp1402578947-18187) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50309_fdp&wt=javabin&version=2}
 status=0 QTime=2642
   [junit4]   2> 1662947 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1662949 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50306/solr ready
   [junit4]   2> 1662949 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1662950 INFO  (qtp1402578947-18190) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1662954 INFO  (OverseerThreadFactory-7785-thread-2) [    ] 
o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1662955 WARN  (OverseerThreadFactory-7785-thread-2) [    ] 
o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) 
without cores.
   [junit4]   2> 1663177 INFO  (qtp1402578947-18190) [    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1663178 INFO  (qtp1402578947-18190) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=2&wt=javabin&version=2}
 status=0 QTime=227
   [junit4]   2> 1663466 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001
 of type NRT
   [junit4]   2> 1663466 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1663468 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@63bbe8b1{/fdp,null,AVAILABLE}
   [junit4]   2> 1663468 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4e2736e{HTTP/1.1,[http/1.1]}{127.0.0.1:50318}
   [junit4]   2> 1663468 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1665362ms
   [junit4]   2> 1663468 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solrconfig=solrconfig.xml, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/jetty1,
 hostPort=50318, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001/cores,
 replicaType=NRT}
   [junit4]   2> 1663469 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1663469 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1663469 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663469 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1663469 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:40:55.121745Z
   [junit4]   2> 1663493 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1663493 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001/solr.xml
   [junit4]   2> 1663496 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1663496 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1663496 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1663500 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50306/solr
   [junit4]   2> 1663527 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1663531 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663534 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50318_fdp
   [junit4]   2> 1663536 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1663538 INFO  (zkCallback-3568-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1663559 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1663608 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1663624 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1663625 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1663627 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001/cores
   [junit4]   2> 1663665 INFO  (qtp1402578947-18192) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params 
node=127.0.0.1:50318_fdp&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1663669 INFO  
(OverseerCollectionConfigSetProcessor-98993625520013316-127.0.0.1:50309_fdp-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1663670 INFO  (OverseerThreadFactory-7785-thread-3) [    ] 
o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:50318_fdp for creating new 
replica
   [junit4]   2> 1663682 INFO  (qtp732510047-18234) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1663682 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1663792 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1664698 INFO  (qtp732510047-18234) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1664709 INFO  (qtp732510047-18234) [    ] o.a.s.s.IndexSchema 
[collection1_shard2_replica_n61] Schema name=test
   [junit4]   2> 1664835 INFO  (qtp732510047-18234) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1664889 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61' using 
configuration from collection collection1, trusted=true
   [junit4]   2> 1664889 INFO  (qtp732510047-18234) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard2.replica_n61' (registry 
'solr.core.collection1.shard2.replica_n61') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1664889 INFO  (qtp732510047-18234) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1664890 INFO  (qtp732510047-18234) [    ] o.a.s.c.SolrCore 
[[collection1_shard2_replica_n61] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001/cores/collection1_shard2_replica_n61],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
   [junit4]   2> 1664892 INFO  (qtp732510047-18234) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=44.7080078125, 
floorSegmentMB=0.4990234375, forceMergeDeletesPctAllowed=27.3280515232123, 
segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1664922 WARN  (qtp732510047-18234) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1665026 INFO  (qtp732510047-18234) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1665026 INFO  (qtp732510047-18234) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1665028 INFO  (qtp732510047-18234) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1665028 INFO  (qtp732510047-18234) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1665029 INFO  (qtp732510047-18234) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=36.7373046875, 
floorSegmentMB=1.1181640625, forceMergeDeletesPctAllowed=22.236436396975687, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.65960882987068
   [junit4]   2> 1665030 INFO  (qtp732510047-18234) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2e29dc56[collection1_shard2_replica_n61] main]
   [junit4]   2> 1665031 INFO  (qtp732510047-18234) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1665033 INFO  (qtp732510047-18234) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1665033 INFO  (qtp732510047-18234) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1665034 INFO  (qtp732510047-18234) [    ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1583898014972379136
   [junit4]   2> 1665035 INFO  (searcherExecutor-7799-thread-1) [    ] 
o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher 
Searcher@2e29dc56[collection1_shard2_replica_n61] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:50318/fdp/collection1_shard2_replica_n61/
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] o.a.s.c.SyncStrategy 
http://127.0.0.1:50318/fdp/collection1_shard2_replica_n61/ has no replicas
   [junit4]   2> 1665040 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1665046 INFO  (qtp732510047-18234) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:50318/fdp/collection1_shard2_replica_n61/ shard2
   [junit4]   2> 1665157 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1665172 INFO  (qtp732510047-18234) [    ] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 1665176 INFO  (qtp732510047-18234) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1501
   [junit4]   2> 1665202 INFO  (qtp1402578947-18192) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:50318_fdp&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
 status=0 QTime=1537
   [junit4]   2> 1665277 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 1665672 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001
 of type NRT
   [junit4]   2> 1665673 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1665675 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3181ee9c{/fdp,null,AVAILABLE}
   [junit4]   2> 1665676 INFO  
(OverseerCollectionConfigSetProcessor-98993625520013316-127.0.0.1:50309_fdp-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1665676 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@5a2de6c7{HTTP/1.1,[http/1.1]}{127.0.0.1:50325}
   [junit4]   2> 1665676 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1667570ms
   [junit4]   2> 1665676 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solrconfig=solrconfig.xml, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/jetty2,
 hostPort=50325, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001/cores,
 replicaType=NRT}
   [junit4]   2> 1665676 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1665676 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1665677 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1665677 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1665677 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:40:57.329215Z
   [junit4]   2> 1665681 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1665681 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001/solr.xml
   [junit4]   2> 1665683 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1665683 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1665684 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1665687 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50306/solr
   [junit4]   2> 1665705 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1665709 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1665716 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50325_fdp
   [junit4]   2> 1665718 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1665718 INFO  (zkCallback-3568-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1665718 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1665719 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1665801 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1665833 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1665833 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1665840 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001/cores
   [junit4]   2> 1665920 INFO  (qtp1402578947-18185) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params 
node=127.0.0.1:50325_fdp&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1665925 INFO  (OverseerThreadFactory-7785-thread-4) [    ] 
o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:50325_fdp for creating new 
replica
   [junit4]   2> 1665929 INFO  (qtp1655939287-18263) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1665929 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1666041 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1666042 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1667000 INFO  (qtp1655939287-18263) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1667010 INFO  (qtp1655939287-18263) [    ] o.a.s.s.IndexSchema 
[collection1_shard3_replica_n63] Schema name=test
   [junit4]   2> 1667087 INFO  (qtp1655939287-18263) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1667150 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63' using 
configuration from collection collection1, trusted=true
   [junit4]   2> 1667150 INFO  (qtp1655939287-18263) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard3.replica_n63' (registry 
'solr.core.collection1.shard3.replica_n63') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1667150 INFO  (qtp1655939287-18263) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1667151 INFO  (qtp1655939287-18263) [    ] o.a.s.c.SolrCore 
[[collection1_shard3_replica_n63] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001/cores/collection1_shard3_replica_n63],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
   [junit4]   2> 1667153 INFO  (qtp1655939287-18263) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=44.7080078125, 
floorSegmentMB=0.4990234375, forceMergeDeletesPctAllowed=27.3280515232123, 
segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1667156 WARN  (qtp1655939287-18263) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1667261 INFO  (qtp1655939287-18263) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1667261 INFO  (qtp1655939287-18263) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1667263 INFO  (qtp1655939287-18263) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1667264 INFO  (qtp1655939287-18263) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1667265 INFO  (qtp1655939287-18263) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=36.7373046875, 
floorSegmentMB=1.1181640625, forceMergeDeletesPctAllowed=22.236436396975687, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.65960882987068
   [junit4]   2> 1667265 INFO  (qtp1655939287-18263) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5ef2d49f[collection1_shard3_replica_n63] main]
   [junit4]   2> 1667268 INFO  (qtp1655939287-18263) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1667268 INFO  (qtp1655939287-18263) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1667269 INFO  (qtp1655939287-18263) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1667270 INFO  (searcherExecutor-7810-thread-1) [    ] 
o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher 
Searcher@5ef2d49f[collection1_shard3_replica_n63] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1667270 INFO  (qtp1655939287-18263) [    ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1583898017316995072
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:50325/fdp/collection1_shard3_replica_n63/
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.SyncStrategy http://127.0.0.1:50325/fdp/collection1_shard3_replica_n63/ 
has no replicas
   [junit4]   2> 1667277 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1667282 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:50325/fdp/collection1_shard3_replica_n63/ shard3
   [junit4]   2> 1667421 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1667422 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1667449 INFO  (qtp1655939287-18263) [    ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1667453 INFO  (qtp1655939287-18263) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1523
   [junit4]   2> 1667457 INFO  (qtp1402578947-18185) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:50325_fdp&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2}
 status=0 QTime=1536
   [junit4]   2> 1667560 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1667560 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1667928 INFO  
(OverseerCollectionConfigSetProcessor-98993625520013316-127.0.0.1:50309_fdp-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1667989 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001
 of type NRT
   [junit4]   2> 1667989 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1667991 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@36e08586{/fdp,null,AVAILABLE}
   [junit4]   2> 1667991 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@36c66c2d{HTTP/1.1,[http/1.1]}{127.0.0.1:50330}
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1669885ms
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solrconfig=solrconfig.xml, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/jetty3,
 hostPort=50330, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001/cores}
   [junit4]   2> 1667992 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1667992 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:40:59.644738Z
   [junit4]   2> 1667998 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1667998 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001/solr.xml
   [junit4]   2> 1668000 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1668000 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1668001 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1668012 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50306/solr
   [junit4]   2> 1668042 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1668046 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1668051 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50330_fdp
   [junit4]   2> 1668053 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1668053 INFO  (zkCallback-3568-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1668053 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1668053 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1668060 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1668122 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1668147 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1668147 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1668149 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001/cores
   [junit4]   2> 1668200 INFO  (qtp1402578947-18189) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params 
node=127.0.0.1:50330_fdp&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1668212 INFO  (OverseerThreadFactory-7785-thread-5) [    ] 
o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:50330_fdp for creating new 
replica
   [junit4]   2> 1668216 INFO  (qtp704397963-18292) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1668217 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1668328 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1668328 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1668328 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669235 INFO  (qtp704397963-18292) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1669267 INFO  (qtp704397963-18292) [    ] o.a.s.s.IndexSchema 
[collection1_shard1_replica_n65] Schema name=test
   [junit4]   2> 1669328 INFO  (qtp704397963-18292) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1669378 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65' using 
configuration from collection collection1, trusted=true
   [junit4]   2> 1669379 INFO  (qtp704397963-18292) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard1.replica_n65' (registry 
'solr.core.collection1.shard1.replica_n65') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1669379 INFO  (qtp704397963-18292) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1669379 INFO  (qtp704397963-18292) [    ] o.a.s.c.SolrCore 
[[collection1_shard1_replica_n65] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001/cores/collection1_shard1_replica_n65],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
   [junit4]   2> 1669382 INFO  (qtp704397963-18292) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=44.7080078125, 
floorSegmentMB=0.4990234375, forceMergeDeletesPctAllowed=27.3280515232123, 
segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1669384 WARN  (qtp704397963-18292) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1669441 INFO  (qtp704397963-18292) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1669441 INFO  (qtp704397963-18292) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1669442 INFO  (qtp704397963-18292) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1669443 INFO  (qtp704397963-18292) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1669444 INFO  (qtp704397963-18292) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=36.7373046875, 
floorSegmentMB=1.1181640625, forceMergeDeletesPctAllowed=22.236436396975687, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.65960882987068
   [junit4]   2> 1669444 INFO  (qtp704397963-18292) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@3855bf[collection1_shard1_replica_n65] main]
   [junit4]   2> 1669446 INFO  (qtp704397963-18292) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1669446 INFO  (qtp704397963-18292) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1669447 INFO  (qtp704397963-18292) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1669447 INFO  (qtp704397963-18292) [    ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1583898019599745024
   [junit4]   2> 1669448 INFO  (searcherExecutor-7821-thread-1) [    ] 
o.a.s.c.SolrCore [collection1_shard1_replica_n65] Registered new searcher 
Searcher@3855bf[collection1_shard1_replica_n65] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:50330/fdp/collection1_shard1_replica_n65/
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] o.a.s.c.SyncStrategy 
http://127.0.0.1:50330/fdp/collection1_shard1_replica_n65/ has no replicas
   [junit4]   2> 1669454 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1669460 INFO  (qtp704397963-18292) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:50330/fdp/collection1_shard1_replica_n65/ shard1
   [junit4]   2> 1669566 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669566 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669566 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669573 INFO  (qtp704397963-18292) [    ] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 1669577 INFO  (qtp704397963-18292) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1360
   [junit4]   2> 1669581 INFO  (qtp1402578947-18189) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:50330_fdp&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2}
 status=0 QTime=1381
   [junit4]   2> 1669686 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669686 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669686 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 1669966 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001
 of type NRT
   [junit4]   2> 1669967 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1669969 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6117d32d{/fdp,null,AVAILABLE}
   [junit4]   2> 1669969 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3f41672b{HTTP/1.1,[http/1.1]}{127.0.0.1:50335}
   [junit4]   2> 1669969 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1671863ms
   [junit4]   2> 1669969 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solrconfig=solrconfig.xml, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/jetty4,
 hostPort=50335, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001/cores,
 replicaType=NRT}
   [junit4]   2> 1669969 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1669970 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1669970 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1669970 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1669970 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:41:01.622223Z
   [junit4]   2> 1669975 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1669975 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001/solr.xml
   [junit4]   2> 1669978 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1669978 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1669979 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1669984 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50306/solr
   [junit4]   2> 1670005 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1670013 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1670017 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50335_fdp
   [junit4]   2> 1670020 INFO  (zkCallback-3568-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670020 INFO  (zkCallback-3560-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670020 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670020 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670021 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670021 INFO  (zkCallback-3591-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1670074 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1670093 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1670094 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1670097 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001/cores
   [junit4]   2> 1670183 INFO  (qtp1402578947-18188) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params 
node=127.0.0.1:50335_fdp&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1670187 INFO  
(OverseerCollectionConfigSetProcessor-98993625520013316-127.0.0.1:50309_fdp-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1670188 INFO  (OverseerThreadFactory-7785-thread-5) [    ] 
o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:50335_fdp for creating new 
replica
   [junit4]   2> 1670192 INFO  (qtp421698380-18321) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n67&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1670193 INFO  (qtp421698380-18321) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
transient cores
   [junit4]   2> 1670302 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1670302 INFO  (zkCallback-3591-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1670302 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1670304 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671213 INFO  (qtp421698380-18321) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1671228 INFO  (qtp421698380-18321) [    ] o.a.s.s.IndexSchema 
[collection1_shard2_replica_n67] Schema name=test
   [junit4]   2> 1671323 INFO  (qtp421698380-18321) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1671346 INFO  (qtp421698380-18321) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n67' using 
configuration from collection collection1, trusted=true
   [junit4]   2> 1671347 INFO  (qtp421698380-18321) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard2.replica_n67' (registry 
'solr.core.collection1.shard2.replica_n67') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1ca93d3f
   [junit4]   2> 1671347 INFO  (qtp421698380-18321) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1671347 INFO  (qtp421698380-18321) [    ] o.a.s.c.SolrCore 
[[collection1_shard2_replica_n67] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001/cores/collection1_shard2_replica_n67],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-4-001/cores/collection1_shard2_replica_n67/data/]
   [junit4]   2> 1671350 INFO  (qtp421698380-18321) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=44.7080078125, 
floorSegmentMB=0.4990234375, forceMergeDeletesPctAllowed=27.3280515232123, 
segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1671353 WARN  (qtp421698380-18321) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1671400 INFO  (qtp421698380-18321) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1671400 INFO  (qtp421698380-18321) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1671401 INFO  (qtp421698380-18321) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1671401 INFO  (qtp421698380-18321) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1671402 INFO  (qtp421698380-18321) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=36.7373046875, 
floorSegmentMB=1.1181640625, forceMergeDeletesPctAllowed=22.236436396975687, 
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.65960882987068
   [junit4]   2> 1671402 INFO  (qtp421698380-18321) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5acc297f[collection1_shard2_replica_n67] main]
   [junit4]   2> 1671404 INFO  (qtp421698380-18321) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1671404 INFO  (qtp421698380-18321) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1671405 INFO  (qtp421698380-18321) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1671406 INFO  (searcherExecutor-7832-thread-1) [    ] 
o.a.s.c.SolrCore [collection1_shard2_replica_n67] Registered new searcher 
Searcher@5acc297f[collection1_shard2_replica_n67] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1671406 INFO  (qtp421698380-18321) [    ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1583898021653905408
   [junit4]   2> 1671409 INFO  (qtp421698380-18321) [    ] o.a.s.c.ZkController 
Core needs to recover:collection1_shard2_replica_n67
   [junit4]   2> 1671410 INFO  (updateExecutor-3588-thread-1) [    ] 
o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1671410 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 1671412 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 1671412 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Begin buffering updates. 
core=[collection1_shard2_replica_n67]
   [junit4]   2> 1671412 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, 
tlog=null}
   [junit4]   2> 1671412 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Publishing state of core 
[collection1_shard2_replica_n67] as recovering, leader is 
[http://127.0.0.1:50318/fdp/collection1_shard2_replica_n61/] and I am 
[http://127.0.0.1:50335/fdp/collection1_shard2_replica_n67/]
   [junit4]   2> 1671412 INFO  (qtp421698380-18321) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n67&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1220
   [junit4]   2> 1671414 INFO  (recoveryExecutor-3589-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Sending prep recovery command to 
[http://127.0.0.1:50318/fdp]; [WaitForState: 
action=PREPRECOVERY&core=collection1_shard2_replica_n61&nodeName=127.0.0.1:50335_fdp&coreNodeName=core_node68&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 1671415 INFO  (qtp732510047-18236) [    ] 
o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node68, state: 
recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, 
maxTime: 183 s
   [junit4]   2> 1671415 INFO  (qtp1402578947-18188) [    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={node=127.0.0.1:50335_fdp&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
 status=0 QTime=1232
   [junit4]   2> 1671416 INFO  (qtp732510047-18236) [    ] 
o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, 
shard=shard2, thisCore=collection1_shard2_replica_n61, 
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, 
currentState=down, localState=active, nodeName=127.0.0.1:50335_fdp, 
coreNodeName=core_node68, onlyIfActiveCheckResult=false, nodeProps: 
core_node68:{"core":"collection1_shard2_replica_n67","base_url":"http://127.0.0.1:50335/fdp","node_name":"127.0.0.1:50335_fdp","state":"down","type":"NRT"}
   [junit4]   2> 1671517 INFO  (zkCallback-3591-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671517 INFO  (zkCallback-3585-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671517 INFO  (zkCallback-3579-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671517 INFO  (zkCallback-3573-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [5])
   [junit4]   2> 1671952 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 5 in directory 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-5-001
 of type NRT
   [junit4]   2> 1671952 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1671953 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1a1d1157{/fdp,null,AVAILABLE}
   [junit4]   2> 1671954 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4a1211fa{HTTP/1.1,[http/1.1]}{127.0.0.1:50341}
   [junit4]   2> 1671954 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.e.j.s.Server Started @1673848ms
   [junit4]   2> 1671954 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/fdp, 
solrconfig=solrconfig.xml, 
solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/tempDir-001/jetty5,
 hostPort=50341, 
coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A0FB4B59955FACA8-001/shard-5-001/cores}
   [junit4]   2> 1671954 ERROR 
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1671955 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.2.0
   [junit4]   2> 1671955 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1671955 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1671955 INFO  
(TEST-FullSolrCloudDistribCmdsTest.test-seed#[A0FB4B59955FACA8]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-11-12T21:41:03.607156Z
   [jun

[...truncated too long message...]

0, 7grand5_s=Lucene50(blocksize=128), 4grand0_s=FSTOrd50, 
7grand1_s=Lucene50(blocksize=128), 9grand7_s=FSTOrd50, 8grand0_s=FSTOrd50, 
9grand3_s=FSTOrd50, 
6parent_f2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
8grand4_s=FSTOrd50, 0parent_f2_s=FST50, 3grand1_s=Lucene50(blocksize=128), 
13grand9_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
4parent_f1_s=Lucene50(blocksize=128), 
11grand10_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
5child3_s=FSTOrd50, 9parent_f2_s=Lucene50(blocksize=128), 
a_t=Lucene50(blocksize=128), 6child2_s=Lucene50(blocksize=128), 
7child5_s=FSTOrd50, id=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
5grand3_s=Lucene50(blocksize=128), 7child1_s=FSTOrd50, 
1parent_f1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
7child0_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
6child1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
12grand10_s=FSTOrd50, 13grand0_s=Lucene50(blocksize=128), _root_=FSTOrd50, 
5child2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
13grand4_s=Lucene50(blocksize=128), 12grand5_s=FSTOrd50, 
3child0_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
4child3_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 1grand0_s=FST50, 
11grand2_s=Lucene50(blocksize=128), 12grand1_s=FSTOrd50, 
11grand6_s=Lucene50(blocksize=128), 10grand7_s=FSTOrd50, 7parent_f1_s=FST50, 
2child1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
3parent_f2_s=FSTOrd50, 10grand3_s=FSTOrd50, 
13grand12_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 6grand3_s=FST50, 
5grand2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
10grand9_s=Lucene50(blocksize=128), 4grand1_s=FST50, 
7grand4_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
3grand0_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
9grand6_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 8grand1_s=FST50, 
9grand2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
12grand7_s=Lucene50(blocksize=128), 8grand5_s=FST50, 
13grand8_s=Lucene50(blocksize=128), 
9parent_f1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
1parent_f2_s=Lucene50(blocksize=128), 6child3_s=FST50, 
7grand0_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), text_t=FSTOrd50, 
7child4_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), type_s=FSTOrd50, 
12grand11_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
5child1_s=Lucene50(blocksize=128), 10parent_f1_s=FST50, 13grand3_s=FST50, 
11grand1_s=FST50, 12grand6_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
10grand0_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
4child0_s=Lucene50(blocksize=128), 11grand5_s=FST50, 
12grand2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
10grand8_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
10grand4_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
5grand1_s=FSTOrd50, 6grand4_s=Lucene50(blocksize=128), 
4grand2_s=Lucene50(blocksize=128), 7grand3_s=FSTOrd50, 11grand9_s=FST50, 
8grand2_s=Lucene50(blocksize=128), 9grand5_s=Lucene50(blocksize=128), 
8grand6_s=Lucene50(blocksize=128), 9grand1_s=Lucene50(blocksize=128), 
12grand8_s=FST50, 13grand7_s=FST50, 6child4_s=FSTOrd50, 
5parent_f1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
6grand0_s=Lucene50(blocksize=128), 7child3_s=Lucene50(blocksize=128), 
10parent_f2_s=Lucene50(blocksize=128), 5child0_s=FST50, 
8parent_f1_s=Lucene50(blocksize=128), 13grand2_s=FSTOrd50, 
2parent_f2_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
11grand0_s=FSTOrd50, 12grand3_s=Lucene50(blocksize=128), 4child1_s=FST50, 
2grand1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
11grand4_s=FSTOrd50, 3child2_s=FST50, 10grand5_s=Lucene50(blocksize=128), 
1child0_s=FST50, 10grand1_s=Lucene50(blocksize=128), 13grand10_s=FST50, 
7grand6_s=FST50, 5grand0_s=FST50, 
6grand5_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 7grand2_s=FST50, 
4grand3_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 9grand8_s=FST50, 
11grand8_s=FSTOrd50, 
8grand3_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
6parent_f1_s=FSTOrd50, 9grand4_s=FST50, 12grand9_s=FSTOrd50, 
8grand7_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
0parent_f1_s=Lucene50(blocksize=128), 3grand2_s=FST50, 9grand0_s=FST50, 
4parent_f2_s=FST50, 13grand6_s=FSTOrd50, 5child4_s=FST50, 7child6_s=FST50, 
6child5_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 7child2_s=FST50, 
5grand4_s=FST50, 6grand1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
5parent_f2_s=Lucene50(blocksize=128), 6child0_s=FSTOrd50, 
13grand1_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
8parent_f2_s=FST50, 
13grand5_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
2parent_f1_s=FSTOrd50, 4child2_s=FSTOrd50, 
rnd_b=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
11grand3_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 12grand4_s=FST50, 
2grand0_s=FSTOrd50, 
11grand7_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 12grand0_s=FST50, 
3child1_s=Lucene50(blocksize=128), 10grand6_s=FST50, 7parent_f2_s=FSTOrd50, 
10grand2_s=FST50, 2child0_s=Lucene50(blocksize=128), 13grand11_s=FSTOrd50, 
3parent_f1_s=FST50}, docValues:{_version_=DocValuesFormat(name=Lucene70)}, 
maxPointsInLeafNode=745, maxMBSortInHeap=6.845520754469819, 
sim=RandomSimilarity(queryNorm=true): {}, locale=es-PE, 
timezone=Atlantic/Jan_Mayen
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 
(64-bit)/cpus=3,threads=1,free=199833560,total=505413632
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestRandomRequestDistribution, ScriptEngineTest, ComputePlanActionTest, 
TestQuerySenderListener, TestRangeQuery, 
DistributedFacetPivotSmallAdvancedTest, TestCorePropertiesReload, 
TestConfigSetProperties, TestRequestStatusCollectionAPI, TestCustomSort, 
RuleEngineTest, TestTolerantSearch, HdfsAutoAddReplicasIntegrationTest, 
HdfsBasicDistributedZkTest, TestExportWriter, SuggesterWFSTTest, UtilsToolTest, 
MinimalSchemaTest, AddReplicaTest, AutoAddReplicasPlanActionTest, 
NoCacheHeaderTest, TestPointFields, ShowFileRequestHandlerTest, 
ReplicationFactorTest, ConvertedLegacyTest, RecoveryZkTest, 
TestShardHandlerFactory, HighlighterTest, BJQParserTest, OutputWriterTest, 
StatsReloadRaceTest, JvmMetricsTest, TestManagedStopFilterFactory, 
TestSizeLimitedDistributedMap, TestNRTOpen, TestDeleteCollectionOnDownNodes, 
SpellCheckCollatorTest, HdfsTlogReplayBufferedWhileIndexingTest, 
TestXIncludeConfig, StatsComponentTest, TestUtils, ExitableDirectoryReaderTest, 
CheckHdfsIndexTest, TestStressInPlaceUpdates, 
DistributedFacetPivotWhiteBoxTest, IndexBasedSpellCheckerTest, 
TestBulkSchemaAPI, RAMDirectoryFactoryTest, TestRecoveryHdfs, 
TestRandomDVFaceting, ShardRoutingTest, TestHalfAndHalfDocValues, 
TestCoreAdminApis, IndexSchemaTest, SyncSliceTest, TestNumericTerms64, 
TestPKIAuthenticationPlugin, DistributedFacetPivotLargeTest, 
TestHighlightDedupGrouping, TestSolrCLIRunExample, CollectionsAPISolrJTest, 
TestSolrCloudSnapshots, TestImpersonationWithHadoopAuth, 
SignatureUpdateProcessorFactoryTest, TestPhraseSuggestions, 
TestCursorMarkWithoutUniqueKey, TestDocBasedVersionConstraints, 
CircularListTest, CdcrUpdateLogTest, SpatialHeatmapFacetsTest, 
ClassificationUpdateProcessorTest, TestLMDirichletSimilarityFactory, 
TestPolicyCloud, TestFieldCollectionResource, ReplicaListTransformerTest, 
CoreMergeIndexesAdminHandlerTest, TestCloudPseudoReturnFields, 
TestSolrCoreParser, TestExpandComponent, GraphQueryTest, BadIndexSchemaTest, 
TestPseudoReturnFields, DistribCursorPagingTest, 
TestEmbeddedSolrServerSchemaAPI, TestSchemalessBufferedUpdates, 
DistributedSpellCheckComponentTest, TestCloudSchemaless, QueryResultKeyTest, 
TestSolrDeletionPolicy2, TestPushWriter, SolrShardReporterTest, 
SolrGangliaReporterTest, TestReplicaProperties, TestAtomicUpdateErrorCases, 
TestInPlaceUpdatesStandalone, SolrCmdDistributorTest, NotRequiredUniqueKeyTest, 
HLLUtilTest, SolrXmlInZkTest, FastVectorHighlighterTest, 
TestReplicationHandler, SubstringBytesRefFilterTest, TestConfigSetsAPI, 
TestLegacyFieldCache, TestSchemaSimilarityResource, ResponseHeaderTest, 
TestFreeTextSuggestions, AsyncCallRequestStatusResponseTest, 
TestNumericTokenStream, TestZkAclsWithHadoopAuth, 
SharedFSAutoReplicaFailoverTest, TestFiltering, CreateCollectionCleanupTest, 
DirectUpdateHandlerOptimizeTest, TestBulkSchemaConcurrent, 
TestQuerySenderNoQuery, ConfigSetsAPITest, TestManagedResourceStorage, 
TestInfoStreamLogging, ChaosMonkeySafeLeaderWithPullReplicasTest, 
SolrInfoBeanTest, DefaultValueUpdateProcessorTest, 
ChaosMonkeyNothingIsSafeTest, TestNoOpRegenerator, 
TestEmbeddedSolrServerAdminHandler, TestRawTransformer, TestOrdValues, 
ReturnFieldsTest, TestObjectReleaseTracker, TestIBSimilarityFactory, 
TestSweetSpotSimilarityFactory, TestDistribIDF, ForceLeaderTest, 
AssignBackwardCompatibilityTest, FieldAnalysisRequestHandlerTest, 
TestCollectionAPIs, TestFilteredDocIdSet, TestXmlQParserPlugin, 
BaseCdcrDistributedZkTest, PeerSyncReplicationTest, CursorPagingTest, 
TestScoreJoinQPScore, TestSolrConfigHandlerCloud, ClusterStateUpdateTest, 
TestGraphMLResponseWriter, TestDownShardTolerantSearch, DistanceFunctionTest, 
TestPivotHelperCode, TestStandardQParsers, TestFieldTypeCollectionResource, 
TestMacroExpander, TestRealTimeGet, UnloadDistributedZkTest, 
SolrCLIZkUtilsTest, TestIndexingPerformance, TestRecovery, DateFieldTest, 
TestIntervalFaceting, OverriddenZkACLAndCredentialsProvidersTest, TestJoin, 
CdcrVersionReplicationTest, MetricUtilsTest, MoveReplicaHDFSFailoverTest, 
BooleanFieldTest, TestNestedDocsSort, UniqFieldsUpdateProcessorFactoryTest, 
ManagedSchemaRoundRobinCloudTest, JavabinLoaderTest, TestHashQParserPlugin, 
BlockJoinFacetRandomTest, CollectionReloadTest, ConnectionReuseTest, 
TestClassicSimilarityFactory, TestLegacyNumericRangeQueryBuilder, 
CdcrBootstrapTest, UninvertDocValuesMergePolicyTest, HdfsLockFactoryTest, 
SuggesterFSTTest, TestSolrCloudWithDelegationTokens, 
DistributedTermsComponentTest, SolrRequestParserTest, OpenCloseCoreStressTest, 
OverseerTest, FullSolrCloudDistribCmdsTest]
   [junit4] Completed [386/748 (1!)] on J0 in 111.93s, 1 test, 1 error <<< 
FAILURES!

[...truncated 41308 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to