This is a valid bug caused by assertions added in SOLR-8069. See https://issues.apache.org/jira/browse/SOLR-8069?focusedCommentId=14968664&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14968664
On Thu, Oct 22, 2015 at 12:17 PM, Apache Jenkins Server <jenk...@builds.apache.org> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/993/ > > 1 tests failed. > FAILED: > org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR > > Error Message: > Captured an uncaught exception in thread: Thread[id=43491, > name=coreZkRegister-5997-thread-1, state=RUNNABLE, > group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] > > Stack Trace: > com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=43491, > name=coreZkRegister-5997-thread-1, state=RUNNABLE, > group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] > Caused by: java.lang.AssertionError > at __randomizedtesting.SeedInfo.seed([7F78F76DDF75FAD1]:0) > at > org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2133) > at > org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:434) > at > org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) > at > org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) > at > org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) > at > org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113) > at org.apache.solr.cloud.ZkController.register(ZkController.java:926) > at org.apache.solr.cloud.ZkController.register(ZkController.java:881) > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > > > Build Log: > [...truncated 11227 lines...] > [junit4] Suite: > org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest > [junit4] 2> Creating dataDir: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/init-core-data-001 > [junit4] 2> 2804605 INFO > (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[7F78F76DDF75FAD1]-worker) > [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system > property: / > [junit4] 2> 2804608 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER > [junit4] 2> 2804609 INFO (Thread-33860) [ ] o.a.s.c.ZkTestServer > client port:0.0.0.0/0.0.0.0:0 > [junit4] 2> 2804609 INFO (Thread-33860) [ ] o.a.s.c.ZkTestServer > Starting server > [junit4] 2> 2804709 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkTestServer start zk server on port:52462 > [junit4] 2> 2804709 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2804709 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2804712 INFO (zkCallback-2280-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@7a70d2b6 > name:ZooKeeperConnection Watcher:127.0.0.1:52462 got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2804712 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2804712 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2804712 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /solr > [junit4] 2> 2804715 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2804715 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2804716 INFO (zkCallback-2281-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@5128e657 > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2804716 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2804716 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2804716 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 > [junit4] 2> 2804718 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards > [junit4] 2> 2804719 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection > [junit4] 2> 2804720 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: > /collections/control_collection/shards > [junit4] 2> 2804722 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml > to /configs/conf1/solrconfig.xml > [junit4] 2> 2804722 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml > [junit4] 2> 2804724 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml > to /configs/conf1/schema.xml > [junit4] 2> 2804724 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml > [junit4] 2> 2804726 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml > to /configs/conf1/solrconfig.snippet.randomindexconfig.xml > [junit4] 2> 2804726 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: > /configs/conf1/solrconfig.snippet.randomindexconfig.xml > [junit4] 2> 2804728 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt > to /configs/conf1/stopwords.txt > [junit4] 2> 2804728 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt > [junit4] 2> 2804729 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt > to /configs/conf1/protwords.txt > [junit4] 2> 2804730 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt > [junit4] 2> 2804731 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml > to /configs/conf1/currency.xml > [junit4] 2> 2804732 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml > [junit4] 2> 2804733 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml > to /configs/conf1/enumsConfig.xml > [junit4] 2> 2804733 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml > [junit4] 2> 2804738 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json > to /configs/conf1/open-exchange-rates.json > [junit4] 2> 2804738 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: > /configs/conf1/open-exchange-rates.json > [junit4] 2> 2804739 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt > to /configs/conf1/mapping-ISOLatin1Accent.txt > [junit4] 2> 2804740 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: > /configs/conf1/mapping-ISOLatin1Accent.txt > [junit4] 2> 2804741 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt > to /configs/conf1/old_synonyms.txt > [junit4] 2> 2804741 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt > [junit4] 2> 2804743 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractZkTestCase put > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt > to /configs/conf1/synonyms.txt > [junit4] 2> 2804743 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt > [junit4] 2> 2805008 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1 > [junit4] 2> 2805010 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.Server jetty-9.2.13.v20150730 > [junit4] 2> 2805012 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.h.ContextHandler Started > o.e.j.s.ServletContextHandler@665b505c{/,null,AVAILABLE} > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.ServerConnector Started > ServerConnector@68a3874{HTTP/1.1}{127.0.0.1:56746} > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.Server Started @2807895ms > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostPort=56746, > solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/tempDir-001/control/data, > hostContext=/, > coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores} > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): > sun.misc.Launcher$AppClassLoader@1fe91485 > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: > '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/' > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr > (NoInitialContextEx) > [junit4] 2> 2805013 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not > find system property or JNDI) > [junit4] 2> 2805027 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2805028 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2805029 INFO (zkCallback-2282-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@39baa32 > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2805029 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2805029 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2805031 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found > in ZooKeeper) > [junit4] 2> 2805031 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrXmlConfig Loading container configuration from > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/solr.xml > [junit4] 2> 2805043 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoresLocator Config-defined core root directory: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores > [junit4] 2> 2805043 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer New CoreContainer 1984045032 > [junit4] 2> 2805043 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer > [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/] > [junit4] 2> 2805044 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer loading shared library: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/lib > [junit4] 2> 2805044 WARN > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to > classloader: lib (resolved as: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/lib). > [junit4] 2> 2805051 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : > 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : > 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : > 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : > false,useRetries : false, > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client > with params: socketTimeout=340000&connTimeout=45000&retry=true > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j > (org.slf4j.impl.Log4jLoggerFactory)] > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52462/solr > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkController zkHost includes chroot > [junit4] 2> 2805052 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2805054 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2805054 INFO (zkCallback-2284-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@2e9d74e9 > name:ZooKeeperConnection Watcher:127.0.0.1:52462 got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2805054 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2805055 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2805056 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.ConnectionManager Waiting for client to > connect to ZooKeeper > [junit4] 2> 2805057 INFO > (zkCallback-2285-thread-1-processing-n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > ] o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@51ed1947 > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2805058 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.ConnectionManager Client is connected to > ZooKeeper > [junit4] 2> 2805058 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue > [junit4] 2> 2805061 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer/collection-queue-work > [junit4] 2> 2805063 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer/collection-map-running > [junit4] 2> 2805065 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer/collection-map-completed > [junit4] 2> 2805066 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer/collection-map-failure > [junit4] 2> 2805068 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes > [junit4] 2> 2805069 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json > [junit4] 2> 2805070 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json > [junit4] 2> 2805071 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /security.json > [junit4] 2> 2805072 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.ZkController Register node as live in > ZooKeeper:/live_nodes/127.0.0.1:56746_ > [junit4] 2> 2805073 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /live_nodes/127.0.0.1:56746_ > [junit4] 2> 2805074 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect > [junit4] 2> 2805075 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer_elect/election > [junit4] 2> 2805076 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer Overseer (id=null) closing > [junit4] 2> 2805077 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.LeaderElector Joined leadership election > with path: > /overseer_elect/election/94731933327425540-127.0.0.1:56746_-n_0000000000 > [junit4] 2> 2805077 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.OverseerElectionContext I am going to be > the leader 127.0.0.1:56746_ > [junit4] 2> 2805077 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer_elect/leader > [junit4] 2> 2805078 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer Overseer > (id=94731933327425540-127.0.0.1:56746_-n_0000000000) starting > [junit4] 2> 2805080 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.SolrZkClient makePath: > /overseer/queue-work > [junit4] 2> 2805085 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting > OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 > autoReplicaFailoverWaitAfterExpiration=30000 > autoReplicaFailoverBadNodeExpiration=60000 > [junit4] 2> 2805085 INFO > (OverseerCollectionConfigSetProcessor-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.OverseerTaskProcessor Process current queue > of overseer operations > [junit4] 2> 2805085 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.c.ZkStateReader Updating cluster state from > ZooKeeper... > [junit4] 2> 2805085 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer Starting to work on the main queue > [junit4] 2> 2805108 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.CoreContainer Security conf doesn't exist. > Skipping setup for authorization module. > [junit4] 2> 2805109 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.CoreContainer No authentication plugin used. > [junit4] 2> 2805110 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.CoresLocator Looking for core definitions > underneath > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores > [junit4] 2> 2805110 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.SolrCore Created CoreDescriptor: > {loadOnStartup=true, configSetProperties=configsetprops.json, coreNodeName=, > dataDir=data/, name=collection1, config=solrconfig.xml, > collection=control_collection, > absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/, > > instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1, > shard=, transient=false, schema=schema.xml} > [junit4] 2> 2805110 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.CoresLocator Found core collection1 in > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/ > [junit4] 2> 2805111 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.c.CoresLocator Found 1 core definitions > [junit4] 2> 2805111 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.s.SolrDispatchFilter > user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2 > [junit4] 2> 2805111 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:56746_ ] o.a.s.s.SolrDispatchFilter > SolrDispatchFilter.init() done > [junit4] 2> 2805112 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController publishing state=down > [junit4] 2> 2805112 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController numShards not found on descriptor - reading it from > system property > [junit4] 2> 2805113 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"state", > [junit4] 2> "shard":null, > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:56746";, > [junit4] 2> "state":"down", > [junit4] 2> "collection":"control_collection", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:56746_"} current state version: 0 > [junit4] 2> 2805113 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController look for our core node name > [junit4] 2> 2805114 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 > message={ > [junit4] 2> "operation":"state", > [junit4] 2> "shard":null, > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:56746";, > [junit4] 2> "state":"down", > [junit4] 2> "collection":"control_collection", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:56746_"} > [junit4] 2> 2805114 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ClusterStateMutator building a new cName: > control_collection > [junit4] 2> 2805114 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard > shard=shard1 > [junit4] 2> 2805116 INFO > (zkCallback-2285-thread-1-processing-n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent > state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has > occurred - updating... (live nodes size: 1) > [junit4] 2> 2806114 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 > [junit4] 2> 2806114 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController Check for collection zkNode:control_collection > [junit4] 2> 2806115 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ZkController Collection zkNode exists > [junit4] 2> 2806115 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.c.ZkStateReader Load collection config > from:/collections/control_collection > [junit4] 2> 2806115 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 > specified config exists in ZooKeeper > [junit4] 2> 2806116 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: > '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/' > [junit4] 2> 2806116 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) > [junit4] 2> 2806116 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find > system property or JNDI) > [junit4] 2> 2806129 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.c.Config > loaded config solrconfig.xml with version 0 > [junit4] 2> 2806133 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.c.SolrConfig > current version of requestparams : -1 > [junit4] 2> 2806145 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.c.SolrConfig > Using Lucene MatchVersion: 5.4.0 > [junit4] 2> 2806170 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.c.Config > Loaded SolrConfig: solrconfig.xml > [junit4] 2> 2806171 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.s.IndexSchema > Reading Solr Schema from /configs/conf1/schema.xml > [junit4] 2> 2806177 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.s.IndexSchema > [collection1] Schema name=test > [junit4] 2> 2806414 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Initialized with > rates=open-exchange-rates.json, refreshInterval=1440. > [junit4] 2> 2806439 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.s.IndexSchema > default search field in schema is text > [junit4] 2> 2806440 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] o.a.s.s.IndexSchema > unique key field: id > [junit4] 2> 2806448 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file > currency.xml > [junit4] 2> 2806451 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file > currency.xml > [junit4] 2> 2806454 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from > open-exchange-rates.json > [junit4] 2> 2806454 WARN > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE > [junit4] 2> 2806454 WARN > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING > [junit4] 2> 2806454 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from > open-exchange-rates.json > [junit4] 2> 2806455 WARN > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE > [junit4] 2> 2806455 WARN > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING > [junit4] 2> 2806456 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming > default properties: Can't find resource 'configsetprops.json' in classpath or > '/configs/conf1', > cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2 > [junit4] 2> 2806456 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection x:collection1] > o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration > from collection control_collection > [junit4] 2> 2806456 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory > [junit4] 2> 2806456 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at > [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/], > dataDir=[null] > [junit4] 2> 2806456 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX > Server: com.sun.jmx.mbeanserver.JmxMBeanServer@379f19b4 > [junit4] 2> 2806457 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.CachingDirectoryFactory return new directory for > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data > [junit4] 2> 2806457 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore New index directory detected: old=null > new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data/index/ > [junit4] 2> 2806457 WARN > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore [collection1] Solr index directory > '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data/index' > doesn't exist. Creating new index... > [junit4] 2> 2806457 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.CachingDirectoryFactory return new directory for > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data/index > [junit4] 2> 2806458 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class > org.apache.lucene.index.MockRandomMergePolicy: > org.apache.lucene.index.MockRandomMergePolicy@7cd8dcec > [junit4] 2> 2806458 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 > [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@19049fd > lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@27e981d8),segFN=segments_1,generation=1} > [junit4] 2> 2806458 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore newest commit generation = 1 > [junit4] 2> 2806458 INFO > (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore > Looking for old index directories to cleanup for core collection1 in > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data/ > [junit4] 2> 2806459 WARN > (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.DirectoryFactory > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/control-001/cores/collection1/data/ > does not point to a valid data directory; skipping clean-up of old index > directories. > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain > "nodistrib" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain > "dedupe" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain inserting > DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain > "stored_sig" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain inserting > DistributedUpdateProcessorFactory into updateRequestProcessorChain > "stored_sig" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain > "distrib-dup-test-chain-explicit" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain > "distrib-dup-test-chain-implicit" > [junit4] 2> 2806462 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.p.UpdateRequestProcessorChain inserting > DistributedUpdateProcessorFactory into updateRequestProcessorChain > "distrib-dup-test-chain-implicit" > [junit4] 2> 2806463 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating > implicit default > [junit4] 2> 2806465 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 > [junit4] 2> 2806466 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 > [junit4] 2> 2806468 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 > [junit4] 2> 2806469 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 > [junit4] 2> 2806472 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.RequestHandlers Registered paths: > /admin/logging,/update/json,/admin/segments,/admin/mbeans,/admin/ping,/update/csv,/admin/plugins,/update,/admin/file,/replication,standard,/update/json/docs,/admin/threads,/admin/properties,/admin/luke,/admin/system,/get,/schema,/config > [junit4] 2> 2806473 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore Using default statsCache cache: > org.apache.solr.search.stats.LocalStatsCache > [junit4] 2> 2806475 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.UpdateHandler Using UpdateLog implementation: > org.apache.solr.update.UpdateLog > [junit4] 2> 2806475 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH > numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 > [junit4] 2> 2806475 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore Hard AutoCommit: disabled > [junit4] 2> 2806476 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore Soft AutoCommit: disabled > [junit4] 2> 2806476 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class > org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: > maxMergeAtOnce=12, maxMergeAtOnceExplicit=36, > maxMergedSegmentMB=82.4736328125, floorSegmentMB=1.5283203125, > forceMergeDeletesPctAllowed=4.112648727330555, segmentsPerTier=14.0, > maxCFSSegmentSizeMB=1.6865234375, noCFSRatio=0.0 > [junit4] 2> 2806476 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 > [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@19049fd > lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@27e981d8),segFN=segments_1,generation=1} > [junit4] 2> 2806476 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SolrCore newest commit generation = 1 > [junit4] 2> 2806476 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.s.SolrIndexSearcher Opening Searcher@772028e6[collection1] main > [junit4] 2> 2806477 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.c.ZkStateReader Load collection config > from:/collections/control_collection > [junit4] 2> 2806478 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 > specified config exists in ZooKeeper > [junit4] 2> 2806478 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the > RestManager with znodeBase: /configs/conf1 > [junit4] 2> 2806478 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: > /configs/conf1 > [junit4] 2> 2806478 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.RestManager Initializing RestManager with initArgs: {} > [junit4] 2> 2806478 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using > ZooKeeperStorageIO:path=/configs/conf1 > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.ManagedResourceStorage No data found for znode > /configs/conf1/_rest_managed.json > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using > ZooKeeperStorageIO:path=/configs/conf1 > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.r.RestManager Initializing 0 registered ManagedResources > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.h.ReplicationHandler Commits will be reserved for 10000 > [junit4] 2> 2806479 INFO > (searcherExecutor-5949-thread-1-processing-r:core_node1 s:shard1 > x:collection1 c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore > [collection1] Registered new searcher Searcher@772028e6[collection1] > main{ExitableDirectoryReader(UninvertingDirectoryReader())} > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.UpdateLog Looking up max value of version field to seed version > buckets > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version > buckets from index > [junit4] 2> 2806479 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket > highest value from index > [junit4] 2> 2806480 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.UpdateLog Could not find max version in index or recent updates, > using new clock 1515710935199645696 > [junit4] 2> 2806482 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version > 1515710935199645696 > [junit4] 2> 2806482 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController watch zkdir /configs/conf1 > [junit4] 2> 2806482 INFO > (coreLoadExecutor-5948-thread-1-processing-n:127.0.0.1:56746_) > [n:127.0.0.1:56746_ c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.CoreContainer registering core: collection1 > [junit4] 2> 2806482 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController Register replica - core:collection1 > address:http://127.0.0.1:56746 collection:control_collection shard:shard1 > [junit4] 2> 2806483 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.c.SolrZkClient makePath: > /collections/control_collection/leader_elect/shard1/election > [junit4] 2> 2806486 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.LeaderElector Joined leadership election with path: > /collections/control_collection/leader_elect/shard1/election/94731933327425540-core_node1-n_0000000000 > [junit4] 2> 2806487 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56746/collection1/ > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SyncStrategy Sync Success - now sync replicas to me > [junit4] 2> 2806488 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"leader", > [junit4] 2> "shard":"shard1", > [junit4] 2> "collection":"control_collection"} current state version: 1 > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.SyncStrategy http://127.0.0.1:56746/collection1/ has no replicas > [junit4] 2> 2806488 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ShardLeaderElectionContext I am the new leader: > http://127.0.0.1:56746/collection1/ shard1 > [junit4] 2> 2806489 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.c.SolrZkClient makePath: > /collections/control_collection/leaders/shard1 > [junit4] 2> 2806491 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node > [junit4] 2> 2806493 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"leader", > [junit4] 2> "shard":"shard1", > [junit4] 2> "collection":"control_collection", > [junit4] 2> "base_url":"http://127.0.0.1:56746";, > [junit4] 2> "core":"collection1", > [junit4] 2> "state":"active"} current state version: 1 > [junit4] 2> 2806595 INFO > (zkCallback-2285-thread-1-processing-n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent > state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has > occurred - updating... (live nodes size: 1) > [junit4] 2> 2806613 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2806614 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2806615 INFO (zkCallback-2287-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@794415fc > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2806615 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2806615 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2806615 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... > [junit4] 2> 2806617 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause > connection loss:false > [junit4] 2> 2806617 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with > stateFormat=2 > [junit4] 2> 2806617 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2806618 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2806619 INFO (zkCallback-2288-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@77c64dbb > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2806619 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2806619 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2806622 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"create", > [junit4] 2> "name":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "stateFormat":"2"} current state version: 2 > [junit4] 2> 2806622 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ClusterStateMutator building a new cName: > collection1 > [junit4] 2> 2806644 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController We are http://127.0.0.1:56746/collection1/ and leader is > http://127.0.0.1:56746/collection1/ > [junit4] 2> 2806644 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController No LogReplay needed for core=collection1 > baseURL=http://127.0.0.1:56746 > [junit4] 2> 2806644 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController I am the leader, no recovery necessary > [junit4] 2> 2806644 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController publishing state=active > [junit4] 2> 2806644 INFO > (coreZkRegister-5942-thread-1-processing-r:core_node1 s:shard1 x:collection1 > c:control_collection n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > c:control_collection s:shard1 r:core_node1 x:collection1] > o.a.s.c.ZkController numShards not found on descriptor - reading it from > system property > [junit4] 2> 2806646 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"state", > [junit4] 2> "shard":"shard1", > [junit4] 2> "core_node_name":"core_node1", > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:56746";, > [junit4] 2> "state":"active", > [junit4] 2> "collection":"control_collection", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:56746_"} current state version: 2 > [junit4] 2> 2806646 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 > message={ > [junit4] 2> "operation":"state", > [junit4] 2> "shard":"shard1", > [junit4] 2> "core_node_name":"core_node1", > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:56746";, > [junit4] 2> "state":"active", > [junit4] 2> "collection":"control_collection", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:56746_"} > [junit4] 2> 2806647 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ZkStateWriter going to create_collection > /collections/collection1/state.json > [junit4] 2> 2806750 INFO (zkCallback-2287-thread-1) [ ] > o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent > state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has > occurred - updating... (live nodes size: 1) > [junit4] 2> 2806750 INFO > (zkCallback-2285-thread-1-processing-n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent > state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has > occurred - updating... (live nodes size: 1) > [junit4] 2> 2806891 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores/collection1 > [junit4] 2> 2806891 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001 > [junit4] 2> 2806892 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.Server jetty-9.2.13.v20150730 > [junit4] 2> 2806894 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.h.ContextHandler Started > o.e.j.s.ServletContextHandler@719f3138{/,null,AVAILABLE} > [junit4] 2> 2806894 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.ServerConnector Started > ServerConnector@3bc61657{HTTP/1.1}{127.0.0.1:50535} > [junit4] 2> 2806894 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.e.j.s.Server Started @2809776ms > [junit4] 2> 2806894 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: > {coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores, > > solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/tempDir-001/jetty1, > hostContext=/, solrconfig=solrconfig.xml, hostPort=50535} > [junit4] 2> 2806895 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): > sun.misc.Launcher$AppClassLoader@1fe91485 > [junit4] 2> 2806895 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: > '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/' > [junit4] 2> 2806895 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr > (NoInitialContextEx) > [junit4] 2> 2806895 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not > find system property or JNDI) > [junit4] 2> 2806909 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2806910 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2806911 INFO (zkCallback-2289-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@306792d6 > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2806911 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2806911 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2806913 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found > in ZooKeeper) > [junit4] 2> 2806913 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrXmlConfig Loading container configuration from > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/solr.xml > [junit4] 2> 2806926 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoresLocator Config-defined core root directory: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores > [junit4] 2> 2806926 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer New CoreContainer 1559122149 > [junit4] 2> 2806926 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer > [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/] > [junit4] 2> 2806926 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.CoreContainer loading shared library: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/lib > [junit4] 2> 2806926 WARN > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to > classloader: lib (resolved as: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/lib). > [junit4] 2> 2806934 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : > 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : > 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : > 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : > false,useRetries : false, > [junit4] 2> 2806935 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client > with params: socketTimeout=340000&connTimeout=45000&retry=true > [junit4] 2> 2806935 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory > [junit4] 2> 2806935 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j > (org.slf4j.impl.Log4jLoggerFactory)] > [junit4] 2> 2806935 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52462/solr > [junit4] 2> 2806935 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.ZkController zkHost includes chroot > [junit4] 2> 2806936 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider > [junit4] 2> 2806936 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper > [junit4] 2> 2806937 INFO (zkCallback-2291-thread-1) [ ] > o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@4c57b1e6 > name:ZooKeeperConnection Watcher:127.0.0.1:52462 got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2806937 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper > [junit4] 2> 2806938 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider > [junit4] 2> 2806940 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.c.ConnectionManager Waiting for client to > connect to ZooKeeper > [junit4] 2> 2806941 INFO > (zkCallback-2292-thread-1-processing-n:127.0.0.1:50535_) [n:127.0.0.1:50535_ > ] o.a.s.c.c.ConnectionManager Watcher > org.apache.solr.common.cloud.ConnectionManager@124679be > name:ZooKeeperConnection Watcher:127.0.0.1:52462/solr got event WatchedEvent > state:SyncConnected type:None path:null path:null type:None > [junit4] 2> 2806941 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.c.ConnectionManager Client is connected to > ZooKeeper > [junit4] 2> 2806945 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.c.ZkStateReader Updating cluster state from > ZooKeeper... > [junit4] 2> 2807951 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.ZkController Register node as live in > ZooKeeper:/live_nodes/127.0.0.1:50535_ > [junit4] 2> 2807951 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.c.SolrZkClient makePath: > /live_nodes/127.0.0.1:50535_ > [junit4] 2> 2807952 INFO (zkCallback-2287-thread-1) [ ] > o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected > type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live > nodes size: 1) > [junit4] 2> 2807952 INFO > (zkCallback-2285-thread-1-processing-n:127.0.0.1:56746_) [n:127.0.0.1:56746_ > ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent > state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - > updating... (live nodes size: 1) > [junit4] 2> 2807952 INFO > (zkCallback-2292-thread-1-processing-n:127.0.0.1:50535_) [n:127.0.0.1:50535_ > ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent > state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - > updating... (live nodes size: 1) > [junit4] 2> 2807954 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.Overseer Overseer (id=null) closing > [junit4] 2> 2807955 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.LeaderElector Joined leadership election > with path: > /overseer_elect/election/94731933327425545-127.0.0.1:50535_-n_0000000001 > [junit4] 2> 2807955 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.LeaderElector Watching path > /overseer_elect/election/94731933327425540-127.0.0.1:56746_-n_0000000000 to > know if I could be the leader > [junit4] 2> 2807971 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.CoreContainer Security conf doesn't exist. > Skipping setup for authorization module. > [junit4] 2> 2807971 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.CoreContainer No authentication plugin used. > [junit4] 2> 2807972 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.CoresLocator Looking for core definitions > underneath > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores > [junit4] 2> 2807972 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.SolrCore Created CoreDescriptor: > {collection=collection1, > absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores/collection1/, > > instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores/collection1, > name=collection1, configSetProperties=configsetprops.json, shard=, > coreNodeName=, loadOnStartup=true, dataDir=data/, schema=schema.xml, > transient=false, config=solrconfig.xml} > [junit4] 2> 2807973 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.CoresLocator Found core collection1 in > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores/collection1/ > [junit4] 2> 2807973 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.c.CoresLocator Found 1 core definitions > [junit4] 2> 2807974 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController > publishing state=down > [junit4] 2> 2807974 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController > numShards not found on descriptor - reading it from system property > [junit4] 2> 2807974 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.s.SolrDispatchFilter > user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2 > [junit4] 2> 2807974 INFO > (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[7F78F76DDF75FAD1]) > [n:127.0.0.1:50535_ ] o.a.s.s.SolrDispatchFilter > SolrDispatchFilter.init() done > [junit4] 2> 2807975 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController > Registering watch for collection collection1 > [junit4] 2> 2807975 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader > addZkWatch collection1 > [junit4] 2> 2807976 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.Overseer processMessage: queueSize: 1, > message = { > [junit4] 2> "operation":"state", > [junit4] 2> "shard":null, > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:50535";, > [junit4] 2> "state":"down", > [junit4] 2> "collection":"collection1", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:50535_"} current state version: 3 > [junit4] 2> 2807976 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 > message={ > [junit4] 2> "operation":"state", > [junit4] 2> "shard":null, > [junit4] 2> "roles":null, > [junit4] 2> "base_url":"http://127.0.0.1:50535";, > [junit4] 2> "state":"down", > [junit4] 2> "collection":"collection1", > [junit4] 2> "core":"collection1", > [junit4] 2> "numShards":"1", > [junit4] 2> "node_name":"127.0.0.1:50535_"} > [junit4] 2> 2807976 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Collection already exists > with numShards=1 > [junit4] 2> 2807976 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard > shard=shard1 > [junit4] 2> 2807976 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader > Add data for collection1 ver 0 > [junit4] 2> 2807977 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController look > for our core node name > [junit4] 2> 2808078 INFO > (OverseerStateUpdate-94731933327425540-127.0.0.1:56746_-n_0000000000) > [n:127.0.0.1:56746_ ] o.a.s.c.o.ZkStateWriter going to update_collection > /collections/collection1/state.json version: 0 > [junit4] 2> 2808079 INFO > (zkCallback-2292-thread-1-processing-n:127.0.0.1:50535_) [n:127.0.0.1:50535_ > ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent > state:SyncConnected type:NodeDataChanged > path:/collections/collection1/state.json for collection collection1 has > occurred - updating... (live nodes size: 2) > [junit4] 2> 2808079 INFO > (zkCallback-2292-thread-1-processing-n:127.0.0.1:50535_) [n:127.0.0.1:50535_ > ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1 > [junit4] 2> 2808977 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController > waiting to find shard id in clusterstate for collection1 > [junit4] 2> 2808977 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController Check > for collection zkNode:collection1 > [junit4] 2> 2808978 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.ZkController > Collection zkNode exists > [junit4] 2> 2808978 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader > Load collection config from:/collections/collection1 > [junit4] 2> 2808978 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader > path=/collections/collection1 configName=conf1 specified config exists in > ZooKeeper > [junit4] 2> 2808978 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader > new SolrResourceLoader for directory: > '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001/shard-1-001/cores/collection1/' > [junit4] 2> 2808979 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader > JNDI not configured for solr (NoInitialContextEx) > [junit4] 2> 2808979 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader > solr home defaulted to 'solr/' (could not find system property or JNDI) > [junit4] 2> 2808992 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.Config loaded > config solrconfig.xml with version 0 > [junit4] 2> 2808997 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.SolrConfig current > version of requestparams : -1 > [junit4] 2> 2809010 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using > Lucene MatchVersion: 5.4.0 > [junit4] 2> 2809039 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.c.Config Loaded > SolrConfig: solrconfig.xml > [junit4] 2> 2809040 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.s.IndexSchema > Reading Solr Schema from /configs/conf1/schema.xml > [junit4] 2> 2809046 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.s.IndexSchema > [collection1] Schema name=test > [junit4] 2> 2809381 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] > o.a.s.s.OpenExchangeRatesOrgProvider Initialized with > rates=open-exchange-rates.json, refreshInterval=1440. > [junit4] 2> 2809388 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.s.IndexSchema > default search field in schema is text > [junit4] 2> 2809390 INFO > (coreLoadExecutor-5959-thread-1-processing-n:127.0.0.1:50535_) > [n:127.0.0.1:50535_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique > key field: id > [junit4] 2> 2809400 INFO (coreLoadExecutor-5959-thread- > > [...truncated too long message...] > > ill nodes recoverying - waited for 330 seconds > [junit4] > at > org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172) > [junit4] > at > org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133) > [junit4] > at > org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128) > [junit4] > at > org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830) > [junit4] > at > org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:81) > [junit4] > at > org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963) > [junit4] > at > org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938) > [junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: > com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an > uncaught exception in thread: Thread[id=43491, > name=coreZkRegister-5997-thread-1, state=RUNNABLE, > group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] > [junit4] > Caused by: java.lang.AssertionError > [junit4] > at > __randomizedtesting.SeedInfo.seed([7F78F76DDF75FAD1]:0) > [junit4] > at > org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2133) > [junit4] > at > org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:434) > [junit4] > at > org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) > [junit4] > at > org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) > [junit4] > at > org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) > [junit4] > at > org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113) > [junit4] > at > org.apache.solr.cloud.ZkController.register(ZkController.java:926) > [junit4] > at > org.apache.solr.cloud.ZkController.register(ZkController.java:881) > [junit4] > at > org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) > [junit4] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) > [junit4] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [junit4] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [junit4] > at java.lang.Thread.run(Thread.java:745) > [junit4] 2> 3169248 INFO > (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[7F78F76DDF75FAD1]-worker) > [n:127.0.0.1:33453_ c:collection1 s:shard1 r:core_node2 x:collection1] > o.a.s.SolrTestCaseJ4 ###deleteCore > [junit4] 2> NOTE: leaving temporary files on disk at: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_7F78F76DDF75FAD1-001 > [junit4] 2> Oct 22, 2015 2:22:32 AM > com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks > [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked > thread(s). > [junit4] 2> NOTE: test params are: codec=Asserting(Lucene53), > sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=be_BY, > timezone=Pacific/Port_Moresby > [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation > 1.7.0_72 (64-bit)/cpus=4,threads=1,free=204385304,total=520093696 > [junit4] 2> NOTE: All tests run in this JVM: [TestExceedMaxTermLength, > BinaryUpdateRequestHandlerTest, TestAuthorizationFramework, > TestNamedUpdateProcessors, CoreAdminCreateDiscoverTest, > TestCloudManagedSchema, TestRemoveLastDynamicCopyField, > TestRawResponseWriter, TestCloudSchemaless, ZkStateReaderTest, TestZkChroot, > TestSolrQueryParser, TestReload, TestReversedWildcardFilterFactory, > HttpPartitionTest, TestSchemaManager, TestPostingsSolrHighlighter, > HdfsLockFactoryTest, QueryParsingTest, TestIndexingPerformance, > TestCloudManagedSchemaConcurrent, RAMDirectoryFactoryTest, > CloudExitableDirectoryReaderTest, CoreAdminHandlerTest, > VMParamsZkACLAndCredentialsProvidersTest, SampleTest, AutoCommitTest, > TestSolrDeletionPolicy1, StatsComponentTest, SolrCoreCheckLockOnStartupTest, > AsyncMigrateRouteKeyTest, TestSimpleQParserPlugin, > SimpleCollectionCreateDeleteTest, SuggesterWFSTTest, VersionInfoTest, > ChangedSchemaMergeTest, TestPKIAuthenticationPlugin, TestIndexSearcher, > DistributedQueryComponentCustomSortTest, TestMacros, PrimitiveFieldTypeTest, > DeleteShardTest, PluginInfoTest, HdfsRecoveryZkTest, SSLMigrationTest, > DistributedFacetPivotSmallAdvancedTest, RequestHandlersTest, > BadComponentTest, TestSearcherReuse, DocValuesMultiTest, > ConnectionManagerTest, FullSolrCloudDistribCmdsTest, > AnalyticsMergeStrategyTest, DeleteLastCustomShardedReplicaTest, > TestConfigSets, TestCustomSort, TestMaxScoreQueryParser, > CollectionReloadTest, TestInitParams, ExitableDirectoryReaderTest, > DistribCursorPagingTest, DocValuesMissingTest, DebugComponentTest, > TestSystemIdResolver, AnalysisErrorHandlingTest, TestSortByMinMaxFunction, > DirectUpdateHandlerOptimizeTest, TestFieldTypeCollectionResource, > SearchHandlerTest, TestElisionMultitermQuery, TestManagedStopFilterFactory, > TestJmxIntegration, RulesTest, HighlighterMaxOffsetTest, TestCollationField, > LukeRequestHandlerTest, TestDocBasedVersionConstraints, > TestDefaultSearchFieldResource, FieldAnalysisRequestHandlerTest, > FieldMutatingUpdateProcessorTest, TestPivotHelperCode, > DocExpirationUpdateProcessorFactoryTest, StressHdfsTest, ScriptEngineTest, > ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, > SyncSliceTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, > TestRandomFaceting, ShardRoutingCustomTest, TestDistributedGrouping, > TestFaceting, TestRecovery, TestHashPartitioner, > TermVectorComponentDistributedTest, TestStressReorder, TestJoin, > TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, > TestRangeQuery, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, > TestGroupingSearch, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, > TestSort, BasicFunctionalityTest, DirectUpdateHandlerTest, TestBadConfig, > SoftAutoCommitTest, ShowFileRequestHandlerTest, > CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, > SolrIndexSplitterTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, > SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, > SuggesterTSTTest, SuggesterTest, TestStressLucene, TestTrie, PolyFieldTest, > NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, > SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, TestUpdate, > TestWordDelimiterFilterFactory, QueryEqualityTest, > DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, > SortByFunctionTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, > DisMaxRequestHandlerTest, TestWriterPerf, DirectSolrSpellCheckerTest, > DocumentAnalysisRequestHandlerTest, TestQueryTypes, TestOmitPositions, > FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, > DocumentBuilderTest, TestValueSourceCache, TermVectorComponentTest, > RequiredFieldsTest, TestArbitraryIndexDir, FastVectorHighlighterTest, > IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, > SolrPluginUtilsTest, ReturnFieldsTest, JSONWriterTest, TestCSVResponseWriter, > MBeansHandlerTest, TestAnalyzedSuggestions, > UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, > HighlighterConfigTest, SOLR749Test, UpdateParamsTest, TestSolrIndexConfig, > SolrIndexConfigTest, TestStressRecovery, MultiTermTest, TestBinaryField, > TestSearchPerf, NumericFieldsTest, OutputWriterTest, > TestFuzzyAnalyzedSuggestions, TestCharFilters, > TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, > TestLMDirichletSimilarityFactory, TestFastWriter, TestFastOutputStream, > URLClassifyProcessorTest, DateMathParserTest, PrimUtilsTest, > SpellingQueryConverterTest, ClusterStateTest, TestLRUCache, > TestDocumentBuilder, SystemInfoHandlerTest, FileUtilsTest, > DistributedMLTComponentTest, TestCrossCoreJoin, > TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, > TestTolerantSearch, TestEmbeddedSolrServerConstructors, ActionThrottleTest, > AsyncCallRequestStatusResponseTest, CleanupOldIndexTest, > CollectionStateFormat2Test, DeleteInactiveReplicaTest, > DistribDocExpirationUpdateProcessorTest, > LeaderInitiatedRecoveryOnShardRestartTest] > [junit4] Completed [439/542] on J2 in 364.94s, 1 test, 1 error <<< > FAILURES! > > [...truncated 365 lines...] > BUILD FAILED > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:792: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:729: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:526: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1452: > The following error occurred while executing this line: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1006: > There were test failures: 542 suites (7 ignored), 2143 tests, 1 error, 31 > ignored (18 assumptions) [seed: 7F78F76DDF75FAD1] > > Total time: 198 minutes 25 seconds > Build step 'Invoke Ant' marked build as failure > Archiving artifacts > Recording test results > Email was triggered for: Failure - Any > Sending email for trigger: Failure - Any > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org -- Regards, Shalin Shekhar Mangar. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
