Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4207/ Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseParallelGC --illegal-access=deny
1 tests failed. FAILED: org.apache.solr.cloud.TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry Error Message: Captured an uncaught exception in thread: Thread[id=25490, name=OverseerAutoScalingTriggerThread-98772199430356994-dummy.host.com:8984_solr-n_0000000000, state=RUNNABLE, group=Overseer autoscaling triggers] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=25490, name=OverseerAutoScalingTriggerThread-98772199430356994-dummy.host.com:8984_solr-n_0000000000, state=RUNNABLE, group=Overseer autoscaling triggers] at __randomizedtesting.SeedInfo.seed([E9B9CF785279AD0C:3F66EE226464BE94]:0) Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas at __randomizedtesting.SeedInfo.seed([E9B9CF785279AD0C]:0) at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:107) at org.apache.solr.cloud.autoscaling.TriggerEventQueue.<init>(TriggerEventQueue.java:44) at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.<init>(ScheduledTriggers.java:398) at org.apache.solr.cloud.autoscaling.ScheduledTriggers.add(ScheduledTriggers.java:149) at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:220) at java.base/java.lang.Thread.run(Thread.java:844) Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:78) at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:105) ... 5 more Build Log: [...truncated 13284 lines...] [junit4] Suite: org.apache.solr.cloud.TestLeaderElectionZkExpiry [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestLeaderElectionZkExpiry_E9B9CF785279AD0C-001/init-core-data-001 [junit4] 2> 2516353 WARN (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2 [junit4] 2> 2516353 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 2516354 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth [junit4] 2> 2516354 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 2516355 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLeaderElectionWithZkExpiry [junit4] 2> 2516357 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4cf80e12, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 2516389 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cf80e12 [junit4] 2> 2516398 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cf80e12 [junit4] 2> 2516398 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cf80e12 [junit4] 2> 2516399 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestLeaderElectionZkExpiry_E9B9CF785279AD0C-001/testLeaderElectionWithZkExpiry-solr-001 [junit4] 2> 2516400 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 2516400 INFO (Thread-4351) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2516400 INFO (Thread-4351) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 2516402 ERROR (Thread-4351) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 2516510 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.ZkTestServer start zk server on port:50813 [junit4] 2> 2516675 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 2516676 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr [junit4] 2> 2516677 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.Overseer Overseer (id=98772199430356994-dummy.host.com:8984_solr-n_0000000000) starting [junit4] 2> 2516686 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/dummy.host.com:8984_solr [junit4] 2> 2516687 INFO (OverseerStateUpdate-98772199430356994-dummy.host.com:8984_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2516796 WARN (zkCallback-4553-thread-4) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2516796 WARN (zkCallback-4553-thread-4) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2518545 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0002 has expired [junit4] 2> 2518546 WARN (zkCallback-4553-thread-3) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2518546 WARN (zkCallback-4553-thread-3) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2518546 INFO (zkCallback-4553-thread-3) [ ] o.a.s.c.Overseer Overseer (id=98772199430356994-dummy.host.com:8984_solr-n_0000000000) closing [junit4] 2> 2518547 INFO (OverseerStateUpdate-98772199430356994-dummy.host.com:8984_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : dummy.host.com:8984_solr [junit4] 2> 2518548 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could not read the data [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:299) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> 2518650 WARN (zkCallback-4553-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes] [junit4] 2> 2518650 WARN (OverseerAutoScalingTriggerThread-98772199430356994-dummy.host.com:8984_solr-n_0000000000) [ ] o.a.s.c.a.TriggerBase Exception checking ZK path /autoscaling/triggerState [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/triggerState [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1327) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:374) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:371) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:371) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:555) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:415) [junit4] 2> at org.apache.solr.cloud.autoscaling.TriggerBase.<init>(TriggerBase.java:45) [junit4] 2> at org.apache.solr.cloud.autoscaling.NodeLostTrigger.<init>(NodeLostTrigger.java:72) [junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScaling$TriggerFactory.create(AutoScaling.java:137) [junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.loadTriggers(OverseerTriggerThread.java:365) [junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:312) [junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:137) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> okt 04, 2017 3:09:18 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException [junit4] 2> WARNING: Uncaught exception in thread: Thread[OverseerAutoScalingTriggerThread-98772199430356994-dummy.host.com:8984_solr-n_0000000000,5,Overseer autoscaling triggers] [junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas [junit4] 2> at __randomizedtesting.SeedInfo.seed([E9B9CF785279AD0C]:0) [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:107) [junit4] 2> at org.apache.solr.cloud.autoscaling.TriggerEventQueue.<init>(TriggerEventQueue.java:44) [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.<init>(ScheduledTriggers.java:398) [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.add(ScheduledTriggers.java:149) [junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:220) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:78) [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:105) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2518665 WARN (zkCallback-4553-thread-3) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2518667 INFO (zkCallback-4553-thread-3) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2518668 INFO (zkCallback-4553-thread-3) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2518671 INFO (zkCallback-4553-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 2518785 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2518785 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2519902 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0003 has expired [junit4] 2> 2519902 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2519902 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2519902 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2519905 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2519905 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2520027 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2520027 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2521774 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0004 has expired [junit4] 2> 2521774 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2521774 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2521774 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2521775 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2521775 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2521877 ERROR (zkCallback-4553-thread-3) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:584) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:434) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269) [junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514) [junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) [junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) [junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> [junit4] 2> 2521878 ERROR (zkCallback-4553-thread-3) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269) [junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514) [junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) [junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) [junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:584) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:434) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> ... 10 more [junit4] 2> [junit4] 2> 2521879 WARN (zkCallback-4553-thread-3) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2521879 INFO (zkCallback-4553-thread-3) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2521892 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2521893 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2523156 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0005 has expired [junit4] 2> 2523156 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x15ee8cac4bb0005 due to java.nio.channels.CancelledKeyException [junit4] 2> 2523156 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2523157 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2523157 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2523160 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2523160 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2523278 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2523278 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2525211 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0006 has expired [junit4] 2> 2525211 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2525212 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2525212 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2525214 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2525214 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2525313 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> [junit4] 2> 2525314 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2525314 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2525314 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2525329 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2525329 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2526370 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0007 has expired [junit4] 2> 2526370 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2526371 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2526371 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2526374 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2526374 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2526488 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 2526488 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 2527730 WARN (zkCallback-4553-thread-3-SendThread(127.0.0.1:50813)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15ee8cac4bb0008 has expired [junit4] 2> 2527730 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4cd790aa name: ZooKeeperConnection Watcher:127.0.0.1:50813/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 2527730 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 2527730 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 2527732 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished. [junit4] 2> 2527732 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. [junit4] 2> 2527830 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> [junit4] 2> 2527831 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2527841 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2527838 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr [junit4] 2> 2527842 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2527844 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr [junit4] 2> 2527844 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.TestLeaderElectionZkExpiry Time=1057681275554701 Overseer leader is = dummy.host.com:8984_solr [junit4] 2> 2527845 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.Overseer Overseer (id=98772199430357002-dummy.host.com:8984_solr-n_0000000001) starting [junit4] 2> 2527847 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=833082550 [junit4] 2> 2527847 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 2527847 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d9e522a: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@79515166 [junit4] 2> 2527853 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 2527853 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ce88c33: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3c8592af [junit4] 2> 2527856 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 2527856 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@27b3d603: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1c5d9a3f [junit4] 2> 2527857 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 2527857 ERROR (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 2527857 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50813 50813 [junit4] 2> 2527876 INFO (Thread-4351) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50813 50813 [junit4] 2> 2528371 WARN (Thread-4351) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 5 /solr/clusterprops.json [junit4] 2> 3 /solr/aliases.json [junit4] 2> 3 /solr/security.json [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 4 /solr/clusterstate.json [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 4 /solr/live_nodes [junit4] 2> 4 /solr/collections [junit4] 2> [junit4] 2> 2528373 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[E9B9CF785279AD0C]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLeaderElectionWithZkExpiry [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestLeaderElectionZkExpiry -Dtests.method=testLeaderElectionWithZkExpiry -Dtests.seed=E9B9CF785279AD0C -Dtests.slow=true -Dtests.locale=az-Latn-AZ -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 12.0s J0 | TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry <<< [junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=25490, name=OverseerAutoScalingTriggerThread-98772199430356994-dummy.host.com:8984_solr-n_0000000000, state=RUNNABLE, group=Overseer autoscaling triggers] [junit4] > at __randomizedtesting.SeedInfo.seed([E9B9CF785279AD0C:3F66EE226464BE94]:0) [junit4] > Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas [junit4] > at __randomizedtesting.SeedInfo.seed([E9B9CF785279AD0C]:0) [junit4] > at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:107) [junit4] > at org.apache.solr.cloud.autoscaling.TriggerEventQueue.<init>(TriggerEventQueue.java:44) [junit4] > at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.<init>(ScheduledTriggers.java:398) [junit4] > at org.apache.solr.cloud.autoscaling.ScheduledTriggers.add(ScheduledTriggers.java:149) [junit4] > at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:220) [junit4] > at java.base/java.lang.Thread.run(Thread.java:844) [junit4] > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/events/.auto_add_replicas [junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] > at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] > at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] > at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) [junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:78) [junit4] > at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:105) [junit4] > ... 5 more [junit4] 2> 2528384 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> 2528384 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=833082550 [junit4] 2> 2528385 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 2528385 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 2528385 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 2528385 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[E9B9CF785279AD0C]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released [junit4] 2> Oct 04, 2017 7:09:28 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 4 leaked thread(s). [junit4] 2> 2529355 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /aliases.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:306) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:303) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:303) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:441) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> [junit4] 2> 2529355 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /aliases.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:306) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:303) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:303) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:441) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2529355 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2529355 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.Overseer Could not create Overseer node [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:392) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:755) [junit4] 2> at org.apache.solr.cloud.Overseer.start(Overseer.java:513) [junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:798) [junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) [junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:347) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> 2529355 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:527) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:524) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:467) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454) [junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:787) [junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) [junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:347) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> [junit4] 2> 2529356 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer [junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:764) [junit4] 2> at org.apache.solr.cloud.Overseer.start(Overseer.java:513) [junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:798) [junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) [junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:347) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:392) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:755) [junit4] 2> ... 12 more [junit4] 2> [junit4] 2> 2529356 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer [junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:764) [junit4] 2> at org.apache.solr.cloud.Overseer.start(Overseer.java:513) [junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:798) [junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) [junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:347) [junit4] 2> ... 5 more [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:392) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:389) [junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:755) [junit4] 2> ... 12 more [junit4] 2> [junit4] 2> 2529356 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2529355 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2529356 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2529355 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.ZkController :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> [junit4] 2> 2529356 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:527) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:524) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:467) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454) [junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:787) [junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) [junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) [junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:347) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2529357 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2529357 ERROR (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:407) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) [junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320) [junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:322) [junit4] 2> ... 5 more [junit4] 2> [junit4] 2> 2529357 WARN (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed [junit4] 2> 2529357 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> 2529357 INFO (zkCallback-4553-thread-3-EventThread) [ ] o.a.s.c.c.ConnectionManager Connected:true [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1317, maxMBSortInHeap=6.185278025816121, sim=RandomSimilarity(queryNorm=true): {}, locale=az-Latn-AZ, timezone=America/Port-au-Prince [junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=41990200,total=519045120 [junit4] 2> NOTE: All tests run in this JVM: [DocValuesMissingTest, TestPKIAuthenticationPlugin, HealthCheckHandlerTest, TestLFUCache, CurrencyFieldTypeTest, TestDistributedStatsComponentCardinality, HdfsUnloadDistributedZkTest, MoveReplicaHDFSTest, CdcrRequestHandlerTest, TestCustomStream, MinimalSchemaTest, PeerSyncWithIndexFingerprintCachingTest, TestDistribDocBasedVersion, AssignTest, CollectionStateFormat2Test, CoreAdminHandlerTest, TestHashPartitioner, ResponseHeaderTest, BJQParserTest, TestStressLiveNodes, SegmentsInfoRequestHandlerTest, JSONWriterTest, RulesTest, HdfsLockFactoryTest, TestFieldTypeCollectionResource, HdfsBasicDistributedZk2Test, ClusterStateTest, CdcrUpdateLogTest, TestBulkSchemaConcurrent, TestStressReorder, ReturnFieldsTest, TestInPlaceUpdatesStandalone, TestNumericRangeQuery64, OutputWriterTest, TestManagedResourceStorage, DirectUpdateHandlerOptimizeTest, OverseerTaskQueueTest, TimeZoneUtilsTest, TestSolrConfigHandlerConcurrent, HdfsThreadLeakTest, InfoHandlerTest, CdcrReplicationDistributedZkTest, TestManagedSchemaAPI, TestFieldCacheSort, HdfsCollectionsAPIDistributedZkTest, TestClassicSimilarityFactory, ExecutePlanActionTest, HardAutoCommitTest, TestSSLRandomization, TestSurroundQueryParser, AutoAddReplicasIntegrationTest, ZkStateReaderTest, XmlUpdateRequestHandlerTest, TestJsonFacets, TestPointFields, BinaryUpdateRequestHandlerTest, TestDynamicFieldCollectionResource, TestLazyCores, CursorPagingTest, TestDistributedSearch, OverseerCollectionConfigSetProcessorTest, OutOfBoxZkACLAndCredentialsProvidersTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestIBSimilarityFactory, HdfsRecoverLeaseTest, TestBinaryField, TestUtils, NodeLostTriggerTest, TestUpdate, SSLMigrationTest, TestWriterPerf, V2ApiIntegrationTest, TestCloudInspectUtil, ShufflingReplicaListTransformerTest, TestLegacyField, BigEndianAscendingWordSerializerTest, HdfsRestartWhileUpdatingTest, TestFuzzyAnalyzedSuggestions, TestSlowCompositeReaderWrapper, XsltUpdateRequestHandlerTest, TestSimpleTextCodec, UniqFieldsUpdateProcessorFactoryTest, DistribDocExpirationUpdateProcessorTest, AnalysisAfterCoreReloadTest, TestCloudRecovery, TestManagedSynonymGraphFilterFactory, SolrJmxReporterTest, MultiThreadedOCPTest, TestNumericTerms64, WrapperMergePolicyFactoryTest, AutoscalingHistoryHandlerTest, TestMacroExpander, TestXIncludeConfig, PKIAuthenticationIntegrationTest, TestAtomicUpdateErrorCases, SearchHandlerTest, TestHdfsUpdateLog, SimplePostToolTest, TestLegacyNumericUtils, DistributedDebugComponentTest, SortByFunctionTest, AliasIntegrationTest, TestFieldCache, TestHighlightDedupGrouping, TestBinaryResponseWriter, AtomicUpdateProcessorFactoryTest, TestOrdValues, ShardRoutingTest, PrimUtilsTest, TestNoOpRegenerator, BlockJoinFacetRandomTest, VMParamsZkACLAndCredentialsProvidersTest, CircularListTest, SimpleCollectionCreateDeleteTest, TestNestedDocsSort, DistributedFacetExistsSmallTest, TestJmxIntegration, SolrMetricsIntegrationTest, TestZkAclsWithHadoopAuth, TestRequestForwarding, TestSolrDeletionPolicy2, UnloadDistributedZkTest, SolrTestCaseJ4Test, TestPseudoReturnFields, TestRandomDVFaceting, FieldAnalysisRequestHandlerTest, RecoveryAfterSoftCommitTest, MetricsConfigTest, TlogReplayBufferedWhileIndexingTest, LeaderElectionTest, HighlighterTest, TestStressRecovery, TestBackupRepositoryFactory, TestXmlQParserPlugin, TestCodecSupport, TestGraphMLResponseWriter, DocValuesNotIndexedTest, DirectoryFactoryTest, SolrInfoBeanTest, TestLegacyFieldCache, IndexBasedSpellCheckerTest, SparseHLLTest, ClassificationUpdateProcessorTest, TestReplicationHandlerBackup, DocValuesTest, ResourceLoaderTest, TestPolicyCloud, LeaderFailureAfterFreshStartTest, CoreAdminRequestStatusTest, TestSolrCloudWithKerberosAlt, PrimitiveFieldTypeTest, TestDocBasedVersionConstraints, SliceStateTest, HttpTriggerListenerTest, TestSchemaSimilarityResource, MultiTermTest, BooleanFieldTest, TestLMDirichletSimilarityFactory, CloudExitableDirectoryReaderTest, TestTrackingShardHandlerFactory, TestSerializedLuceneMatchVersion, TestMaxTokenLenTokenizer, TestBulkSchemaAPI, BasicDistributedZkTest, LargeFieldTest, TestAddFieldRealTimeGet, TestMissingGroups, TestCloudSchemaless, QueryParsingTest, RequestHandlersTest, TestCoreContainer, SuggesterTest, MissingSegmentRecoveryTest, BasicAuthIntegrationTest, ConnectionManagerTest, TestConfigSetImmutable, ClusterStateUpdateTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ZkCLITest, ShardRoutingCustomTest, TestFaceting, TestRecovery, TermVectorComponentDistributedTest, TestReload, TestRangeQuery, SpellCheckComponentTest, PeerSyncTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SolrRequestParserTest, TestFoldingMultitermQuery, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DistanceFunctionTest, DebugComponentTest, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FastVectorHighlighterTest, LoggingHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, TestCollationField, TestCSVResponseWriter, MBeansHandlerTest, HighlighterConfigTest, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, CopyFieldTest, TestMergePolicyConfig, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCharFilters, EchoParamsTest, TestDFRSimilarityFactory, ScriptEngineTest, URLClassifyProcessorTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, CdcrReplicationHandlerTest, CdcrVersionReplicationTest, CollectionsAPIAsyncDistributedZkTest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistribCursorPagingTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnCommitTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, OverseerRolesTest, ReplaceNodeTest, RestartWhileUpdatingTest, ShardSplitTest, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestDeleteCollectionOnDownNodes, TestExclusionRuleCollectionAccess, TestLeaderElectionZkExpiry] [junit4] Completed [546/745 (1!)] on J0 in 13.07s, 1 test, 1 error <<< FAILURES! [...truncated 40317 lines...] BUILD FAILED /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:826: The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:706: The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:693: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files: * lucene/licenses/morfologik-ukrainian-search-3.7.5.jar.sha1 Total time: 76 minutes 8 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts [WARNINGS] Skipping publisher since build result is FAILURE Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org