Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1435/
9 tests failed. FAILED: org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader Error Message: There are still nodes recoverying - waited for 330 seconds Stack Trace: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:D5D22F8DAC07273E]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135) at org.apache.solr.cloud.ForceLeaderTest.bringBackOldLeaderAndSendDoc(ForceLeaderTest.java:381) at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:152) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.RestartWhileUpdatingTest.test Error Message: shard1 is not consistent. Got 189 from http://127.0.0.1:37179/collection1_shard1_replica_n21 (previous client) and got 3354 from http://127.0.0.1:37338/collection1_shard1_replica_n23 Stack Trace: java.lang.AssertionError: shard1 is not consistent. Got 189 from http://127.0.0.1:37179/collection1_shard1_replica_n21 (previous client) and got 3354 from http://127.0.0.1:37338/collection1_shard1_replica_n23 at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:BB1124973B79B3A7]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1322) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1301) at org.apache.solr.cloud.RestartWhileUpdatingTest.test(RestartWhileUpdatingTest.java:155) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.RollingRestartTest.test Error Message: KeeperErrorCode = Session expired for /overseer_elect/leader Stack Trace: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:BB1124973B79B3A7]:0) at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212) at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339) at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderId(OverseerTaskProcessor.java:374) at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderNode(OverseerTaskProcessor.java:365) at org.apache.solr.cloud.RollingRestartTest.waitUntilOverseerDesignateIsLeader(RollingRestartTest.java:137) at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104) at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx Error Message: Error from server at http://127.0.0.1:35036/solr/test_col: No registered leader was found after waiting for 4000ms , collection: test_col slice: shard5 saw state=DocCollection(test_col//collections/test_col/state.json/15)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{ "core_node3":{ "core":"test_col_shard1_replica_n1", "base_url":"http://127.0.0.1:33086/solr", "node_name":"127.0.0.1:33086_solr", "state":"down", "type":"NRT"}, "core_node5":{ "core":"test_col_shard1_replica_n2", "base_url":"http://127.0.0.1:41508/solr", "node_name":"127.0.0.1:41508_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{ "core_node7":{ "core":"test_col_shard2_replica_n4", "base_url":"http://127.0.0.1:41836/solr", "node_name":"127.0.0.1:41836_solr", "state":"down", "type":"NRT"}, "core_node9":{ "core":"test_col_shard2_replica_n6", "base_url":"http://127.0.0.1:38422/solr", "node_name":"127.0.0.1:38422_solr", "state":"down", "type":"NRT"}}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{ "core_node11":{ "core":"test_col_shard3_replica_n8", "base_url":"http://127.0.0.1:45559/solr", "node_name":"127.0.0.1:45559_solr", "state":"recovering", "type":"NRT"}, "core_node13":{ "core":"test_col_shard3_replica_n10", "base_url":"http://127.0.0.1:35036/solr", "node_name":"127.0.0.1:35036_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{ "core_node15":{ "core":"test_col_shard4_replica_n12", "base_url":"http://127.0.0.1:43174/solr", "node_name":"127.0.0.1:43174_solr", "state":"down", "type":"NRT"}, "core_node18":{ "core":"test_col_shard4_replica_n14", "base_url":"http://127.0.0.1:41214/solr", "node_name":"127.0.0.1:41214_solr", "state":"down", "type":"NRT"}}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{ "core_node19":{ "core":"test_col_shard5_replica_n16", "base_url":"http://127.0.0.1:38512/solr", "node_name":"127.0.0.1:38512_solr", "state":"down", "type":"NRT"}, "core_node20":{ "core":"test_col_shard5_replica_n17", "base_url":"http://127.0.0.1:39149/solr", "node_name":"127.0.0.1:39149_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:41836_solr, 127.0.0.1:41508_solr, 127.0.0.1:45559_solr, 127.0.0.1:35036_solr, 127.0.0.1:39149_solr, 127.0.0.1:43174_solr] Stack Trace: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35036/solr/test_col: No registered leader was found after waiting for 4000ms , collection: test_col slice: shard5 saw state=DocCollection(test_col//collections/test_col/state.json/15)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{ "core_node3":{ "core":"test_col_shard1_replica_n1", "base_url":"http://127.0.0.1:33086/solr", "node_name":"127.0.0.1:33086_solr", "state":"down", "type":"NRT"}, "core_node5":{ "core":"test_col_shard1_replica_n2", "base_url":"http://127.0.0.1:41508/solr", "node_name":"127.0.0.1:41508_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{ "core_node7":{ "core":"test_col_shard2_replica_n4", "base_url":"http://127.0.0.1:41836/solr", "node_name":"127.0.0.1:41836_solr", "state":"down", "type":"NRT"}, "core_node9":{ "core":"test_col_shard2_replica_n6", "base_url":"http://127.0.0.1:38422/solr", "node_name":"127.0.0.1:38422_solr", "state":"down", "type":"NRT"}}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{ "core_node11":{ "core":"test_col_shard3_replica_n8", "base_url":"http://127.0.0.1:45559/solr", "node_name":"127.0.0.1:45559_solr", "state":"recovering", "type":"NRT"}, "core_node13":{ "core":"test_col_shard3_replica_n10", "base_url":"http://127.0.0.1:35036/solr", "node_name":"127.0.0.1:35036_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{ "core_node15":{ "core":"test_col_shard4_replica_n12", "base_url":"http://127.0.0.1:43174/solr", "node_name":"127.0.0.1:43174_solr", "state":"down", "type":"NRT"}, "core_node18":{ "core":"test_col_shard4_replica_n14", "base_url":"http://127.0.0.1:41214/solr", "node_name":"127.0.0.1:41214_solr", "state":"down", "type":"NRT"}}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{ "core_node19":{ "core":"test_col_shard5_replica_n16", "base_url":"http://127.0.0.1:38512/solr", "node_name":"127.0.0.1:38512_solr", "state":"down", "type":"NRT"}, "core_node20":{ "core":"test_col_shard5_replica_n17", "base_url":"http://127.0.0.1:39149/solr", "node_name":"127.0.0.1:39149_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:41836_solr, 127.0.0.1:41508_solr, 127.0.0.1:45559_solr, 127.0.0.1:35036_solr, 127.0.0.1:39149_solr, 127.0.0.1:43174_solr] at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:A6396E85495973BE]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:255) at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx(TestStressCloudBlindAtomicUpdates.java:226) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSearchRate Error Message: {} Stack Trace: java.lang.AssertionError: {} at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:6E0D05C45A437810]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSearchRate(TriggerIntegrationTest.java:1490) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test Error Message: Error from server at http://127.0.0.1:37177/gf_/f: ADDREPLICA failed to create replica Stack Trace: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37177/gf_/f: ADDREPLICA failed to create replica at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:BB1124973B79B3A7]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124) at org.apache.solr.cloud.UnloadDistributedZkTest.test(UnloadDistributedZkTest.java:71) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) FAILED: org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit Error Message: GC overhead limit exceeded Stack Trace: java.lang.OutOfMemoryError: GC overhead limit exceeded at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:F73389983204E8]:0) at java.lang.Character.toChars(Character.java:5166) at org.apache.lucene.analysis.MockTokenizer.incrementToken(MockTokenizer.java:157) at org.apache.lucene.analysis.MockTokenFilter.incrementToken(MockTokenFilter.java:80) at org.apache.lucene.analysis.MockFixedLengthPayloadFilter.incrementToken(MockFixedLengthPayloadFilter.java:46) at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:736) at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:430) at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:392) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:240) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:497) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1727) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1462) at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171) at org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit(TestDocTermOrds.java:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) FAILED: org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomBig Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([1FBD5E1987B5CC78]:0) FAILED: junit.framework.TestSuite.org.apache.lucene.spatial3d.TestGeo3DPoint Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([1FBD5E1987B5CC78]:0) Build Log: [...truncated 10948 lines...] [junit4] Suite: org.apache.lucene.spatial3d.TestGeo3DPoint [junit4] 2> ??? 11, 2017 1:22:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate [junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.spatial3d.TestGeo3DPoint [junit4] 2> 1) Thread[id=1, name=main, state=WAITING, group=main] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.lang.Thread.join(Thread.java:1252) [junit4] 2> at java.lang.Thread.join(Thread.java:1326) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:636) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:493) [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:251) [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:368) [junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13) [junit4] 2> 2) Thread[id=14, name=TEST-TestGeo3DPoint.testRandomBig-seed#[1FBD5E1987B5CC78], state=RUNNABLE, group=TGRP-TestGeo3DPoint] [junit4] 2> at org.apache.lucene.spatial3d.geom.Plane.addPoint(Plane.java:1953) [junit4] 2> at org.apache.lucene.spatial3d.geom.Plane.recordBounds(Plane.java:1591) [junit4] 2> at org.apache.lucene.spatial3d.geom.XYZBounds.addPlane(XYZBounds.java:161) [junit4] 2> at org.apache.lucene.spatial3d.geom.GeoConvexPolygon.getBounds(GeoConvexPolygon.java:484) [junit4] 2> at org.apache.lucene.spatial3d.geom.GeoBaseCompositeShape.getBounds(GeoBaseCompositeShape.java:131) [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.verify(TestGeo3DPoint.java:847) [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.doTestRandom(TestGeo3DPoint.java:549) [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomBig(TestGeo3DPoint.java:481) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.lang.Thread.run(Thread.java:748) [junit4] 2> 3) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main] [junit4] 2> at java.lang.Thread.sleep(Native Method) [junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50) [junit4] 2> 4) Thread[id=13, name=SUITE-TestGeo3DPoint-seed#[1FBD5E1987B5CC78], state=RUNNABLE, group=TGRP-TestGeo3DPoint] [junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1559) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693) [junit4] 2> at java.security.AccessController.doPrivileged(Native Method) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:705) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:139) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:626) [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestGeo3DPoint -Dtests.method=testRandomBig -Dtests.seed=1FBD5E1987B5CC78 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sr-CS -Dtests.timezone=Asia/Thimphu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] ERROR 7031s J1 | TestGeo3DPoint.testRandomBig <<< [junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached. [junit4] > at __randomizedtesting.SeedInfo.seed([1FBD5E1987B5CC78]:0) [junit4] 2> ??? 11, 2017 1:22:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> ??? 11, 2017 1:23:02 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.spatial3d.TestGeo3DPoint: [junit4] 2> 1) Thread[id=14, name=TEST-TestGeo3DPoint.testRandomBig-seed#[1FBD5E1987B5CC78], state=RUNNABLE, group=TGRP-TestGeo3DPoint] [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.verify(TestGeo3DPoint.java:839) [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.doTestRandom(TestGeo3DPoint.java:549) [junit4] 2> at org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomBig(TestGeo3DPoint.java:481) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.lang.Thread.run(Thread.java:748) [junit4] 2> ??? 11, 2017 1:23:02 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> INFO: Starting to interrupt leaked threads: [junit4] 2> 1) Thread[id=14, name=TEST-TestGeo3DPoint.testRandomBig-seed#[1FBD5E1987B5CC78], state=RUNNABLE, group=TGRP-TestGeo3DPoint] [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/spatial3d/test/J1/temp/lucene.spatial3d.TestGeo3DPoint_1FBD5E1987B5CC78-001 [junit4] 2> Dec 11, 2017 7:23:02 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> INFO: All leaked threads terminated. [junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@148e1e7a), locale=sr-CS, timezone=Asia/Thimphu [junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=112298752,total=418906112 [junit4] 2> NOTE: All tests run in this JVM: [GeoCircleTest, TestGeo3DPoint] [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestGeo3DPoint -Dtests.seed=1FBD5E1987B5CC78 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sr-CS -Dtests.timezone=Asia/Thimphu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] ERROR 0.00s J1 | TestGeo3DPoint (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([1FBD5E1987B5CC78]:0) [junit4] Completed [16/16 (1!)] on J1 in 7220.68s, 13 tests, 2 errors <<< FAILURES! [...truncated 1980 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest [junit4] 2> 429113 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_33451B4D9585DE5F-001/init-core-data-001 [junit4] 2> 429115 WARN (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1 [junit4] 2> 429115 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 429116 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 429117 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_33451B4D9585DE5F-001/tempDir-001 [junit4] 2> 429188 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 429198 INFO (Thread-79) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 429198 INFO (Thread-79) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 429304 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:44158 [junit4] 2> 429349 ERROR (Thread-79) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 429425 INFO (zkConnectionManagerCallback-85-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 429629 INFO (jetty-launcher-82-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531 [junit4] 2> 429719 INFO (jetty-launcher-82-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@475d8239{/solr,null,AVAILABLE} [junit4] 2> 429757 INFO (jetty-launcher-82-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531 [junit4] 2> 429792 INFO (jetty-launcher-82-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7cb7cd58{/solr,null,AVAILABLE} [junit4] 2> 429966 INFO (jetty-launcher-82-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1bcb239e{SSL,[ssl, http/1.1]}{127.0.0.1:43422} [junit4] 2> 429966 INFO (jetty-launcher-82-thread-2) [ ] o.e.j.s.Server Started @444247ms [junit4] 2> 429966 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43422} [junit4] 2> 429967 ERROR (jetty-launcher-82-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 429967 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0 [junit4] 2> 429967 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 429967 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 429967 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-11T08:02:12.028Z [junit4] 2> 429967 INFO (jetty-launcher-82-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3e0d5077{SSL,[ssl, http/1.1]}{127.0.0.1:38111} [junit4] 2> 429967 INFO (jetty-launcher-82-thread-1) [ ] o.e.j.s.Server Started @444248ms [junit4] 2> 429968 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38111} [junit4] 2> 429968 ERROR (jetty-launcher-82-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 429968 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0 [junit4] 2> 429968 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 429968 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 429968 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-11T08:02:12.029Z [junit4] 2> 430082 INFO (zkConnectionManagerCallback-89-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 430116 INFO (zkConnectionManagerCallback-87-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 430121 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 430121 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 430230 INFO (jetty-launcher-82-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44158/solr [junit4] 2> 430315 INFO (zkConnectionManagerCallback-93-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 430442 INFO (jetty-launcher-82-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44158/solr [junit4] 2> 430552 INFO (zkConnectionManagerCallback-97-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 430527 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x160449879110003, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203) [junit4] 2> at java.lang.Thread.run(Thread.java:748) [junit4] 2> 430726 INFO (zkConnectionManagerCallback-99-thread-1-processing-n:127.0.0.1:38111_solr) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 430839 INFO (zkConnectionManagerCallback-101-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 431108 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 431109 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43422_solr [junit4] 2> 431110 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.Overseer Overseer (id=99154613459025926-127.0.0.1:43422_solr-n_0000000000) starting [junit4] 2> 431222 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43422_solr [junit4] 2> 431222 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger [junit4] 2> 431331 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 431343 INFO (OverseerStateUpdate-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 431344 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:43422_solr] [junit4] 2> 431344 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1 [junit4] 2> 431344 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 431437 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 431438 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 431438 DEBUG (ScheduledTrigger-184-thread-1) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:43422_solr] [junit4] 2> 431681 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 431683 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 431699 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38111_solr [junit4] 2> 431699 INFO (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 431843 INFO (zkCallback-98-thread-1-processing-n:127.0.0.1:38111_solr) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 432243 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43422.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 432335 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43422.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 432335 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43422.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 432336 INFO (jetty-launcher-82-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_33451B4D9585DE5F-001/tempDir-001/node2/. [junit4] 2> 432605 DEBUG (ScheduledTrigger-184-thread-1) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr] [junit4] 2> 432936 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38111.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 433046 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38111.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 433046 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38111.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 433060 INFO (jetty-launcher-82-thread-1) [n:127.0.0.1:38111_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_33451B4D9585DE5F-001/tempDir-001/node1/. [junit4] 2> 433309 INFO (zkConnectionManagerCallback-106-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 433567 INFO (zkConnectionManagerCallback-110-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 433713 DEBUG (ScheduledTrigger-184-thread-2) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr] [junit4] 2> 433771 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 433844 INFO (SUITE-TriggerIntegrationTest-seed#[33451B4D9585DE5F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44158/solr ready [junit4] 2> 434253 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger [junit4] 2> 434254 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 434254 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 434273 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2 [junit4] 2> 434276 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 434277 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 434346 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 435342 INFO (zkConnectionManagerCallback-114-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 435366 INFO (qtp1378649828-427) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 435367 INFO (qtp1378649828-427) [n:127.0.0.1:43422_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44158/solr ready [junit4] 2> 436020 INFO (qtp1642614097-418) [n:127.0.0.1:38111_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=56 [junit4] 2> 436264 INFO (qtp1378649828-429) [n:127.0.0.1:43422_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0 [junit4] 2> 436266 DEBUG (qtp1378649828-427) [n:127.0.0.1:43422_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 436301 INFO (qtp1378649828-427) [n:127.0.0.1:43422_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=1051 [junit4] 2> 436321 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 436361 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr] [junit4] 2> 436361 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true} [junit4] 2> 436365 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 436414 INFO (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init [junit4] 2> 436432 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 436433 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3 [junit4] 2> 436433 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 436439 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr] [junit4] 2> 436442 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531 [junit4] 2> 436524 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d535897{/solr,null,AVAILABLE} [junit4] 2> 436525 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@112a933{SSL,[ssl, http/1.1]}{127.0.0.1:41223} [junit4] 2> 436525 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.e.j.s.Server Started @450806ms [junit4] 2> 436525 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41223} [junit4] 2> 436526 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 436533 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0 [junit4] 2> 436533 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 436533 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 436533 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-11T08:02:18.594Z [junit4] 2> 436605 INFO (zkConnectionManagerCallback-116-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 436621 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 436682 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44158/solr [junit4] 2> 436877 INFO (zkConnectionManagerCallback-120-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 437081 INFO (zkConnectionManagerCallback-122-thread-1-processing-n:127.0.0.1:41223_solr) [n:127.0.0.1:41223_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 437142 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 437144 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 437192 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41223_solr [junit4] 2> 437211 INFO (zkCallback-98-thread-1-processing-n:127.0.0.1:38111_solr) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 437211 INFO (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 437447 INFO (zkCallback-121-thread-1-processing-n:127.0.0.1:41223_solr) [n:127.0.0.1:41223_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 437447 INFO (zkCallback-109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 437466 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 437466 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 437466 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:41223_solr at time 1512979339527000000 [junit4] 2> 438470 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 438470 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 438633 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41223.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 438800 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41223.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 438800 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41223.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c3ad449 [junit4] 2> 438802 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [n:127.0.0.1:41223_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_33451B4D9585DE5F-001/tempDir-001/node3/. [junit4] 2> 439470 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 439470 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 440472 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 440473 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 440473 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:41223_solr] added at times [1512979339527000000], now=1512979342534000000 [junit4] 2> 440474 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"14ff2eb175030fc0T644u2kag0gma5hvxi10xfmqmt", [junit4] 2> "source":"node_added_trigger", [junit4] 2> "eventTime":1512979339527000000, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[1512979339527000000], [junit4] 2> "nodeNames":["127.0.0.1:41223_solr"]}} [junit4] 2> 440494 INFO (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging. [junit4] 2> 440511 DEBUG (AutoscalingActionExecutor-185-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"14ff2eb175030fc0T644u2kag0gma5hvxi10xfmqmt", [junit4] 2> "source":"node_added_trigger", [junit4] 2> "eventTime":1512979339527000000, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[1512979339527000000], [junit4] 2> "_enqueue_time_":1512979342535000000, [junit4] 2> "nodeNames":["127.0.0.1:41223_solr"]}} [junit4] 2> 441013 INFO (zkConnectionManagerCallback-127-thread-1-processing-n:127.0.0.1:38111_solr) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 441015 INFO (qtp1642614097-420) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 441015 INFO (qtp1642614097-420) [n:127.0.0.1:38111_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44158/solr ready [junit4] 2> 441293 INFO (qtp1642614097-417) [n:127.0.0.1:38111_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0 [junit4] 2> 441524 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 441524 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 441635 INFO (qtp1609401051-484) [n:127.0.0.1:41223_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0 [junit4] 2> 441680 INFO (qtp1378649828-422) [n:127.0.0.1:43422_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0 [junit4] 2> 441681 DEBUG (qtp1642614097-420) [n:127.0.0.1:38111_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 441745 INFO (qtp1642614097-420) [n:127.0.0.1:38111_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=839 [junit4] 2> 441747 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4 [junit4] 2> 441747 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 441747 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true} [junit4] 2> 441747 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4 [junit4] 2> 441801 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 441801 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4 [junit4] 2> 442541 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 442541 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 443549 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 443549 DEBUG (ScheduledTrigger-184-thread-3) [n:127.0.0.1:43422_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:43422_solr, 127.0.0.1:38111_solr, 127.0.0.1:41223_solr] [junit4] 2> 443752 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[33451B4D9585DE5F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAddedTrigger [junit4] 2> 443873 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[33451B4D9585DE5F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTriggerRestoreState [junit4] 2> 443891 DEBUG (zkCallback-100-thread-1-processing-n:127.0.0.1:43422_solr) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5 [junit4] 2> 443892 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[33451B4D9585DE5F]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5 [junit4] 2> 443895 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5 [junit4] 2> 444095 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 444096 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 444096 DEBUG (OverseerAutoScalingTriggerThread-99154613459025926-127.0.0.1:43422_solr-n_0000000000) [n:127.0.0.1:43422_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5 [junit4] 2> 444104 INFO (zkConnectionManagerCallback-131-thread-1-processing-n:127.0.0.1:38111_solr) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 444132 INFO (qtp1642614097-418) [n:127.0.0.1:38111_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 444133 INFO (qtp1642614097-418) [n:127.0.0.1:38111_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44158/solr ready [junit4] 2> 444168 INFO (qtp1642614097-414) [n:127.0.0.1:38111_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName& [...truncated too long message...] Test, MetricsHandlerTest, DirectUpdateHandlerOptimizeTest, BasicZkTest, TestPullReplica, ResourceLoaderTest, DocValuesTest, TestStressLiveNodes, RecoveryAfterSoftCommitTest, CloudMLTQParserTest, DateMathParserTest, DeleteInactiveReplicaTest, TestCollectionsAPIViaSolrCloudCluster, TestSimpleTrackingShardHandler, ActionThrottleTest, AssignTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, CreateCollectionCleanupTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerStatusTest, PeerSyncReplicationTest, ReplicationFactorTest, ShardSplitTest, TlogReplayBufferedWhileIndexingTest, ExecutePlanActionTest, NodeAddedTriggerTest, CdcrReplicationDistributedZkTest, CdcrReplicationHandlerTest, HdfsCollectionsAPIDistributedZkTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest] [junit4] Completed [583/752 (6!)] on J0 in 160.74s, 1 test, 1 error <<< FAILURES! [...truncated 584 lines...] [junit4] Suite: org.apache.solr.uninverting.TestDocTermOrds [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDocTermOrds -Dtests.method=testTriggerUnInvertLimit -Dtests.seed=33451B4D9585DE5F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=no-NO -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] ERROR 295s J0 | TestDocTermOrds.testTriggerUnInvertLimit <<< [junit4] > Throwable #1: java.lang.OutOfMemoryError: GC overhead limit exceeded [junit4] > at __randomizedtesting.SeedInfo.seed([33451B4D9585DE5F:F73389983204E8]:0) [junit4] > at java.lang.Character.toChars(Character.java:5166) [junit4] > at org.apache.lucene.analysis.MockTokenizer.incrementToken(MockTokenizer.java:157) [junit4] > at org.apache.lucene.analysis.MockTokenFilter.incrementToken(MockTokenFilter.java:80) [junit4] > at org.apache.lucene.analysis.MockFixedLengthPayloadFilter.incrementToken(MockFixedLengthPayloadFilter.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:736) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:430) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:392) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:240) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:497) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1727) [junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1462) [junit4] > at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171) [junit4] > at org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit(TestDocTermOrds.java:167) [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.uninverting.TestDocTermOrds_33451B4D9585DE5F-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {field=PostingsFormat(name=Direct), foo=PostingsFormat(name=Direct), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=1626, maxMBSortInHeap=7.481417159256942, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@14aea1fb), locale=no-NO, timezone=Europe/Ljubljana [junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=60333712,total=477626368 [junit4] 2> NOTE: All tests run in this JVM: [TestRestManager, TestSort, TestTrieFacet, TestSolrFieldCacheBean, TestDFRSimilarityFactory, SoftAutoCommitTest, SSLMigrationTest, TestTolerantUpdateProcessorRandomCloud, JvmMetricsTest, ResponseLogComponentTest, NodeMutatorTest, TriggerIntegrationTest, TestSuggestSpellingConverter, QueryParsingTest, UpdateRequestProcessorFactoryTest, ForceLeaderTest, BadCopyFieldTest, SearchHandlerTest, DocumentBuilderTest, TestConfigReload, TestDistribDocBasedVersion, TestTestInjection, TestJoin, SpatialHeatmapFacetsTest, TestDynamicLoading, SolrMetricManagerTest, TestIBSimilarityFactory, SliceStateTest, NoCacheHeaderTest, TestRandomFaceting, TestSchemalessBufferedUpdates, TestRecovery, TestConfig, JsonLoaderTest, HLLUtilTest, TestDocBasedVersionConstraints, AssignBackwardCompatibilityTest, TestCodecSupport, TestReversedWildcardFilterFactory, TestCloudManagedSchema, EnumFieldTest, SpellCheckComponentTest, TestSolrConfigHandlerConcurrent, TestLegacyTerms, SolrShardReporterTest, DistributedQueryElevationComponentTest, TestExactSharedStatsCache, CoreAdminRequestStatusTest, CollectionStateFormat2Test, CdcrBootstrapTest, TestFieldCacheVsDocValues, BlockDirectoryTest, TestBadConfig, FastVectorHighlighterTest, InfixSuggestersTest, GraphQueryTest, LargeFieldTest, ExplicitHLLTest, RequestLoggingTest, SmileWriterTest, TestReplicationHandlerBackup, TestReplicationHandler, DistribCursorPagingTest, DistributedMLTComponentTest, TestConfigSetsAPIZkFailure, ResponseHeaderTest, TestQueryUtils, TestNumericTerms32, SearchRateTriggerTest, ComputePlanActionTest, TestFieldCacheReopen, OverseerCollectionConfigSetProcessorTest, TestSegmentSorting, TestScoreJoinQPNoScore, MigrateRouteKeyTest, SegmentsInfoRequestHandlerTest, TestRandomRequestDistribution, TestNumericRangeQuery64, DistributedQueueTest, TestHalfAndHalfDocValues, TestMacroExpander, AnalysisAfterCoreReloadTest, TestSolrJ, TestAuthorizationFramework, HighlighterMaxOffsetTest, TestSolrXml, TestComplexPhraseLeadingWildcard, TestSchemaVersionResource, DistributedFacetPivotLargeTest, BasicFunctionalityTest, TestSmileRequest, TestHdfsCloudBackupRestore, TestCollectionAPIs, TestPHPSerializedResponseWriter, MoveReplicaHDFSTest, DistributedDebugComponentTest, TestComponentsName, TestCloudPivotFacet, TestOrdValues, HdfsWriteToMultipleCollectionsTest, TestObjectReleaseTracker, CdcrRequestHandlerTest, RAMDirectoryFactoryTest, TestFreeTextSuggestions, BlockJoinFacetDistribTest, VersionInfoTest, TestStressVersions, TestFoldingMultitermQuery, DistributedQueryComponentOptimizationTest, DistributedFacetPivotSmallTest, MetricsHandlerTest, DirectUpdateHandlerOptimizeTest, BasicZkTest, TestPullReplica, ResourceLoaderTest, DocValuesTest, TestStressLiveNodes, RecoveryAfterSoftCommitTest, CloudMLTQParserTest, DateMathParserTest, DeleteInactiveReplicaTest, TestCollectionsAPIViaSolrCloudCluster, TestSimpleTrackingShardHandler, ActionThrottleTest, AssignTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, CreateCollectionCleanupTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerStatusTest, PeerSyncReplicationTest, ReplicationFactorTest, ShardSplitTest, TlogReplayBufferedWhileIndexingTest, ExecutePlanActionTest, NodeAddedTriggerTest, CdcrReplicationDistributedZkTest, CdcrReplicationHandlerTest, HdfsCollectionsAPIDistributedZkTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest, StressHdfsTest, TestClusterStateMutator, ZkStateReaderTest, RuleEngineTest, RulesTest, TestBackupRepositoryFactory, TestConfigOverlay, TestConfigSetProperties, TestConfigSets, TestInitParams, TestSolrCloudSnapshots, TestSQLHandler, TestHttpShardHandlerFactory, TestPivotHelperCode, TestUnifiedSolrHighlighter, TestSlowCompositeReaderWrapper, UninvertDocValuesMergePolicyTest, WrapperMergePolicyFactoryTest, CheckHdfsIndexTest, TestLegacyField, TestLegacyFieldReuse, TestNumericRangeQuery32, MetricsConfigTest, SolrGangliaReporterTest, SolrJmxReporterCloudTest, SolrJmxReporterTest, SubstringBytesRefFilterTest, TestIntervalFaceting, TestSimpleQParserPlugin, TestStressUserVersions, TestXmlQParserPlugin, TestJsonFacetRefinement, TestMinMaxOnMultiValuedField, SimpleMLTQParserTest, TestDFISimilarityFactory, TestNonDefinedSimilarityFactory, TestDistribIDF, TestLRUStatsCache, TestSolrCloudWithHadoopAuthPlugin, HdfsLockFactoryTest, TestDocTermOrds] [junit4] Completed [734/752 (7!)] on J0 in 306.14s, 10 tests, 1 error <<< FAILURES! [...truncated 51 lines...] [junit4] JVM J0: stdout was not empty, see: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J0-20171211_075447_3185700268493426221447.sysout [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded [junit4] Dumping heap to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid30586.hprof ... [junit4] Heap dump file created [463393112 bytes in 5.476 secs] [junit4] <<< JVM J0: EOF ---- [...truncated 8502 lines...] BUILD FAILED /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:843: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:787: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created: * java_pid30586.hprof Total time: 873 minutes 8 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org