Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4443/ Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)
2 tests failed. REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0) Build Log: [...truncated 10853 lines...] [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\init-core-data-001 [junit4] 2> 2182043 T3968 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false) [junit4] 2> 2182043 T3968 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ugpw/ [junit4] 2> 2182067 T3968 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 2182067 T3968 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2182073 T3969 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 2182196 T3968 oasc.ZkTestServer.run start zk server on port:56899 [junit4] 2> 2182196 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2182199 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2182206 T3976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bb960f6 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2182206 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2182206 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2182206 T3968 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 2182215 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2182217 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2182226 T3979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e505b9 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2182227 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2182227 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2182227 T3968 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 2182232 T3968 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 2182236 T3968 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 2182240 T3968 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 2182244 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 2182244 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 2182250 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml [junit4] 2> 2182250 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 2182258 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2182258 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2182264 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 2182264 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 2182269 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 2182269 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 2182273 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml [junit4] 2> 2182273 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 2182278 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 2182278 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 2182283 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 2182283 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 2182288 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2182288 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2182293 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 2182293 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 2182298 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 2182298 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 2182305 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2182310 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2182311 T3982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1592d7fc name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2182311 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2182311 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2184355 T3968 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2184365 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2184390 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56909 [junit4] 2> 2184395 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2184395 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2184397 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002 [junit4] 2> 2184397 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\' [junit4] 2> 2184438 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\solr.xml [junit4] 2> 2184539 T3968 oasc.CoreContainer.<init> New CoreContainer 933801199 [junit4] 2> 2184539 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\] [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2184545 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2184547 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2184547 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2184554 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2184558 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2184558 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2184558 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2184558 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr [junit4] 2> 2184558 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2184562 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2184563 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2184568 T3994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73d99907 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2184569 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2184569 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2184572 T3970 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149ceec0cfa0003, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 2184575 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2184578 T3997 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af76892 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2184579 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2184580 T3968 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 2184586 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 2184591 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 2184596 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 2184601 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 2184607 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 2184610 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56909_ugpw [junit4] 2> 2184611 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56909_ugpw [junit4] 2> 2184618 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 2184623 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 2184627 T3968 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2184630 T3968 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56909_ugpw [junit4] 2> 2184630 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 2184634 T3968 oasc.Overseer.start Overseer (id=92832780563120132-127.0.0.1:56909_ugpw-n_0000000000) starting [junit4] 2> 2184639 T3968 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 2184656 T3968 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 2184657 T3999 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 2184657 T3968 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 2184663 T3968 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 2184666 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2184674 T3998 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 2184683 T4001 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection [junit4] 2> 2184683 T4001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2184684 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2184684 T4001 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56909_ugpw", [junit4] 2> "collection":"control_collection", [junit4] 2> "numShards":"1", [junit4] 2> "roles":null, [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:56909/ugpw"} [junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1] [junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1 [junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1 [junit4] 2> 2184698 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2185937 T4001 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 2185937 T4001 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection [junit4] 2> 2185940 T4001 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2185940 T4001 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 2185942 T4001 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185942 T4001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\collection1\' [junit4] 2> 2185946 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/.svn/' to classloader [junit4] 2> 2185947 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/classes/' to classloader [junit4] 2> 2185949 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/README' to classloader [junit4] 2> 2186033 T4001 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 2186110 T4001 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2186113 T4001 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 2186126 T4001 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 2186609 T4001 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2186613 T4001 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2186615 T4001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2186623 T4001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2186669 T4001 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 2186669 T4001 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 2186669 T4001 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/control/data\ [junit4] 2> 2186670 T4001 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845 [junit4] 2> 2186675 T4001 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data [junit4] 2> 2186676 T4001 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/control/data\index/ [junit4] 2> 2186676 T4001 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index' doesn't exist. Creating new index... [junit4] 2> 2186679 T4001 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index [junit4] 2> 2186680 T4001 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861 [junit4] 2> 2186691 T4001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index,segFN=segments_1,generation=1} [junit4] 2> 2186692 T4001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2186698 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2186702 T4001 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2186702 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2186705 T4001 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 2186705 T4001 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 2186707 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 2186707 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2186708 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2186731 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2186739 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2186745 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2186747 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2186753 T4001 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 2186753 T4001 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 2186756 T4001 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 2186758 T4001 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index,segFN=segments_1,generation=1} [junit4] 2> 2186760 T4001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2186760 T4001 oass.SolrIndexSearcher.<init> Opening Searcher@4f6cfbd0[collection1] main [junit4] 2> 2186760 T4001 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 2186763 T4001 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2186763 T4001 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 2186764 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2186764 T4001 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 2186764 T4001 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2186767 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 2186767 T4001 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2186768 T4001 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json [junit4] 2> 2186773 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json [junit4] 2> 2186773 T4001 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2186774 T4001 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 2186780 T4001 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 2186780 T4002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f6cfbd0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2186782 T4006 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56909/ugpw collection:control_collection shard:shard1 [junit4] 2> 2186783 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0 [junit4] 2> 2186783 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2186786 T4006 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 2186799 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 [junit4] 2> 2186800 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2186802 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2186802 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2186805 T4006 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 2186805 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C15982 name=collection1 org.apache.solr.core.SolrCore@190095fd url=https://127.0.0.1:56909/ugpw/collection1 node=127.0.0.1:56909_ugpw C15982_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:56909_ugpw, state=down, base_url=https://127.0.0.1:56909/ugpw} [junit4] 2> 2186805 T4006 C15982 P56909 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56909/ugpw/collection1/ [junit4] 2> 2186806 T4006 C15982 P56909 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 2186806 T4006 C15982 P56909 oasc.SyncStrategy.syncToMe https://127.0.0.1:56909/ugpw/collection1/ has no replicas [junit4] 2> 2186806 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56909/ugpw/collection1/ shard1 [junit4] 2> 2186806 T4006 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 2186809 T4009 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21c07652 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2186811 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2186811 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2186816 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2186826 T3968 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 2186827 T3968 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2 [junit4] 2> 2186827 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2186828 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2186829 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2186829 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2186835 T4012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d57497d name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2186835 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2186837 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2186843 T3970 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149ceec0cfa0006, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 2186853 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1 [junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3] [junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2 [junit4] 2> 2186860 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2186861 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json [junit4] 2> 2186865 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2186866 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2186888 T4006 oasc.ZkController.register We are https://127.0.0.1:56909/ugpw/collection1/ and leader is https://127.0.0.1:56909/ugpw/collection1/ [junit4] 2> 2186888 T4006 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56909/ugpw [junit4] 2> 2186888 T4006 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 2186888 T4006 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection [junit4] 2> 2186888 T4006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2186893 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2186904 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56909_ugpw", [junit4] 2> "collection":"control_collection", [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "base_url":"https://127.0.0.1:56909/ugpw"} [junit4] 2> 2187040 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2187041 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2188911 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 2188912 T3968 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2188925 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2188929 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56924 [junit4] 2> 2188935 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2188935 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2188935 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003 [junit4] 2> 2188936 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\' [junit4] 2> 2188972 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\solr.xml [junit4] 2> 2189072 T3968 oasc.CoreContainer.<init> New CoreContainer 942879475 [junit4] 2> 2189072 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\] [junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2189084 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2189088 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2189088 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2189088 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2189092 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr [junit4] 2> 2189092 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2189092 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2189095 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2189098 T4024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@311405af name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2189099 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2189099 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2189105 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2189108 T4027 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@753cdc90 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2189108 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2189122 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2190261 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56924_ugpw [junit4] 2> 2190262 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56924_ugpw [junit4] 2> 2190271 T3968 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2190289 T4028 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 2190289 T4028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2190292 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2190293 T4028 oasc.ZkController.preRegister Registering watch for external collection collection1 [junit4] 2> 2190293 T4028 oascc.ZkStateReader.addZkWatch addZkWatch collection1 [junit4] 2> 2190294 T4028 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... [junit4] 2> 2190299 T4028 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 [junit4] 2> 2190299 T4028 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2190310 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56924_ugpw", [junit4] 2> "collection":"collection1", [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:56924/ugpw"} [junit4] 2> 2190316 T3998 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 [junit4] 2> 2190319 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3 [junit4] 2> 2190328 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2190330 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2190331 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2190333 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 [junit4] 2> 2191426 T4028 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 2191426 T4028 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 2191429 T4028 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2191429 T4028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 2191431 T4028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2191431 T4028 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\collection1\' [junit4] 2> 2191434 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/.svn/' to classloader [junit4] 2> 2191436 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/classes/' to classloader [junit4] 2> 2191437 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/README' to classloader [junit4] 2> 2191516 T4028 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 2191602 T4028 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2191605 T4028 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 2191616 T4028 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 2192045 T4028 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2192050 T4028 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2192051 T4028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2192057 T4028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2192095 T4028 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2192096 T4028 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 2192096 T4028 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty1\ [junit4] 2> 2192096 T4028 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845 [junit4] 2> 2192099 T4028 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1 [junit4] 2> 2192100 T4028 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty1\index/ [junit4] 2> 2192100 T4028 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index' doesn't exist. Creating new index... [junit4] 2> 2192103 T4028 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index [junit4] 2> 2192103 T4028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861 [junit4] 2> 2192108 T4028 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1} [junit4] 2> 2192108 T4028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2192114 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2192117 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2192117 T4028 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2192117 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2192118 T4028 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2192119 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2192119 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2192120 T4028 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 2192120 T4028 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 2192122 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 2192122 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2192124 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2192135 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2192138 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2192140 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2192142 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2192147 T4028 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 2192147 T4028 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 2192149 T4028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 2192151 T4028 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1} [junit4] 2> 2192151 T4028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2192152 T4028 oass.SolrIndexSearcher.<init> Opening Searcher@6d643724[collection1] main [junit4] 2> 2192153 T4028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 2192155 T4028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2192155 T4028 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 2192157 T4028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2192157 T4028 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 2192157 T4028 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2192159 T4028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 2192159 T4028 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2192160 T4028 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 2192160 T4028 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 2192163 T4029 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d643724[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2192165 T4028 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 2192166 T4032 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56924/ugpw collection:collection1 shard:shard3 [junit4] 2> 2192168 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0 [junit4] 2> 2192169 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2192170 T4032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election [junit4] 2> 2192182 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3 [junit4] 2> 2192185 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C15983 name=collection1 org.apache.solr.core.SolrCore@2d0b5a78 url=https://127.0.0.1:56924/ugpw/collection1 node=127.0.0.1:56924_ugpw C15983_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:56924_ugpw, state=down, base_url=https://127.0.0.1:56924/ugpw} [junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56924/ugpw/collection1/ [junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.syncToMe https://127.0.0.1:56924/ugpw/collection1/ has no replicas [junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56924/ugpw/collection1/ shard3 [junit4] 2> 2192189 T4032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3 [junit4] 2> 2192207 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2192209 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2192211 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 [junit4] 2> 2192228 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2192229 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2192230 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2192233 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 [junit4] 2> 2192261 T4032 oasc.ZkController.register We are https://127.0.0.1:56924/ugpw/collection1/ and leader is https://127.0.0.1:56924/ugpw/collection1/ [junit4] 2> 2192262 T4032 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56924/ugpw [junit4] 2> 2192262 T4032 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 2192262 T4032 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 2192262 T4032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2192266 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2192277 T4032 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 [junit4] 2> 2192277 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56924_ugpw", [junit4] 2> "collection":"collection1", [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard3", [junit4] 2> "state":"active", [junit4] 2> "base_url":"https://127.0.0.1:56924/ugpw"} [junit4] 2> 2192288 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2192290 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2192291 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 [junit4] 2> 2193944 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 2193945 T3968 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2193956 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2193959 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56933 [junit4] 2> 2193965 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004 [junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\' [junit4] 2> 2194002 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\solr.xml [junit4] 2> 2194094 T3968 oasc.CoreContainer.<init> New CoreContainer 1720565798 [junit4] 2> 2194094 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\] [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2194098 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2194098 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2194101 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2194106 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2194106 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2194106 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2194106 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr [junit4] 2> 2194106 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2194106 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2194110 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2194114 T4044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61a26416 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2194115 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2194115 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2194119 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2194121 T4047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53bee23f name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2194122 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2194135 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2195272 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56933_ugpw [junit4] 2> 2195273 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56933_ugpw [junit4] 2> 2195283 T3968 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2195300 T4048 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 2195301 T4048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2195304 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2195305 T4048 oasc.ZkController.preRegister Registering watch for external collection collection1 [junit4] 2> 2195306 T4048 oascc.ZkStateReader.addZkWatch addZkWatch collection1 [junit4] 2> 2195306 T4048 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... [junit4] 2> 2195310 T4048 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 [junit4] 2> 2195310 T4048 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2195312 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56933_ugpw", [junit4] 2> "collection":"collection1", [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:56933/ugpw"} [junit4] 2> 2195318 T3998 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 [junit4] 2> 2195321 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2 [junit4] 2> 2195331 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2195333 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2195333 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2195334 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 [junit4] 2> 2195334 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 [junit4] 2> 2196437 T4048 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 2196437 T4048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 2196438 T4048 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2196440 T4048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 2196441 T4048 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2196442 T4048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\collection1\' [junit4] 2> 2196445 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/.svn/' to classloader [junit4] 2> 2196446 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/classes/' to classloader [junit4] 2> 2196448 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/README' to classloader [junit4] 2> 2196528 T4048 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 2196587 T4048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2196590 T4048 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 2196615 T4048 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 2197057 T4048 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2197061 T4048 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2197063 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2197069 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2197112 T4048 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2197112 T4048 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 2197112 T4048 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty2\ [junit4] 2> 2197114 T4048 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845 [junit4] 2> 2197116 T4048 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2 [junit4] 2> 2197117 T4048 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty2\index/ [junit4] 2> 2197117 T4048 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index' doesn't exist. Creating new index... [junit4] 2> 2197119 T4048 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index [junit4] 2> 2197120 T4048 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861 [junit4] 2> 2197156 T4048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1} [junit4] 2> 2197156 T4048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2197167 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 2197170 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 2197170 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2197171 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2197171 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2197172 T4048 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2197172 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2197174 T4048 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2197174 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2197175 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2197175 T4048 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 2197177 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 2197177 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 2197179 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2197179 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2197187 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2197190 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2197193 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2197195 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2197202 T4048 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 2197202 T4048 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 2197204 T4048 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 2197204 T4048 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1} [junit4] 2> 2197204 T4048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2197205 T4048 oass.SolrIndexSearcher.<init> Opening Searcher@67f34e4e[collection1] main [junit4] 2> 2197205 T4048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 2197208 T4048 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2197208 T4048 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 2197209 T4048 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2197209 T4048 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 2197210 T4048 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2197213 T4048 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 2197213 T4048 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2197213 T4048 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 2197213 T4048 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 2197216 T4049 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67f34e4e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2197217 T4048 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 2197218 T4052 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56933/ugpw collection:collection1 shard:shard2 [junit4] 2> 2197220 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0 [junit4] 2> 2197220 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2197223 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election [junit4] 2> 2197232 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2 [junit4] 2> 2197236 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2197237 T4052 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 2197237 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C15984 name=collection1 org.apache.solr.core.SolrCore@1736844b url=https://127.0.0.1:56933/ugpw/collection1 node=127.0.0.1:56933_ugpw C15984_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:56933_ugpw, state=down, base_url=https://127.0.0.1:56933/ugpw} [junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56933/ugpw/collection1/ [junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.syncToMe https://127.0.0.1:56933/ugpw/collection1/ has no replicas [junit4] 2> 2197238 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56933/ugpw/collection1/ shard2 [junit4] 2> 2197238 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2 [junit4] 2> 2197261 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2197263 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197263 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197267 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 [junit4] 2> 2197267 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 [junit4] 2> 2197283 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2197285 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2197286 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197288 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197289 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 [junit4] 2> 2197290 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 [junit4] 2> 2197313 T4052 oasc.ZkController.register We are https://127.0.0.1:56933/ugpw/collection1/ and leader is https://127.0.0.1:56933/ugpw/collection1/ [junit4] 2> 2197313 T4052 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56933/ugpw [junit4] 2> 2197313 T4052 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 2197313 T4052 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 2197313 T4052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 2197316 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2197328 T4052 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 [junit4] 2> 2197329 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "node_name":"127.0.0.1:56933_ugpw", [junit4] 2> "collection":"collection1", [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "core_node_name":"core_node2", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard2", [junit4] 2> "state":"active", [junit4] 2> "base_url":"https://127.0.0.1:56933/ugpw"} [junit4] 2> 2197347 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json [junit4] 2> 2197349 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197349 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... [junit4] 2> 2197350 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8 [junit4] 2> 2197351 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8 [junit4] 2> 2199012 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 2199012 T3968 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2199020 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2199024 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56942 [junit4] 2> 2199029 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005 [junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\' [junit4] 2> 2199067 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\solr.xml [junit4] 2> 2199137 T3968 oasc.CoreContainer.<init> New CoreContainer 1131504597 [junit4] 2> 2199137 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\] [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2199144 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2199162 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2199162 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2199162 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2199162 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr [junit4] 2> 2199162 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2199162 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2199165 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2199168 T4064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@652fee0e name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2199169 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [ [...truncated too long message...] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 34) Thread[id=4050, name=Thread-807, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.lang.Object.wait(Object.java:503) [junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:925) [junit4] 2> 35) Thread[id=3983, name=HashSessionScavenger-53, state=TERMINATED, group={null group}] [junit4] 2> at java.lang.Object.wait(Native Method) [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552) [junit4] 2> at java.util.TimerThread.run(Timer.java:505) [junit4] 2> 36) Thread[id=4052, name=coreZkRegister-1232-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 37) Thread[id=4101, name=commitScheduler-1258-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 38) Thread[id=4814, name=zkCallback-1141-thread-115, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) [junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) [junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) [junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 39) Thread[id=4099, name=commitScheduler-1240-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 40) Thread[id=4092, name=coreZkRegister-1250-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneFixedGap), a_t=Lucene50(blocksize=128), a_i=PostingsFormat(name=LuceneFixedGap), rnd_b=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=pt, timezone=Atlantic/Canary [junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_67 (64-bit)/cpus=2,threads=78,free=158271320,total=262578176 [junit4] 2> NOTE: All tests run in this JVM: [TestManagedResource, TestModifyConfFiles, TestTolerantSearch, SOLR749Test, AnalysisAfterCoreReloadTest, TestTrie, LoggingHandlerTest, URLClassifyProcessorTest, CursorPagingTest, TestConfigOverlay, SolrXmlInZkTest, HdfsWriteToMultipleCollectionsTest, HighlighterMaxOffsetTest, MergeStrategyTest, TestQueryUtils, DistributedSuggestComponentTest, AliasIntegrationTest, FieldAnalysisRequestHandlerTest, PreAnalyzedUpdateProcessorTest, TestSchemaSimilarityResource, ResponseLogComponentTest, BasicFunctionalityTest, DOMUtilTest, StressHdfsTest, TestStandardQParsers, TestMergePolicyConfig, DocValuesMissingTest, HdfsUnloadDistributedZkTest, ZkSolrClientTest, TestCloudManagedSchemaConcurrent, TestSolr4Spatial, TestCSVLoader, OverseerTest, AddSchemaFieldsUpdateProcessorFactoryTest, FileBasedSpellCheckerTest, TestNonDefinedSimilarityFactory, TestNRTOpen, TestManagedSchemaFieldTypeResource, SoftAutoCommitTest, CurrencyFieldXmlFileTest, TestPhraseSuggestions, TestOrdValues, OutputWriterTest, TestCloudManagedSchema, DistributedFacetPivotWhiteBoxTest, TestOmitPositions, TestCloudInspectUtil, TestCollectionAPI, CurrencyFieldOpenExchangeTest, PreAnalyzedFieldTest, TestUtils, TestExceedMaxTermLength, CoreAdminCreateDiscoverTest, TestFoldingMultitermQuery, IndexSchemaRuntimeFieldTest, TestSchemaVersionResource, FacetPivotSmallTest, ShardSplitTest, TestCollapseQParserPlugin, DocValuesTest, ChaosMonkeySafeLeaderTest] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=3DCF993F0F4631A6 -Dtests.slow=true -Dtests.locale=pt -Dtests.timezone=Atlantic/Canary -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0) [junit4] Completed in 7354.46s, 1 test, 2 errors <<< FAILURES! [...truncated 1167 lines...] BUILD FAILED C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:525: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:473: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:186: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:508: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1358: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:965: There were test failures: 448 suites, 1821 tests, 1 suite-level error, 1 error, 1433 ignored (17 assumptions) Total time: 207 minutes 20 seconds Build step 'Invoke Ant' marked build as failure [description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true) Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org