Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/661/
1 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch Error Message: Captured an uncaught exception in thread: Thread[id=28050, name=Thread-5840, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28050, name=Thread-5840, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: java.lang.NullPointerException at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044) Build Log: [...truncated 12106 lines...] [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest [junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/init-core-data-001 [junit4] 2> 1204771 T27685 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false) [junit4] 2> 1204771 T27685 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: / [junit4] 2> 1204776 T27685 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 1204776 T27685 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1204777 T27686 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 1204877 T27685 oasc.ZkTestServer.run start zk server on port:63966 [junit4] 2> 1204878 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1204879 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1204882 T27692 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b69ea46 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1204882 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1204882 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1204882 T27685 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 1204884 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1204885 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1204885 T27694 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3661390e name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1204886 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1204886 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1204886 T27685 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 1204887 T27685 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 1204888 T27685 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 1204889 T27685 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 1204890 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1204891 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1204893 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 1204893 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 1204995 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1204996 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1204998 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1204998 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 1205000 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1205001 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 1205003 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1205003 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 1205005 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1205006 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1205007 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1205008 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1205010 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1205010 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1205012 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1205013 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1205014 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1205015 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 1205017 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1205017 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1205019 T27696 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41e8ba68 name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1205019 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1205019 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> Using old style solr.xml [junit4] 2> 1205021 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1205021 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1205022 T27698 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f3ce7f0 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1205023 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1205023 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1205023 T27685 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 1205024 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1205025 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1205026 T27700 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67c9879b name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1205026 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1205026 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1205028 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml [junit4] 2> 1205029 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml [junit4] 2> 1205031 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml [junit4] 2> 1205032 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml [junit4] 2> 1205134 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1205134 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1205136 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt [junit4] 2> 1205137 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt [junit4] 2> 1205138 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt [junit4] 2> 1205139 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt [junit4] 2> 1205140 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml [junit4] 2> 1205141 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml [junit4] 2> 1205142 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json [junit4] 2> 1205143 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json [junit4] 2> 1205144 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt [junit4] 2> 1205145 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt [junit4] 2> 1205146 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt [junit4] 2> 1205147 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt [junit4] 2> 1205148 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt [junit4] 2> 1205149 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt [junit4] 2> 1205150 T27685 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml [junit4] 2> 1205151 T27685 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml [junit4] 2> 1206445 T27685 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1206449 T27685 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 1206454 T27685 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:63972 [junit4] 2> 1206456 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1206456 T27685 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1206457 T27685 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-002 [junit4] 2> 1206457 T27685 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-002/' [junit4] 2> 1206488 T27685 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-002/solr.xml [junit4] 2> 1206573 T27685 oasc.CoreContainer.<init> New CoreContainer 480716668 [junit4] 2> 1206573 T27685 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-002/] [junit4] 2> 1206575 T27685 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000 [junit4] 2> 1206575 T27685 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null [junit4] 2> 1206575 T27685 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1206576 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1206576 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1206576 T27685 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1206577 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1206577 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1206578 T27685 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1206578 T27685 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1206581 T27685 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false [junit4] 2> 1206583 T27685 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1206583 T27685 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1206584 T27685 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1206584 T27685 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63966/solr [junit4] 2> 1206584 T27685 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1206585 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1206586 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1206587 T27711 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@181b9f03 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1206588 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1206589 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1206590 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1206591 T27713 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63a586f5 name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1206592 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1206593 T27685 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 1206595 T27685 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 1206597 T27685 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 1206599 T27685 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 1206601 T27685 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 1206603 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 1206604 T27685 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63972_ [junit4] 2> 1206605 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63972_ [junit4] 2> 1206606 T27685 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 1206607 T27685 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 1206609 T27685 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1206610 T27685 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63972_ [junit4] 2> 1206611 T27685 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 1206612 T27685 oasc.Overseer.start Overseer (id=92702442030432262-127.0.0.1:63972_-n_0000000000) starting [junit4] 2> 1206614 T27685 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 1206619 T27685 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1206620 T27715 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 1206621 T27685 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 1206623 T27685 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 1206624 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1206626 T27714 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 1206630 T27685 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3 [junit4] 2> 1206630 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1206635 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1206635 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1206637 T27719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41205c8b name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1206637 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1206637 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1206638 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1206640 T27685 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1207706 T27685 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 1207707 T27685 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1207710 T27685 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 1207712 T27685 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:63976 [junit4] 2> 1207714 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1207714 T27685 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1207715 T27685 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003 [junit4] 2> 1207715 T27685 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/' [junit4] 2> 1207746 T27685 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solr.xml [junit4] 2> 1207804 T27685 oasc.CoreContainer.<init> New CoreContainer 1821520330 [junit4] 2> 1207804 T27685 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/] [junit4] 2> 1207805 T27685 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000 [junit4] 2> 1207805 T27685 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null [junit4] 2> 1207805 T27685 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1207805 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1207806 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1207806 T27685 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1207806 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1207806 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1207807 T27685 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1207807 T27685 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1207809 T27685 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false [junit4] 2> 1207810 T27685 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1207810 T27685 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1207811 T27685 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1207811 T27685 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63966/solr [junit4] 2> 1207811 T27685 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1207811 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1207812 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1207813 T27730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d5684a6 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1207814 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1207815 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1207816 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1207817 T27732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a0a9be name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1207817 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1207820 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1208822 T27685 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63976_ [junit4] 2> 1208823 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63976_ [junit4] 2> 1208827 T27685 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1208832 T27685 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3 [junit4] 2> 1208832 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1210182 T27685 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 1210184 T27685 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1210188 T27685 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 1210189 T27685 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:63979 [junit4] 2> 1210191 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1210192 T27685 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1210192 T27685 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004 [junit4] 2> 1210192 T27685 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/' [junit4] 2> 1210222 T27685 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solr.xml [junit4] 2> 1210279 T27685 oasc.CoreContainer.<init> New CoreContainer 1318011298 [junit4] 2> 1210280 T27685 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/] [junit4] 2> 1210281 T27685 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000 [junit4] 2> 1210281 T27685 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null [junit4] 2> 1210281 T27685 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1210281 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1210281 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1210282 T27685 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1210282 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1210282 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1210282 T27685 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1210283 T27685 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1210284 T27685 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false [junit4] 2> 1210286 T27685 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1210286 T27685 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1210286 T27685 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1210287 T27685 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63966/solr [junit4] 2> 1210287 T27685 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1210287 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1210288 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1210290 T27747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e86c09a name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1210291 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1210292 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1210294 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1210295 T27749 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22acd0e4 name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1210295 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1210299 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1211302 T27685 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63979_ [junit4] 2> 1211303 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63979_ [junit4] 2> 1211306 T27685 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1211311 T27685 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3 [junit4] 2> 1211311 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1212478 T27685 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 1212478 T27685 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1212482 T27685 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 1212483 T27685 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:63982 [junit4] 2> 1212485 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1212486 T27685 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1212486 T27685 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005 [junit4] 2> 1212528 T27685 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/' [junit4] 2> 1212559 T27685 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solr.xml [junit4] 2> 1212615 T27685 oasc.CoreContainer.<init> New CoreContainer 1213264595 [junit4] 2> 1212616 T27685 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/] [junit4] 2> 1212617 T27685 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000 [junit4] 2> 1212617 T27685 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null [junit4] 2> 1212617 T27685 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1212617 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1212617 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1212618 T27685 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1212618 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1212618 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1212618 T27685 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1212619 T27685 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1212620 T27685 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false [junit4] 2> 1212622 T27685 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1212622 T27685 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1212622 T27685 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1212623 T27685 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63966/solr [junit4] 2> 1212623 T27685 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1212623 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1212624 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1212625 T27762 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@439a3bd0 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1212626 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1212626 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1212628 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1212628 T27764 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ec3410d name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1212629 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1212632 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1213635 T27685 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63982_ [junit4] 2> 1213636 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63982_ [junit4] 2> 1213639 T27685 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1213643 T27685 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3 [junit4] 2> 1213643 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1214950 T27685 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4 [junit4] 2> 1214950 T27685 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1214954 T27685 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 1214955 T27685 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:63988 [junit4] 2> 1214958 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1214958 T27685 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1214958 T27685 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006 [junit4] 2> 1214958 T27685 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/' [junit4] 2> 1214991 T27685 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solr.xml [junit4] 2> 1215051 T27685 oasc.CoreContainer.<init> New CoreContainer 1019796720 [junit4] 2> 1215052 T27685 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/] [junit4] 2> 1215053 T27685 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000 [junit4] 2> 1215053 T27685 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null [junit4] 2> 1215053 T27685 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1215053 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1215054 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1215054 T27685 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1215054 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1215054 T27685 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1215055 T27685 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1215055 T27685 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1215057 T27685 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false [junit4] 2> 1215058 T27685 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1215059 T27685 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1215059 T27685 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1215059 T27685 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63966/solr [junit4] 2> 1215059 T27685 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1215060 T27685 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1215060 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1215061 T27777 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e421349 name:ZooKeeperConnection Watcher:127.0.0.1:63966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1215062 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1215063 T27685 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1215064 T27685 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1215065 T27779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75ae54ac name:ZooKeeperConnection Watcher:127.0.0.1:63966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1215065 T27685 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1215069 T27685 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1216071 T27685 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63988_ [junit4] 2> 1216072 T27685 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63988_ [junit4] 2> 1216075 T27685 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1216079 T27685 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3 [junit4] 2> 1216080 T27685 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1216200 T27723 oasha.CollectionsHandler.handleCreateAction Creating Collection : action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&version=2&name=solrj_collection&router.field=myOwnField&replicationFactor=2 [junit4] 2> 1216202 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216202 T27715 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{ [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"solrj_collection", [junit4] 2> "replicationFactor":"2", [junit4] 2> "collection.configName":"conf1", [junit4] 2> "numShards":"2", [junit4] 2> "router.field":"myOwnField"} [junit4] 2> 1216204 T27783 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , { [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"solrj_collection", [junit4] 2> "replicationFactor":"2", [junit4] 2> "collection.configName":"conf1", [junit4] 2> "numShards":"2", [junit4] 2> "router.field":"myOwnField"} [junit4] 2> 1216205 T27783 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection [junit4] 2> 1216205 T27783 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection [junit4] 2> 1216207 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216209 T27714 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection [junit4] 2> 1216209 T27714 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2] [junit4] 2> 1216209 T27714 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1 [junit4] 2> 1216211 T27734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216211 T27735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216211 T27765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216211 T27750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216211 T27733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216211 T27780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216307 T27783 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2 [junit4] 2> 1216308 T27783 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:63988_ [junit4] 2> 1216309 T27783 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:63976_ [junit4] 2> 1216311 T27783 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:63979_ [junit4] 2> 1216314 T27783 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:63982_ [junit4] 2> 1216432 T27743 oasha.CoreAdminHandler.handleCreateAction core create command action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&version=2&name=solrj_collection_shard2_replica1&collection=solrj_collection&qt=/admin/cores&shard=shard2 [junit4] 2> 1216434 T27743 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection [junit4] 2> 1216435 T27743 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1216435 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216438 T27724 oasha.CoreAdminHandler.handleCreateAction core create command action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&version=2&name=solrj_collection_shard1_replica2&collection=solrj_collection&qt=/admin/cores&shard=shard1 [junit4] 2> 1216438 T27769 oasha.CoreAdminHandler.handleCreateAction core create command action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&version=2&name=solrj_collection_shard1_replica1&collection=solrj_collection&qt=/admin/cores&shard=shard1 [junit4] 2> 1216438 T27714 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "base_url":"https://127.0.0.1:63979", [junit4] 2> "operation":"state", [junit4] 2> "core":"solrj_collection_shard2_replica1", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "collection":"solrj_collection", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard2", [junit4] 2> "node_name":"127.0.0.1:63979_"} [junit4] 2> 1216441 T27724 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection [junit4] 2> 1216442 T27724 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1216442 T27754 oasha.CoreAdminHandler.handleCreateAction core create command action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&version=2&name=solrj_collection_shard2_replica2&collection=solrj_collection&qt=/admin/cores&shard=shard2 [junit4] 2> 1216442 T27769 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection [junit4] 2> 1216442 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216443 T27769 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1216444 T27714 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "base_url":"https://127.0.0.1:63976", [junit4] 2> "operation":"state", [junit4] 2> "core":"solrj_collection_shard1_replica2", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "collection":"solrj_collection", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard1", [junit4] 2> "node_name":"127.0.0.1:63976_"} [junit4] 2> 1216445 T27754 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection [junit4] 2> 1216446 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216446 T27714 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "base_url":"https://127.0.0.1:63988", [junit4] 2> "operation":"state", [junit4] 2> "core":"solrj_collection_shard1_replica1", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "collection":"solrj_collection", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard1", [junit4] 2> "node_name":"127.0.0.1:63988_"} [junit4] 2> 1216446 T27754 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1216447 T27714 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "base_url":"https://127.0.0.1:63982", [junit4] 2> "operation":"state", [junit4] 2> "core":"solrj_collection_shard2_replica2", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "collection":"solrj_collection", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard2", [junit4] 2> "node_name":"127.0.0.1:63982_"} [junit4] 2> 1216448 T27735 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1216449 T27735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216449 T27733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216449 T27734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216449 T27750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216449 T27765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1216449 T27780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1217436 T27743 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1 [junit4] 2> 1217437 T27743 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection [junit4] 2> 1217437 T27743 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1217438 T27743 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection [junit4] 2> 1217438 T27743 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1217438 T27743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/' [junit4] 2> 1217444 T27724 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2 [junit4] 2> 1217444 T27724 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection [junit4] 2> 1217444 T27769 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1 [junit4] 2> 1217445 T27769 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection [junit4] 2> 1217445 T27724 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1217445 T27724 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection [junit4] 2> 1217445 T27769 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1217445 T27769 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection [junit4] 2> 1217446 T27724 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1217446 T27724 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/' [junit4] 2> 1217446 T27769 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1217446 T27769 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/' [junit4] 2> 1217446 T27754 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2 [junit4] 2> 1217447 T27754 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection [junit4] 2> 1217448 T27754 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1217448 T27754 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection [junit4] 2> 1217449 T27754 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1217450 T27754 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/' [junit4] 2> 1217538 T27769 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1217539 T27743 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1217557 T27724 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1217613 T27754 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1217627 T27743 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1217633 T27769 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1217645 T27724 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1217653 T27754 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1217728 T27743 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1217734 T27769 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1217742 T27743 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test [junit4] 2> 1217746 T27724 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1217747 T27769 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test [junit4] 2> 1217754 T27754 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1217756 T27724 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test [junit4] 2> 1217807 T27754 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test [junit4] 2> 1218411 T27724 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1218426 T27724 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1218438 T27724 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1218440 T27743 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1218444 T27754 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1218448 T27743 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1218450 T27724 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218451 T27754 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1218451 T27743 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1218455 T27754 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1218455 T27724 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218460 T27724 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218461 T27724 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218464 T27724 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218464 T27724 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218465 T27743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218465 T27724 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218466 T27724 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218466 T27724 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection [junit4] 2> 1218466 T27724 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1218467 T27724 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/data/ [junit4] 2> 1218467 T27724 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3eb6814a [junit4] 2> 1218469 T27754 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218470 T27743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218470 T27724 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/data [junit4] 2> 1218472 T27724 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/data/index/ [junit4] 2> 1218472 T27724 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index... [junit4] 2> 1218473 T27769 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1218473 T27724 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-003/solrj_collection_shard1_replica2/data/index [junit4] 2> 1218474 T27724 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=97.9267578125, floorSegmentMB=1.2958984375, forceMergeDeletesPctAllowed=11.900176490131441, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0 [junit4] 2> 1218474 T27754 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218475 T27724 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-7c885a91)),segFN=segments_1,generation=1} [junit4] 2> 1218475 T27743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218475 T27724 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1218476 T27743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218477 T27743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218477 T27743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218478 T27743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218478 T27743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218479 T27743 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection [junit4] 2> 1218479 T27743 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1218479 T27743 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/data/ [junit4] 2> 1218480 T27769 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1218480 T27754 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218480 T27743 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3eb6814a [junit4] 2> 1218481 T27724 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1218481 T27754 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218482 T27724 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1218482 T27754 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218483 T27724 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1218483 T27769 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1218483 T27754 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218484 T27743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/data [junit4] 2> 1218483 T27724 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1218485 T27754 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218485 T27743 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/data/index/ [junit4] 2> 1218485 T27724 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1218486 T27743 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index... [junit4] 2> 1218486 T27754 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218487 T27743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-004/solrj_collection_shard2_replica1/data/index [junit4] 2> 1218486 T27724 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1218488 T27743 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=97.9267578125, floorSegmentMB=1.2958984375, forceMergeDeletesPctAllowed=11.900176490131441, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0 [junit4] 2> 1218487 T27754 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection [junit4] 2> 1218488 T27724 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218489 T27743 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-68b86762)),segFN=segments_1,generation=1} [junit4] 2> 1218489 T27754 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1218490 T27743 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1218489 T27724 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218490 T27754 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/data/ [junit4] 2> 1218491 T27724 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1218491 T27754 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3eb6814a [junit4] 2> 1218492 T27724 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218493 T27724 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218494 T27724 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218494 T27724 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1218495 T27754 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/data [junit4] 2> 1218495 T27769 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218495 T27743 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1218496 T27754 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/data/index/ [junit4] 2> 1218495 T27724 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1218496 T27754 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index... [junit4] 2> 1218496 T27743 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1218497 T27724 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1218498 T27743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1218498 T27754 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-005/solrj_collection_shard2_replica2/data/index [junit4] 2> 1218498 T27743 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1218499 T27754 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=97.9267578125, floorSegmentMB=1.2958984375, forceMergeDeletesPctAllowed=11.900176490131441, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0 [junit4] 2> 1218498 T27724 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1218499 T27743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1218500 T27724 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1218501 T27754 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-5c32ed3a)),segFN=segments_1,generation=1} [junit4] 2> 1218500 T27743 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1218501 T27769 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1218502 T27743 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218501 T27754 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1218501 T27724 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1218502 T27743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218503 T27724 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1218503 T27743 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1218504 T27724 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1218504 T27743 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218505 T27743 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218506 T27743 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218506 T27743 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1218507 T27743 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1218507 T27743 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1218507 T27769 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218508 T27743 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1218508 T27754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1218509 T27769 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218509 T27754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1218509 T27743 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1218510 T27754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1218509 T27769 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218510 T27754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1218510 T27743 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1218511 T27754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1218511 T27743 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1218510 T27769 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1218512 T27743 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1218512 T27754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1218513 T27769 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1218513 T27754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218513 T27769 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1218514 T27754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218514 T27769 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection [junit4] 2> 1218514 T27754 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1218515 T27769 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1218515 T27769 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/data/ [junit4] 2> 1218515 T27754 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218516 T27769 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3eb6814a [junit4] 2> 1218516 T27754 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218517 T27754 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1218518 T27754 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1218518 T27754 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1218519 T27754 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1218519 T27754 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1218520 T27754 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1218520 T27754 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1218521 T27769 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/data [junit4] 2> 1218521 T27754 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1218522 T27754 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1218523 T27769 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/data/index/ [junit4] 2> 1218523 T27769 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index... [junit4] 2> 1218524 T27769 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/solrj_collection_shard1_replica1/data/index [junit4] 2> 1218525 T27769 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=97.9267578125, floorSegmentMB=1.2958984375, forceMergeDeletesPctAllowed=11.900176490131441, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0 [junit4] 2> 1218527 T27769 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-21a88cd6)),segFN=segments_1,generation=1} [junit4] 2> 1218527 T27769 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1218533 T27769 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1218533 T27724 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218533 T27754 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218533 T27769 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1218533 T27743 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218534 T27769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1218535 T27769 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1218535 T27769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1218536 T27769 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1218536 T27754 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218536 T27724 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218537 T27743 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1218537 T27769 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1218538 T27769 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-t [...truncated too long message...] home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data;done=false>>] [junit4] 2> 1369735 T27685 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data [junit4] 2> 1369735 T27685 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data/index;done=false>>] [junit4] 2> 1369736 T27685 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-901F7D855C61C262-001/tempDir-006/addReplicaColl_shard2_replica3/data/index [junit4] 2> 1369737 T27685 oasc.Overseer.close Overseer (id=92702442030432271-127.0.0.1:63988_-n_0000000004) closing [junit4] 2> 1369738 T29287 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:63988_ [junit4] 2> 1369751 T27976 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 1369756 T27685 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null} [junit4] 2> 1370474 T27685 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 63972 [junit4] 2> 1370475 T27685 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch [junit4] 2> 1370477 T27685 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63966 63966 [junit4] 2> 1370659 T27969 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63966 63966 [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=901F7D855C61C262 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=pt_BR -Dtests.timezone=Pacific/Norfolk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 166s J3 | CollectionsAPIDistributedZkTest.testDistribSearch <<< [junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28050, name=Thread-5840, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28048, name=Thread-5838, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28049, name=Thread-5839, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28053, name=Thread-5843, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28051, name=Thread-5841, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28052, name=Thread-5842, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: java.lang.NullPointerException [junit4] > at __randomizedtesting.SeedInfo.seed([901F7D855C61C262]:0) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1044) [junit4] 2> 1370705 T27685 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=BlockTreeOrds(blocksize=128), intDefault=BlockTreeOrds(blocksize=128), range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval), other_tl1=BlockTreeOrds(blocksize=128), a_i1=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval), text=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), id=FST50}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=DefaultSimilarity, locale=pt_BR, timezone=Pacific/Norfolk [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=211097640,total=522190848 [junit4] 2> NOTE: All tests run in this JVM: [StatelessScriptUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, TestSearcherReuse, TestMergePolicyConfig, DocumentAnalysisRequestHandlerTest, SpellPossibilityIteratorTest, TestFastLRUCache, AliasIntegrationTest, SolrInfoMBeanTest, TestSearchPerf, HdfsWriteToMultipleCollectionsTest, TestLMJelinekMercerSimilarityFactory, LoggingHandlerTest, CollectionsAPIAsyncDistributedZkTest, TimeZoneUtilsTest, TestPhraseSuggestions, TestPHPSerializedResponseWriter, DOMUtilTest, TestCSVLoader, TestNonNRTOpen, SOLR749Test, TestIndexSearcher, TestOverriddenPrefixQueryForCustomFieldType, DistributedDebugComponentTest, UniqFieldsUpdateProcessorFactoryTest, TestMiniSolrCloudCluster, TestDistributedMissingSort, TestReplicaProperties, CoreContainerCoreInitFailuresTest, TestInfoStreamLogging, FileBasedSpellCheckerTest, TestDistributedGrouping, TestLRUCache, DistributedFacetPivotLongTailTest, ShardRoutingTest, TestAnalyzeInfixSuggestions, TestConfigSets, RequestHandlersTest, CursorPagingTest, ResponseLogComponentTest, TermVectorComponentDistributedTest, EchoParamsTest, TestModifyConfFiles, OverseerStatusTest, FieldMutatingUpdateProcessorTest, UnloadDistributedZkTest, ZkCLITest, TestDocSet, DocExpirationUpdateProcessorFactoryTest, AtomicUpdatesTest, OutputWriterTest, TestSort, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest] [junit4] Completed on J3 in 170.41s, 1 test, 1 error <<< FAILURES! [...truncated 850 lines...] BUILD FAILED /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:532: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:473: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1359: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:966: There were test failures: 438 suites, 1800 tests, 1 error, 54 ignored (9 assumptions) Total time: 224 minutes 20 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #654 Archived 5 artifacts Archive block size is 32768 Received 0 blocks and 419876900 bytes Compression is 0.0% Took 1 min 15 sec Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org