Unfortunately, the reference impl is creating quite a bit of noise in Hoss’ rollups. That said, I have a mail filter for test failures that puts the reference impl tests in a different mail folder and my sense is that the regular branch is getting an increasing number of failures.
If I have the energy, I’ll try to collect some of them. Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 210 failures Week: 1 had 112 failures Week: 2 had 110 failures Week: 3 had 150 failures ********Failures in Hoss' reports in every one of the last 4 rollups. There were 390 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd Failures in the last 4 reports.. Report Pct runs fails test 0123 0.5 1745 10 CachingDirectoryFactoryTest.stressTest 0123 100.0 159 159 CollectionsAPIAsyncDistributedZkTest.classMethod 0123 2.9 1759 49 CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition 0123 3.0 1744 50 CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection 0123 3.0 1772 53 CollectionsAPIDistributedZkTest.testNoConfigSetExist 0123 100.0 209 209 JsonRequestApiHeatmapFacetingTest.classMethod 0123 100.0 209 209 JsonRequestApiTest.classMethod 0123 0.4 1708 7 ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin 0123 3.1 1737 32 MoveReplicaTest.test 0123 1.9 1366 23 TestCircuitBreaker.testResponseWithCBTiming 0123 8.5 1275 94 TestContainerPlugin.testApi 0123 2.5 1368 36 TestDistributedStatsComponentCardinality.test 0123 0.3 1069 8 TestHdfsCloudBackupRestore.test 0123 0.2 1277 9 TestLocalFSCloudBackupRestore.test 0123 1.9 1313 17 TestPackages.testPluginLoading 0123 1.7 1575 20 TestPullReplicaErrorHandling.testCantConnectToLeader 0123 1.9 1575 31 TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper 0123 100.0 209 209 UsingSolrJRefGuideExamplesTest.classMethod 0123 100.0 192 192 ZkConfigFilesTest.classMethod ********************************************
DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen TestICUNormalizer2CharFilter.testRandomStrings TestICUTokenizerCJK TestImpersonationWithHadoopAuth.testForwarding TestLTRReRankingPipeline.testDifferentTopN TestRandomChains DO NOT ANNOTATE LIST CdcrBidirectionalTest.testBiDir IndexSizeTriggerTest.testMergeIntegration IndexSizeTriggerTest.testMixedBounds IndexSizeTriggerTest.testSplitIntegration IndexSizeTriggerTest.testTrigger InfixSuggestersTest.testShutdownDuringBuild ShardSplitTest.test ShardSplitTest.testSplitMixedReplicaTypes ShardSplitTest.testSplitWithChaosMonkey Test2BPostings.test TestLatLonShapeQueries.testRandomBig TestPackedInts.testPackedLongValues TestRandomChains.testRandomChainsWithLargeStrings TestTriggerIntegration.testSearchRate SuppressWarnings count: last week: 4,481, this week: 4,487, delta 6 *************** Files with increased @SuppressWarnings annotations: Suppress count increase in: lucene/analysis/common/src/java/org/tartarus/snowball/ext/YiddishStemmer.java. Was: null, now: 1 Suppress count increase in: lucene/core/src/test/org/apache/lucene/util/hnsw/TestHnsw.java. Was: null, now: 1 Suppress count increase in: lucene/grouping/src/test/org/apache/lucene/search/grouping/TestAllGroupHeadsCollector.java. Was: null, now: 1 Suppress count increase in: lucene/grouping/src/test/org/apache/lucene/search/grouping/TestDistinctValuesCollector.java. Was: null, now: 5 Suppress count increase in: lucene/grouping/src/test/org/apache/lucene/search/grouping/TestTopGroups.java. Was: null, now: 2 Suppress count increase in: lucene/misc/src/java/org/apache/lucene/misc/index/MultiPassIndexSplitter.java. Was: null, now: 1 Suppress count increase in: lucene/misc/src/java/org/apache/lucene/misc/util/fst/ListOfOutputs.java. Was: null, now: 1 Suppress count increase in: lucene/misc/src/java/org/apache/lucene/misc/util/fst/UpToTwoPositiveIntOutputs.java. Was: null, now: 1 Suppress count increase in: lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexAndTaxonomyReplicationClient.java. Was: null, now: 2 Suppress count increase in: lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexAndTaxonomyRevision.java. Was: null, now: 1 Suppress count increase in: lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexReplicationClient.java. Was: null, now: 2 Suppress count increase in: lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexRevision.java. Was: null, now: 2 Suppress count increase in: lucene/spatial-extras/src/test/org/apache/lucene/spatial/prefix/TestRandomSpatialOpFuzzyPrefixTree.java. Was: null, now: 1 Suppress count increase in: solr/contrib/ltr/src/java/org/apache/solr/ltr/response/transform/LTRInterleavingTransformerFactory.java. Was: null, now: 2 Suppress count increase in: solr/core/src/java/org/apache/solr/api/ContainerPluginsRegistry.java. Was: 4, now: 6 Suppress count increase in: solr/core/src/test/org/apache/solr/metrics/MetricsConfigTest.java. Was: 0, now: 1 Suppress count increase in: solr/core/src/test/org/apache/solr/search/SolrIndexSearcherTest.java. Was: 0, now: 1 *************** Files with decreased @SuppressWarnings annotations: Suppress count decrease in: solr/core/src/test/org/apache/solr/handler/TestContainerPlugin.java. Was: 2, now: 1 Suppress count decrease in: solr/solrj/src/java/org/apache/solr/client/solrj/routing/RequestReplicaListTransformerGenerator.java. Was: 1, now: 0 Processing file (History bit 3): HOSS-2020-11-23.csv Processing file (History bit 2): HOSS-2020-11-09.csv Processing file (History bit 1): HOSS-2020-11-02.csv Processing file (History bit 0): HOSS-2020-10-26.csv Number of AwaitsFix: 31 Number of BadApples: 3 **Annotated tests that didn't fail in the last 4 weeks. **Tests removed from the next two lists because they were specified in 'doNotEnable' in the properties file MoveReplicaHDFSTest.testNormalFailedMove **Annotations can be removed from the following tests because they haven't failed in the last 4 rollups. **Methods: 0 Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 210 failures Week: 1 had 112 failures Week: 2 had 110 failures Week: 3 had 150 failures ********Failures in Hoss' reports in every one of the last 4 rollups. There were 390 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd Failures in the last 4 reports.. Report Pct runs fails test 0123 0.5 1745 10 CachingDirectoryFactoryTest.stressTest 0123 100.0 159 159 CollectionsAPIAsyncDistributedZkTest.classMethod 0123 2.9 1759 49 CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition 0123 3.0 1744 50 CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection 0123 3.0 1772 53 CollectionsAPIDistributedZkTest.testNoConfigSetExist 0123 100.0 209 209 JsonRequestApiHeatmapFacetingTest.classMethod 0123 100.0 209 209 JsonRequestApiTest.classMethod 0123 0.4 1708 7 ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin 0123 3.1 1737 32 MoveReplicaTest.test 0123 1.9 1366 23 TestCircuitBreaker.testResponseWithCBTiming 0123 8.5 1275 94 TestContainerPlugin.testApi 0123 2.5 1368 36 TestDistributedStatsComponentCardinality.test 0123 0.3 1069 8 TestHdfsCloudBackupRestore.test 0123 0.2 1277 9 TestLocalFSCloudBackupRestore.test 0123 1.9 1313 17 TestPackages.testPluginLoading 0123 1.7 1575 20 TestPullReplicaErrorHandling.testCantConnectToLeader 0123 1.9 1575 31 TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper 0123 100.0 209 209 UsingSolrJRefGuideExamplesTest.classMethod 0123 100.0 192 192 ZkConfigFilesTest.classMethod ******************************************** Failures over the last 4 weeks, but not every week. Ordered most-recent first: Report Pct runs fails test 012 2.9 1409 39 ClusterStateUpdateTest.testCoreRegistration 012 2.9 1390 37 CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls 012 100.0 49 49 CustomHighlightComponentTest.classMethod 012 0.2 1370 3 CustomHighlightComponentTest.test 012 3.1 1397 37 ShardSplitTest.testSplitShardWithRule 012 19.9 1302 245 TestPullReplicaErrorHandling.testCantConnectToPullReplica 012 2.1 1387 44 TestSchemalessBufferedUpdates.test 012 100.0 14 14 TestSolrConfigHandlerConcurrent.classMethod 01 3 0.2 1012 7 HttpPartitionOnCommitTest.test 01 3 1.7 1035 15 MultiThreadedOCPTest.test 01 0.2 740 2 ChaosMonkeySafeLeaderWithPullReplicasTest.test 01 14.4 290 57 ClusterEventProducerTest.testEvents 01 0.4 1027 3 DistributedExpandComponentTest.test 01 0.2 743 3 DistributedFacetPivotLongTailTest.test 01 0.2 1029 2 DistributedQueryComponentCustomSortTest.test 01 100.0 37 37 DocValuesNotIndexedTest.classMethod 01 0.2 746 2 MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected 01 0.4 482 2 OverseerTest.testShardLeaderChange 01 1.0 745 5 RollingRestartTest.test 01 100.0 3 2 SharedFSAutoReplicaFailoverTest.test 01 2.9 1039 18 SplitShardTest.testSplitFuzz 01 0.2 737 2 TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess 01 0.4 972 4 TestPullReplicaErrorHandling.testCloseHooksDeletedOnReconnect 01 0.2 776 44 TestRandomFaceting.testRandomFaceting 01 0.2 738 3 TestReplicaProperties.test 01 0.2 737 2 TestSolrConfigHandlerCloud.test 0 23 100.0 37 37 HttpSolrCallGetCoreTest.classMethod 0 23 2.9 1205 29 TestCloudPivotFacet.test 0 23 2.9 1201 42 TestCloudSchemaless.test 0 23 2.9 1262 19 ZkShardTermsTest.testParticipationOfReplicas 0 2 2.9 935 18 CloudHttp2SolrClientTest.testParallelUpdateQTime 0 2 0.2 675 3 CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat 0 2 2.9 935 18 ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection 0 2 100.0 35 35 JsonQueryRequestFacetingIntegrationTest.classMethod 0 2 0.2 676 2 LeaderVoteWaitTimeoutTest.basicTest 0 2 11.2 259 37 ShardRoutingTest.doAtomicUpdate 0 2 10.1 259 33 ShardRoutingTest.doHashingTest 0 2 9.5 259 32 ShardRoutingTest.doTestNumRequests 0 2 2.9 928 20 TestDynamicFieldNamesIndexCorrectly.test 0 2 0.5 322 2 TestRequestRateLimiter.testConcurrentQueries 0 2 100.0 35 35 V2ApiIntegrationTest.classMethod 0 3 0.2 928 2 AnalyticsMergeStrategyTest.test 0 3 0.2 676 2 AssignBackwardCompatibilityTest.test 0 3 0.2 676 2 BasicDistributedZkTest.test 0 3 2.9 950 18 CloudHttp2SolrClientTest.testNonRetryableRequests 0 3 2.9 950 18 CloudHttp2SolrClientTest.testVersionsAreReturned 0 3 9.4 241 19 CollectionsAPIDistClusterPerZkTest.testCollectionReload 0 3 0.5 365 2 ComputePlanActionTest.testNodeAdded 0 3 2.9 913 18 DeleteReplicaTest.deleteReplicaByCount 0 3 0.2 686 2 HealthCheckHandlerTest.testHealthCheckHandler 0 3 0.5 681 5 HttpPartitionTest.test 0 3 0.2 690 2 MoveReplicaTest.testFailedMove 0 3 2.9 940 18 OverseerModifyCollectionTest.testModifyColl 0 3 2.9 916 18 RecoveryZkTest.test 0 3 0.5 360 2 SearchRateTriggerTest.testWaitForElapsed 0 3 5.9 39 2 ShardSplitTest.testSplitWithChaosMonkey 0 3 100.0 6 6 TestExclusionRuleCollectionAccess.classMethod 0 3 100.0 2 2 TestHdfsCloudBackupRestore.classMethod 0 3 0.2 976 9 TestRandomChains.testRandomChainsWithLargeStrings 0 3 1.5 691 16 TestReRankQParserPlugin.testMinExactCount 0 3 3.1 859 19 TestShortCircuitedRequests.test 0 3 2.9 861 18 TestSystemCollAutoCreate.testAutoCreate 0 100.0 1 1 AliasIntegrationTest.classMethod 0 100.0 34 34 AtomicUpdateRemovalJavabinTest.classMethod 0 4.0 226 9 AutoscalingHistoryHandlerTest.testHistory 0 2.9 581 17 BasicAuthOnSingleNodeTest.basicTest 0 0.2 407 1 BasicDistributedZk2Test.test 0 0.5 403 2 ChaosMonkeyNothingIsSafeWithPullReplicasTest.test 0 100.0 17 17 CloudHttp2SolrClientBadInputTest.classMethod 0 2.9 588 17 CloudHttp2SolrClientTest.testInitializationWithSolrUrls 0 100.0 17 17 CloudSolrClientBadInputTest.classMethod 0 0.2 413 1 CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale 0 4.5 380 17 CollectionStateZnodeTest.testZkNodeLocation 0 9.4 180 17 CollectionsAPIDistClusterPerZkTest.addReplicaTest 0 9.4 180 17 CollectionsAPIDistClusterPerZkTest.testCreateNodeSet 0 9.4 180 17 CollectionsAPIDistClusterPerZkTest.testSpecificConfigsets 0 2.9 586 17 CollectionsAPISolrJTest.testAddAndDeleteReplica 0 2.9 586 17 CollectionsAPISolrJTest.testCloudInfoInCoreStatus 0 2.9 586 17 CollectionsAPISolrJTest.testCollectionProp 0 2.9 586 17 CollectionsAPISolrJTest.testCreateAndDeleteCollection 0 2.9 586 17 CollectionsAPISolrJTest.testCreateWithDefaultConfigSet 0 9.4 180 17 ConfigSetsAPITest.testConfigSetDeleteWhenInUse 0 3.3 572 19 DeleteInactiveReplicaTest.deleteInactiveReplicaTest 0 2.9 582 17 DeleteLastCustomShardedReplicaTest.test 0 2.9 578 17 DeleteReplicaTest.deleteLiveReplicaTest 0 2.9 578 17 DeleteReplicaTest.deleteReplicaOnIndexing 0 3.0 574 17 DeleteStatusTest.testAsyncIdsMayBeDeleted 0 3.0 574 17 DeleteStatusTest.testDeleteStatusFlush 0 3.0 574 17 DeleteStatusTest.testProcessAndWaitDeletesAsyncIds 0 100.0 34 34 DirectJsonQueryRequestFacetingIntegrationTest.classMethod 0 100.0 17 17 DirectSolrConnectionTest.classMethod 0 100.0 16 16 DirectUpdateHandlerTest.classMethod 0 100.0 51 51 DirectoryFactoryTest.classMethod 0 2.9 581 17 DirectoryFactoryTest.testGetDataHomeByteBuffersDirectory 0 2.9 581 17 DirectoryFactoryTest.testGetDataHomeRAMDirectory 0 0.2 403 1 DistributedFacetSimpleRefinementLongTailTest.test 0 0.3 582 2 DistributedMLTComponentTest.test 0 100.0 4 4 DistributedQueryComponentOptimizationTest.classMethod 0 100.0 17 17 DistributedSuggestComponentTest.classMethod 0 0.5 379 2 DistributedUpdateProcessorTest.testVersionAdd 0 0.8 379 3 DistributedUpdateProcessorTest.testVersionDelete 0 100.0 1 1 ExtractingRequestHandlerTest.classMethod 0 0.2 588 1 ExtractingRequestHandlerTest.testArabicPDF 0 2.9 582 17 FuzzySearchTest.testTooComplex 0 7.1 14 1 HdfsBasicDistributedZk2Test.test 0 100.0 35 35 HelloWorldSolrCloudTestCase.classMethod 0 100.0 34 34 JDBCStreamTest.classMethod 0 100.0 34 34 JsonQueryRequestHeatmapFacetingTest.classMethod 0 100.0 34 34 JsonQueryRequestIntegrationTest.classMethod 0 100.0 17 17 LargeFieldTest.classMethod 0 0.2 402 1 LeaderElectionIntegrationTest.testSimpleSliceLeaderElection 0 0.5 408 2 MathExpressionTest.testZipFDistribution 0 100.0 17 17 MergeIndexesEmbeddedTest.classMethod 0 3.0 573 17 MissingSegmentRecoveryTest.testLeaderRecovery 0 100.0 27 27 NestedShardedAtomicUpdateTest.classMethod 0 4.8 582 28 NestedShardedAtomicUpdateTest.test 0 0.2 402 1 OverseerRolesTest.testDesignatedOverseerRestarts 0 100.0 17 17 PeerSyncWithIndexFingerprintCachingTest.classMethod 0 100.0 17 17 PeerSyncWithLeaderAndIndexFingerprintCachingTest.classMethod 0 100.0 17 17 PhrasesIdentificationComponentTest.classMethod 0 100.0 12 12 RecoveryZkTest.classMethod 0 0.2 402 1 ReplicationFactorTest.test 0 100.0 17 17 SampleTest.classMethod 0 3.0 573 17 SearchHandlerTest.testRequireZkConnectedDistrib 0 100.0 34 34 SelectWithEvaluatorsTest.classMethod 0 2.9 579 17 ShardRoutingCustomTest.test 0 100.0 12 12 ShardRoutingTest.classMethod 0 0.3 370 1 SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds 0 1.0 581 6 SolrJmxReporterTest.testClosedCore 0 100.0 9 9 SolrSchemalessExampleTest.classMethod 0 0.2 407 1 SpatialHeatmapFacetsTest.testClassicFacets 0 2.9 581 17 SplitShardTest.doTest 0 100.0 17 17 SuggesterFSTTest.classMethod 0 100.0 17 17 SuggesterTest.classMethod 0 0.2 554 1 TermVectorComponentDistributedTest.test 0 6.7 15 1 TestBestCompressionLucene80DocValuesFormat.testTermsEnumFixedWidth 0 6.7 15 1 TestBestCompressionLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes 0 6.7 15 1 TestBestCompressionLucene80DocValuesFormat.testTermsEnumRandomMany 0 6.7 15 1 TestBestCompressionLucene80DocValuesFormat.testTermsEnumVariableWidth 0 6.7 15 1 TestBestSpeedLucene80DocValuesFormat.testTermsEnumFixedWidth 0 6.7 15 1 TestBestSpeedLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes 0 6.7 15 1 TestBestSpeedLucene80DocValuesFormat.testTermsEnumRandomMany 0 6.7 15 1 TestBestSpeedLucene80DocValuesFormat.testTermsEnumVariableWidth 0 100.0 34 34 TestCloudDeleteByQuery.classMethod 0 0.2 565 1 TestCloudDeleteByQuery.testMalformedDBQViaCloudClient 0 100.0 34 34 TestCloudJSONFacetJoinDomain.classMethod 0 100.0 33 33 TestCloudJSONFacetSKG.classMethod 0 0.2 407 1 TestCloudRecovery2.test 0 100.0 17 17 TestClusterProperties.classMethod 0 3.0 572 17 TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete 0 10.0 170 17 TestCollectionsAPIViaSolrCloudCluster.testDeleteUnknownCollection 0 100.0 51 51 TestConfigSetsAPI.classMethod 0 2.9 582 17 TestConfigSetsAPI.testCreateErrors 0 2.9 582 17 TestConfigSetsAPI.testUpload 0 100.0 10 10 TestDeleteCollectionOnDownNodes.classMethod 0 1.1 565 6 TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes 0 100.0 16 16 TestDistribPackageStore.classMethod 0 2.9 578 17 TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue 0 0.2 402 1 TestExactStatsCache.testShardsTolerant 0 100.0 17 17 TestHighFrequencyDictionaryFactory.classMethod 0 100.0 51 51 TestLBHttpSolrClient.classMethod 0 2.9 588 17 TestLBHttpSolrClient.testReliability 0 2.9 588 17 TestLBHttpSolrClient.testSimple 0 1.0 594 6 TestLatLonPointQueries.testAllLatEqual 0 4.7 379 18 TestLocalStatsCacheCloud.testBasicStats 0 2.9 578 17 TestManagedSchemaAPI.test 0 100.0 17 17 TestManagedStopFilterFactory.classMethod 0 100.0 3 3 TestOnReconnectListenerSupport.classMethod 0 0.2 555 1 TestOnReconnectListenerSupport.test 0 0.2 402 1 TestRandomCollapseQParserPlugin.testRandomCollpaseWithSort 0 100.0 1 1 TestRandomFaceting.classMethod 0 100.0 4 4 TestRandomFlRTGCloud.classMethod 0 0.2 403 1 TestRecovery.stressLogReplay 0 100.0 17 17 TestReplicationHandlerBackup.classMethod 0 2.9 580 17 TestRequestForwarding.testMultiCollectionQuery 0 100.0 17 17 TestSchemalessBufferedUpdates.classMethod 0 100.0 3 3 TestShortCircuitedRequests.classMethod 0 0.5 204 1 TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy 0 0.2 402 1 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew 0 3.0 574 17 TestSolrConfigHandlerConcurrent.test 0 100.0 38 38 TestTolerantUpdateProcessorRandomCloud.classMethod 0 0.2 565 1 TestTolerantUpdateProcessorRandomCloud.testRandomUpdates 0 100.0 17 17 TestUseDocValuesAsStored.classMethod 0 100.0 17 17 TestUseDocValuesAsStored2.classMethod 0 0.4 228 1 TestWithCollection.testAddReplicaWithPolicy 0 3.1 228 7 TestWithCollection.testNodeAdded 0 100.0 17 17 TestZkConfigManager.classMethod 0 0.2 556 1 V2ApiIntegrationTest.testSetPropertyValidationOfCluster 123 100.0 160 160 AddReplicaTest.classMethod 123 100.0 108 108 CollectionsAPIDistributedZkTest.classMethod 123 2.1 1199 36 CollectionsAPIDistributedZkTest.testBadActionNames 123 2.1 1199 36 CollectionsAPIDistributedZkTest.testMissingNumShards 123 2.1 1199 36 CollectionsAPIDistributedZkTest.testMissingRequiredParameters 123 2.1 1199 36 CollectionsAPIDistributedZkTest.testZeroNumShards 123 100.0 175 175 ConcurrentUpdateSolrClientMultiCollectionTest.classMethod 123 100.0 16 16 DeleteStatusTest.classMethod 123 7.5 299 32 SimpleCollectionCreateDeleteTest.test 123 0.4 1166 5 TestChildDocTransformer.testAllParams 123 0.4 1166 5 TestChildDocTransformer.testParentFilter 123 0.7 1144 9 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 123 13.1 1212 166 TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes 123 28.7 1209 329 TestSynonymFilterFactory.testFormat 123 28.7 1209 329 TestSynonymFilterFactory.testSynonyms 123 28.6 1212 330 TestSysoutsLimits.OverHardLimit 123 28.6 1212 330 TestSysoutsLimits.testOverSoftLimit 123 13.1 1212 166 TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes 12 100.0 66 66 ClusterStateUpdateTest.classMethod 12 0.9 600 5 DistributedTermsComponentTest.test 12 100.0 54 54 ShardSplitTest.classMethod 12 0.4 807 3 TestAuthenticationFramework.testBasics 12 0.3 610 2 TestBulkSchemaConcurrent.test 12 0.3 609 2 TestDistributedMissingSort.test 1 3 0.2 796 2 DocValuesNotIndexedTest.testGroupingDVOnlySortFirst 1 3 0.4 827 3 StatsReloadRaceTest.testParallelReloadAndStats 1 3 0.3 610 3 TestInPlaceUpdatesDistrib.test 1 0.2 459 1 CleanupOldIndexTest.test 1 0.9 340 3 CollectionsAPIAsyncDistributedZkTest.testAsyncRequests 1 0.2 458 1 DeleteNodeTest.test 1 0.2 460 1 DistributedDebugComponentTest.testTolerantSearch 1 0.2 461 1 DocValuesNotIndexedTest.testGroupingSorting 1 5.3 19 1 HdfsTlogReplayBufferedWhileIndexingTest.test 1 0.3 293 1 LBSolrClientTest.testServerIteratorTimeAllowed 1 100.0 1 1 MetricsHistoryWithAuthIntegrationTest.classMethod 1 1.3 477 6 TestAssertingDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields 1 100.0 4 4 TestAuthenticationFramework.classMethod 1 0.2 472 1 TestCachePurging.testBackgroundPurges 1 3.3 183 6 TestDirectDocValuesFormat.testSortedFixedLengthVsStoredFields 1 100.0 1 1 TestHighlightDedupGrouping.classMethod 1 0.3 340 1 TestLBHttp2SolrClient.testSimple 1 0.2 487 1 TestLatLonDocValuesQueries.testAllLonEqual 1 2.3 487 11 TestLatLonDocValuesQueries.testRandomMedium 1 2.3 485 11 TestLatLonPointQueries.testRandomMedium 1 0.2 458 1 TestLockTree.testLocks 1 3.3 183 6 TestLucene70DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields 1 0.2 472 1 TestLucene80DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields 1 1.9 314 6 TestOrdinalMap.testOneSegmentWithAllValues 1 0.2 472 1 TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields 1 0.2 472 1 TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields 1 0.3 335 1 TestPointFields.testDoublePointStats 1 100.0 1 1 TestPrepRecovery.classMethod 1 0.4 473 2 TestRandomChains.testRandomChains 1 67.7 1059 717 TestRandomDVFaceting.testRandomFaceting 1 100.0 1 1 TestReplicaProperties.classMethod 1 100.0 1 1 TestReplicationHandler.classMethod 1 0.6 179 1 TestSimTriggerIntegration.testTriggerThrottling 1 2.3 485 11 TestSimpleTextDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields 1 0.6 333 2 TestSkipOverseerOperations.testSkipDownOperations 1 0.3 334 1 TestStressLiveNodes.testStress 1 0.2 457 1 TestUseDocValuesAsStored.testRandomSingleAndMultiValued 1 0.2 464 1 UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues 1 0.3 340 1 UnloadDistributedZkTest.test 23 100.0 90 90 AsyncCallRequestStatusResponseTest.classMethod 23 0.6 709 7 CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale 23 0.3 641 3 CustomCollectionTest.testCustomCollectionsAPI 23 100.0 31 31 DeleteReplicaTest.classMethod 23 100.0 12 12 MissingSegmentRecoveryTest.classMethod 23 0.4 554 2 ShardSplitTest.testSplitMixedReplicaTypesLink 23 0.3 642 2 TestBlobHandler.doBlobHandlerTest 23 0.3 641 2 TestCloudCollectionsListeners.testCollectionDeletion 23 0.3 641 4 TestCloudCollectionsListeners.testSimpleCloudCollectionsListener 23 2.5 494 7 TestFileListEntityProcessor.testNTOT 23 100.0 4 4 TestSegmentSorting.classMethod 23 0.3 681 2 TestSegmentSorting.testSegmentTerminateEarly 2 0.3 305 1 AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse 2 100.0 1 1 BlobRepositoryCloudTest.classMethod 2 0.3 344 1 CollectionPropsTest.testMultipleWatchers 2 0.3 344 1 CollectionPropsTest.testReadWriteCached 2 0.4 270 1 ConnectionManagerTest.testReconnectWhenZkDisappeared 2 100.0 1 1 DistributedDebugComponentTest.classMethod 2 1.1 264 3 DistributedFacetPivotLargeTest.test 2 0.3 349 1 DistributedQueryElevationComponentTest.test 2 0.6 349 2 DistributedSpellCheckComponentTest.test 2 2.2 269 6 HttpPartitionWithTlogReplicasTest.test 2 100.0 20 20 LegacyNoFacetCloudTest.classMethod 2 0.6 345 2 SplitByPrefixTest.doTest 2 100.0 1 1 StreamingTest.classMethod 2 0.3 361 1 TestIndexFileDeleter.testExcInDecRef 2 0.3 366 1 TestIndexWriterReader.testTooManySegments 2 100.0 2 2 TestLuceneIndexBackCompat.classMethod 2 100.0 1 1 TestNumericTerms64.classMethod 2 0.4 269 1 TestRangeQuery.testCompareTypesRandomRangeQueries 2 0.4 263 1 TestReplicationHandler.doTestDetails 2 0.7 145 1 TestSimScenario.testSuggestions 2 0.0 3480 1 TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise 2 0.8 265 2 TestSortingCodecReader.testSortOnAddIndicesRandom 2 100.0 1 1 TestStressLockFactories.classMethod 2 0.3 361 1 TestStressLockFactories.testSimpleFSLockFactory 2 0.2 540 1 TestTlogReplica.testCreateDelete 2 0.4 270 1 TestTlogReplica.testRebalanceLeaders 2 0.3 287 1 TestTolerantUpdateProcessorRandomCloud.testSanityRandomUnsetBit 2 0.3 345 1 TestTrackingShardHandlerFactory.testRequestTracking 2 0.8 121 1 TestVectorUtil.testSelfDotProduct 3 100.0 1 1 AnalysisErrorHandlingTest.classMethod 3 100.0 3 3 AssignTest.classMethod 3 0.6 155 1 AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp 3 0.3 362 1 CloudHttp2SolrClientTest.testRouting 3 1.6 61 1 CloudHttp2SolrClientWireMockTest.testConcurrentParallelUpdates 3 0.4 273 1 CollectionsAPIDistributedZkTest.addReplicaTest 3 0.4 273 1 CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes 3 100.0 20 20 CollectionsAPISolrJTest.classMethod 3 0.6 159 1 ComputePlanActionTest.testSelectedCollectionsByPolicy 3 100.0 50 50 ConfigSetsAPITest.classMethod 3 0.4 278 1 ConnectionManagerTest.testLikelyExpired 3 0.3 334 1 CustomCollectionTest.testCreateShardRepFactor 3 100.0 20 20 DeleteNodeTest.classMethod 3 0.3 335 1 DeleteShardTest.test 3 0.6 155 1 ExecutePlanActionTest.testTaskTimeout 3 0.3 354 1 HttpSolrCallGetCoreTest.test 3 0.4 274 1 LeaderFailoverAfterPartitionTest.test 3 0.6 154 1 NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState 3 0.6 154 1 NodeMarkersRegistrationTest.testNodeMarkersRegistration 3 100.0 20 20 OverseerModifyCollectionTest.classMethod 3 100.0 1 1 PeerSyncReplicationTest.classMethod 3 0.4 279 1 PeerSyncReplicationTest.test 3 100.0 1 1 RollingRestartTest.classMethod 3 0.4 282 1 ShardSplitTest.testSplitLocking 3 0.4 282 1 ShardSplitTest.testSplitStaticIndexReplication 3 0.4 282 1 ShardSplitTest.testSplitStaticIndexReplicationLink 3 0.4 244 1 SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds 3 1.4 284 4 SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection 3 0.4 278 1 SolrCloudReportersTest.testExplicitConfiguration 3 0.3 371 1 SolrExampleStreamingBinaryTest.testCommitWithinOnAdd 3 0.4 274 1 SolrShardReporterTest.test 3 100.0 1 1 TestCloudConsistency.classMethod 3 0.4 279 1 TestCollectionAPI.testRecreateCollectionAfterFailure 3 4.8 21 1 TestCompressingStoredFieldsFormat.testBigDocuments 3 0.7 279 2 TestCustomStream.testDynamicLoadingCustomStream 3 0.9 231 2 TestDelegationWithHadoopAuth.testDelegationTokenRenew 3 0.5 380 2 TestDemoParallelLeafReader.testBasic 3 1.3 383 5 TestDemoParallelLeafReader.testRandomMultipleSchemaGens 3 1.0 289 3 TestDistributedSearch.test 3 1.3 160 2 TestDynamicLoading.testDynamicLoading 3 100.0 1 1 TestJsonFacets.classMethod 3 100.0 1 1 TestLocalFSCloudBackupRestore.classMethod 3 0.3 379 1 TestNRTThreads.testNRTThreads 3 0.6 154 1 TestNamedUpdateProcessors.test 3 0.4 283 1 TestPackages.testSchemaPlugins 3 0.4 273 1 TestPointFields.testFloatPointStats 3 0.3 336 1 TestPrepRecovery.testLeaderUnloaded 3 0.4 278 1 TestRandomRequestDistribution.test 3 100.0 1 1 TestSizeLimitedDistributedMap.classMethod 3 5.7 300 17 TestSpanExplanations.testExplainWithoutScoring 3 5.7 299 17 TestSpanExplanationsOfNonMatches.testExplainWithoutScoring 3 0.4 278 1 TestTlogReplica.testDeleteById 3 0.8 130 1 TestVectorValues.testAddIndexesDirectory01 3 100.0 1 1 TestWaitForStateWithJettyShutdowns.classMethod 3 100.0 1 1 TestWithCJKBigramFilter.classMethod 3 0.3 377 1 TestWithCJKBigramFilter.testMix2 ***********************Annotations report *****************AwaitsFix Annotations: ************Lucene AwaitsFix TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356") TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409") TestControlledRealTimeReopenThread.testCRTReopen @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737") TestICUNormalizer2CharFilter.testRandomStrings @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595") TestICUTokenizerCJK.TestICUTokenizerCJK suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222") TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161") ************Solr AwaitsFix CollectionsAPISolrJTest.testCreateAndDeleteShard @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021") ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource" LeaderTragicEventTest.LeaderTragicEventTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237") MoveReplicaHDFSTest.MoveReplicaHDFSTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924") MoveReplicaHDFSTest.testFailedMove @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added 03-Oct-2018 RoutedAliasUpdateProcessorTest.alias, @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696") SSLMigrationTest.SSLMigrationTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 SaslZkACLProviderTest.testSaslZkACLProvider @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075") SecurityHeadersTest.SecurityHeadersTest suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903") SolrExporterIntegrationTest.SolrExporterIntegrationTest suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786") Tagger2Test.testStopWords @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344") TestImpersonationWithHadoopAuth.testForwarding @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893") TestJsonFacetRefinement.testIndexAscRefineConsistency @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595") TestJsonFacetRefinement.testProcessEmptyRefinement @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestLTRReRankingPipeline.testDifferentTopN @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134") TestMinMaxOnMultiValuedField.testDoubleFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testFloatFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testIntFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testLongFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestPullReplica.TestPullReplica suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183") TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943") TriLevelCompositeIdRoutingTest.test @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369") *****************BadApple Annotations: ************Lucene BadApple ************Solr BadApple MoveReplicaHDFSTest.testNormalFailedMove @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 14-Oct-2018 SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Jul-2018 TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite @LuceneTestCase.BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13059")
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org